2024-09-19T08:58:39.214 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:58:39.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:58:39.336 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911893' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFavuc2UuxA+E7azx5/QcwZoCdFxfVBFK9ASjqgHn1RsNjTNd97AYK7YwUYsVDpmWkuOjado33GUNnWCkKJayWU= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuIDpgFfSCTWc/lEICr3zCuShj/kZQDCCXh1d1KlsFaeN9zveZ50vgAlL6NZ1LUlOtpRJQz6lE1efZdOepBzPs= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEc3X5edj+UvIVTCkeK1YjnlizGWn8is2K57Dm9ukr2DpbkK/yVprrp7e4Xj3zVf9S3QSYK/n2j8UZbXAV9Kyp4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:58:39.336 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:58:39.337 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:58:39.337 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:58:39.338 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:58:39.361 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:58:39.361 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:58:39.361 INFO:teuthology.packaging:ref: None 2024-09-19T08:58:39.361 INFO:teuthology.packaging:tag: None 2024-09-19T08:58:39.361 INFO:teuthology.packaging:branch: squid 2024-09-19T08:58:39.361 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:58:39.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:58:39.568 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:58:39.569 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:58:39.576 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:58:39.576 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:58:39.584 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:58:39.603 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:58:39.612 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:58:39.636 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:53:34.511932', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFavuc2UuxA+E7azx5/QcwZoCdFxfVBFK9ASjqgHn1RsNjTNd97AYK7YwUYsVDpmWkuOjado33GUNnWCkKJayWU='} 2024-09-19T08:58:39.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:53:34.513920', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuIDpgFfSCTWc/lEICr3zCuShj/kZQDCCXh1d1KlsFaeN9zveZ50vgAlL6NZ1LUlOtpRJQz6lE1efZdOepBzPs='} 2024-09-19T08:58:39.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:53:34.515644', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEc3X5edj+UvIVTCkeK1YjnlizGWn8is2K57Dm9ukr2DpbkK/yVprrp7e4Xj3zVf9S3QSYK/n2j8UZbXAV9Kyp4='} 2024-09-19T08:58:39.680 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:58:39.686 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:58:39.686 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:58:39.686 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:58:39.686 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:58:39.764 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f662ceefbe0>, signals=[15]) 2024-09-19T08:58:39.765 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:58:39.773 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:58:39.773 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T08:58:39.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:58:39.855 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T08:58:39.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:58:39.948 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-09-19T08:58:39.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:58:40.034 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:58:40.041 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-09-19T08:58:40.060 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-09-19T08:58:40.060 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-09-19T08:58:40.117 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-09-19T08:58:40.117 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-09-19T08:58:40.117 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:58:40.118 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:58:40.119 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-09-19T08:58:40.138 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-19T08:58:40.156 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-19T08:58:40.156 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-19T08:58:40.214 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-19T08:58:40.214 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:58:40.215 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:58:40.216 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-19T08:58:40.237 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-09-19T08:58:40.256 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-09-19T08:58:40.256 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-09-19T08:58:40.314 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:58:40.315 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:58:40.316 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-09-19T08:58:40.337 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:58:40.348 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:58:40.353 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:58:40.354 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:58:40.356 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:58:40.359 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:58:40.375 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:58:40.381 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:58:40.382 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:58:40.413 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:58:40.417 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:58:40.441 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:58:40.515 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:58:40.531 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:58:40.531 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T08:58:40.531 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T08:58:40.532 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:58:40.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:58:40.549 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-19T08:58:40.607 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:58:40.607 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-503.el9.x86_64 2024-09-19T08:58:40.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-09-19T08:58:43.041 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T08:58:44.959 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-19T08:58:49.484 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-19T08:58:50.960 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-19T08:58:51.914 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T08:58:57.578 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T08:58:59.518 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:58:59.518 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:58:59.601 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-19T08:58:59.608 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-19T08:58:59.608 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-19T08:58:59.608 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-19T08:58:59.608 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-19T08:58:59.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T08:58:59.610 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 79 M 2024-09-19T08:58:59.610 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 126 M 2024-09-19T08:58:59.610 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-19T08:58:59.788 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 252 kB/s | 36 kB 00:00 2024-09-19T08:59:00.354 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-19T08:59:00.855 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-19T08:59:01.505 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-19T08:59:01.505 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:59:01.505 INFO:teuthology.orchestra.run.smithi046.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-19T08:59:02.208 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-19T08:59:02.585 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-19T08:59:02.585 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-19T08:59:06.144 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-19T08:59:06.815 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:59:06.980 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:59:09.734 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:59:09.858 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:59:14.984 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:59:15.025 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:59:20.175 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:59:59.088 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:59:59.134 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:59:59.479 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:59:59.479 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:59:59.479 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:59:59.479 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:00:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:00:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:00:00.328 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-19T09:00:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:00:00.328 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:00:00.329 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:00:00.329 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:00:00.329 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:00:00.329 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-19T09:00:00.683 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:00:00.766 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:00:00.767 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:00:00.767 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:00:00.767 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:00:00.767 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:00:00.767 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:00:00.767 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:00:00.768 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:00:00.826 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:00:00.827 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:00:00.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 82.el9 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8274670 2024-09-19T09:00:00.859 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:00:00.860 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:00:00.861 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-09-19T09:00:00.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:00:00.861 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:00:00.862 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:00:00.862 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:00:00.862 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:00:01.598 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-09-19T09:00:02.909 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:00:02.934 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-09-19T09:00:02.936 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-19T09:00:02.951 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.B67wozbHR1 2024-09-19T09:00:02.951 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B67wozbHR1 2024-09-19T09:00:03.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.B67wozbHR1 2024-09-19T09:00:03.155 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.B67wozbHR1 is 6KB 2024-09-19T09:00:03.203 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.B67wozbHR1 2024-09-19T09:00:03.217 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:00:03.288 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:00:03.288 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:00:03.288 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:00:03.289 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:00:03.290 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:00:03.459 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-09-19T09:00:33.462 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:00:33.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T09:00:33.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:00:51.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-19T09:01:00.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T09:01:00.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:01:03.965 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-19T09:01:15.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T09:01:15.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:01:48.019 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-19T09:01:48.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T09:01:48.374 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:01:48.374 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-19T09:01:48.389 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:01:48.390 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:01:48.390 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:01:48.390 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:01:49.391 DEBUG:teuthology.parallel:result is None 2024-09-19T09:01:49.391 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:01:49.398 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:01:49.398 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:01:49.400 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:01:49.404 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:01:49.423 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:01:49.431 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:01:49.440 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:01:49.441 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:01:49.457 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:01:49.463 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:01:49.568 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:01:49.574 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:01:49.574 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:01:49.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:01:49.592 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:01:49.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:01:49.610 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:01:49.612 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:01:49.635 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:01:49.685 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:01:49.696 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:01:49.699 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:01:49.699 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:01:49.722 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:01:49.734 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:01:49.735 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:01:49.742 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:01:49.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:01:49.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:01:49.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:01:49.775 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:01:49.784 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:01:49.785 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:01:49.812 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:01:49.815 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:01:49.833 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:01:49.912 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:01:49.955 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:01:50.035 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:01:50.078 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:01:50.078 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:01:50.161 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:01:50.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:01:50.262 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:01:50.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:01:50.390 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:01:50.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:01:50.457 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:01:50.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:01:50.560 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:01:50.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:01:50.688 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:01:50.688 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:01:50.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-09-19T09:01:50.758 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-19T09:01:50.760 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-09-19T09:01:50.798 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:01:50.799 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:01:50.839 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:01:51.303 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:01:51.311 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:01:51.311 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:01:51.335 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:01:51.343 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:01:51.343 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-09-19T09:01:51.397 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-09-19T09:01:51.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-19T09:01:51.466 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-19T09:01:51.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-09-19T09:01:51.526 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-09-19T09:01:51.528 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:01:51.528 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-09-19T09:01:51.548 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-09-19T09:01:51.549 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-19T09:01:51.584 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-19T09:01:51.584 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-09-19T09:01:51.607 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-09-19T09:01:51.607 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:01:51.607 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:01:51.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:01:51.634 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:01:51.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:01:51.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:01:51.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:01:51.694 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:01:51.694 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:01:51.807 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:01:51.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:01:51.882 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:01:51.892 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T09:01:51.895 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T09:01:52.061 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:01:52.072 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:01:52.097 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi099.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:06:03.468 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2024-09-19T09:06:03.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T09:06:03.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:03.547 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-19T09:06:03.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-19T09:06:03.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T09:06:03.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:03.701 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-19T09:06:03.777 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T09:06:03.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-19T09:06:03.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:03.859 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-19T09:06:03.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-19T09:06:03.943 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:06:04.030 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:06:04.030 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:06:04.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:06:04.033 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:06:04.034 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:06:04.036 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:06:04.036 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:06:04.063 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:06:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:06:04.070 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:06:04.079 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:06:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:06:04.086 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:06:04.106 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-09-19T09:06:04.110 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-19T09:06:04.113 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-09-19T09:06:04.118 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-09-19T09:06:04.122 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-19T09:06:04.124 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-09-19T09:06:04.133 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:06:04.137 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:06:04.139 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:06:04.148 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:06:04.151 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:06:04.153 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:06:04.207 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:06:04.210 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:06:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:06:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:06:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-19T09:06:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.214 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:06:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-19T09:06:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.215 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.216 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:06:04.216 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-19T09:06:04.216 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.216 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.216 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.216 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:06:04.217 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:06:04.224 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:06:04.225 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:06:04.225 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:06:04.225 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:06:04.230 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:06:04.231 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:06:04.231 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:06:04.232 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:06:04.234 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:06:04.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:06:04.235 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:06:04.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:06:04.381 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:06:04.381 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:06:04.392 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:06:04.392 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:06:04.397 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:06:04.397 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:06:04.497 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:06:04.497 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:06:04.497 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:06:04.506 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:06:04.506 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:06:04.506 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:06:04.513 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:06:04.513 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:06:04.513 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:06:04.525 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:06:04.525 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:06:04.531 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:06:04.532 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:06:04.538 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:06:04.538 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:06:04.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:06:04.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:06:04.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:06:04.668 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:06:04.672 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:06:04.679 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:06:04.733 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-09-19T09:06:04.735 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-09-19T09:06:04.736 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-09-19T09:06:04.738 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-09-19T09:06:04.744 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-19T09:06:04.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-19T09:06:04.963 INFO:teuthology.orchestra.run.smithi115.stdout:45 files removed 2024-09-19T09:06:04.966 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-09-19T09:06:04.968 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-19T09:06:04.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:06:04.993 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:06:04.995 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:06:05.532 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-19T09:06:05.535 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-19T09:06:05.572 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-19T09:06:05.807 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T09:06:05.836 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 45 kB/s | 12 kB 00:00 2024-09-19T09:06:05.864 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T09:06:06.083 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T09:06:06.104 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T09:06:06.140 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:06:06.766 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T09:06:07.715 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 5.4 MB/s | 8.3 MB 00:01 2024-09-19T09:06:07.837 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-19T09:06:08.480 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-19T09:06:09.641 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-19T09:06:13.845 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-19T09:06:14.787 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-19T09:06:15.101 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-19T09:06:16.438 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-19T09:06:16.693 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-19T09:06:17.284 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T09:06:17.664 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T09:06:19.412 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-19T09:06:20.862 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-19T09:06:21.793 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T09:06:22.747 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T09:06:23.328 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T09:06:24.900 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:06:24.901 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:06:24.912 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:06:24.913 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:06:24.914 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:06:24.914 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:06:24.916 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:06:24.918 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:06:24.919 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:06:24.984 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-19T09:06:24.993 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-19T09:06:24.993 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:06:24.994 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:06:24.995 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:06:24.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:06:24.997 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:06:24.998 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:06:24.999 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:06:25.000 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:06:25.001 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:06:25.002 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:06:25.003 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:06:25.004 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:06:25.005 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:06:25.006 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout:Install 148 Packages 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 8 Packages 2024-09-19T09:06:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:06:25.008 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 226 M 2024-09-19T09:06:25.008 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-19T09:06:25.566 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:06:25.567 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:06:25.581 INFO:teuthology.orchestra.run.smithi046.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:06:25.582 INFO:teuthology.orchestra.run.smithi046.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:06:25.583 INFO:teuthology.orchestra.run.smithi046.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:06:25.584 INFO:teuthology.orchestra.run.smithi046.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:06:25.586 INFO:teuthology.orchestra.run.smithi046.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:06:25.589 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:06:25.590 INFO:teuthology.orchestra.run.smithi046.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:06:25.615 INFO:teuthology.orchestra.run.smithi115.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T09:06:25.658 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-19T09:06:25.668 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-19T09:06:25.668 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-19T09:06:25.668 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-19T09:06:25.668 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-19T09:06:25.668 INFO:teuthology.orchestra.run.smithi046.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:06:25.669 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:06:25.669 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:06:25.669 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:06:25.669 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:06:25.672 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:06:25.672 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:06:25.673 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:06:25.674 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:06:25.675 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:06:25.676 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:06:25.677 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:06:25.678 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:06:25.679 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:06:25.680 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:06:25.681 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:06:25.682 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:06:25.683 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:06:25.684 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-19T09:06:25.685 INFO:teuthology.orchestra.run.smithi046.stdout:Install 148 Packages 2024-09-19T09:06:25.686 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 8 Packages 2024-09-19T09:06:25.686 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:06:25.882 INFO:teuthology.orchestra.run.smithi115.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.3 MB/s | 896 kB 00:00 2024-09-19T09:06:25.884 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 226 M 2024-09-19T09:06:25.885 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-19T09:06:25.966 INFO:teuthology.orchestra.run.smithi115.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T09:06:25.991 INFO:teuthology.orchestra.run.smithi115.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T09:06:26.108 INFO:teuthology.orchestra.run.smithi115.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 2.4 MB 00:00 2024-09-19T09:06:26.375 INFO:teuthology.orchestra.run.smithi115.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-19T09:06:26.409 INFO:teuthology.orchestra.run.smithi115.stdout:(7/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-09-19T09:06:26.626 INFO:teuthology.orchestra.run.smithi115.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T09:06:26.668 INFO:teuthology.orchestra.run.smithi115.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T09:06:26.773 INFO:teuthology.orchestra.run.smithi046.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 35 kB/s | 6.6 kB 00:00 2024-09-19T09:06:27.185 INFO:teuthology.orchestra.run.smithi115.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 21 MB/s | 17 MB 00:00 2024-09-19T09:06:27.214 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T09:06:27.251 INFO:teuthology.orchestra.run.smithi115.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T09:06:27.306 INFO:teuthology.orchestra.run.smithi046.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.6 MB/s | 896 kB 00:00 2024-09-19T09:06:27.312 INFO:teuthology.orchestra.run.smithi115.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T09:06:27.369 INFO:teuthology.orchestra.run.smithi115.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T09:06:27.373 INFO:teuthology.orchestra.run.smithi046.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T09:06:27.474 INFO:teuthology.orchestra.run.smithi115.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 7.0 MB/s | 751 kB 00:00 2024-09-19T09:06:27.528 INFO:teuthology.orchestra.run.smithi115.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.0 MB/s | 163 kB 00:00 2024-09-19T09:06:27.586 INFO:teuthology.orchestra.run.smithi115.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T09:06:27.720 INFO:teuthology.orchestra.run.smithi115.stdout:(17/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 8.1 MB/s | 11 MB 00:01 2024-09-19T09:06:27.745 INFO:teuthology.orchestra.run.smithi115.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 3.1 MB/s | 506 kB 00:00 2024-09-19T09:06:27.804 INFO:teuthology.orchestra.run.smithi115.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 773 kB/s | 45 kB 00:00 2024-09-19T09:06:27.862 INFO:teuthology.orchestra.run.smithi115.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T09:06:27.865 INFO:teuthology.orchestra.run.smithi046.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.9 MB/s | 2.4 MB 00:00 2024-09-19T09:06:27.921 INFO:teuthology.orchestra.run.smithi115.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T09:06:27.980 INFO:teuthology.orchestra.run.smithi115.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T09:06:28.047 INFO:teuthology.orchestra.run.smithi115.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T09:06:28.105 INFO:teuthology.orchestra.run.smithi115.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T09:06:28.124 INFO:teuthology.orchestra.run.smithi046.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-19T09:06:28.164 INFO:teuthology.orchestra.run.smithi115.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T09:06:28.264 INFO:teuthology.orchestra.run.smithi115.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 9.8 MB/s | 5.3 MB 00:00 2024-09-19T09:06:28.365 INFO:teuthology.orchestra.run.smithi115.stdout:(27/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-19T09:06:28.390 INFO:teuthology.orchestra.run.smithi115.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.3 MB/s | 171 kB 00:00 2024-09-19T09:06:28.415 INFO:teuthology.orchestra.run.smithi115.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 636 kB/s | 32 kB 00:00 2024-09-19T09:06:28.449 INFO:teuthology.orchestra.run.smithi115.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T09:06:28.649 INFO:teuthology.orchestra.run.smithi046.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.0 MB/s | 4.7 MB 00:00 2024-09-19T09:06:28.674 INFO:teuthology.orchestra.run.smithi115.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 14 MB/s | 3.6 MB 00:00 2024-09-19T09:06:29.058 INFO:teuthology.orchestra.run.smithi046.stdout:(7/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.2 MB/s | 5.4 MB 00:02 2024-09-19T09:06:29.124 INFO:teuthology.orchestra.run.smithi115.stdout:(32/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 20 MB/s | 49 MB 00:02 2024-09-19T09:06:29.143 INFO:teuthology.orchestra.run.smithi115.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 532 kB/s | 249 kB 00:00 2024-09-19T09:06:29.210 INFO:teuthology.orchestra.run.smithi115.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 579 kB/s | 49 kB 00:00 2024-09-19T09:06:29.235 INFO:teuthology.orchestra.run.smithi115.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 179 kB/s | 16 kB 00:00 2024-09-19T09:06:29.303 INFO:teuthology.orchestra.run.smithi115.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.0 MB/s | 285 kB 00:00 2024-09-19T09:06:29.333 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:06:29.334 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:06:29.347 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:06:29.348 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:06:29.349 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:06:29.350 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:06:29.352 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:06:29.355 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:06:29.356 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:06:29.403 INFO:teuthology.orchestra.run.smithi115.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 183 kB/s | 18 kB 00:00 2024-09-19T09:06:29.418 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T09:06:29.437 INFO:teuthology.orchestra.run.smithi115.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 3.7 MB/s | 765 kB 00:00 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:06:29.438 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:06:29.439 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:06:29.440 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:06:29.441 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:06:29.442 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:06:29.443 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:06:29.444 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:06:29.445 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:06:29.446 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:06:29.447 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:06:29.448 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:06:29.449 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:06:29.450 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:06:29.451 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout:Install 148 Packages 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 8 Packages 2024-09-19T09:06:29.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:06:29.453 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 226 M 2024-09-19T09:06:29.453 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T09:06:29.645 INFO:teuthology.orchestra.run.smithi115.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 6.2 MB/s | 7.4 MB 00:01 2024-09-19T09:06:29.650 INFO:teuthology.orchestra.run.smithi046.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 17 MB 00:01 2024-09-19T09:06:29.725 INFO:teuthology.orchestra.run.smithi046.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 337 kB/s | 25 kB 00:00 2024-09-19T09:06:29.779 INFO:teuthology.orchestra.run.smithi115.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 212 kB/s | 80 kB 00:00 2024-09-19T09:06:29.906 INFO:teuthology.orchestra.run.smithi099.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 29 kB/s | 6.6 kB 00:00 2024-09-19T09:06:30.162 INFO:teuthology.orchestra.run.smithi115.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 661 kB/s | 253 kB 00:00 2024-09-19T09:06:30.196 INFO:teuthology.orchestra.run.smithi115.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-19T09:06:30.313 INFO:teuthology.orchestra.run.smithi115.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 914 kB/s | 106 kB 00:00 2024-09-19T09:06:30.355 INFO:teuthology.orchestra.run.smithi115.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 873 kB/s | 801 kB 00:00 2024-09-19T09:06:30.422 INFO:teuthology.orchestra.run.smithi115.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-19T09:06:30.472 INFO:teuthology.orchestra.run.smithi115.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-19T09:06:30.539 INFO:teuthology.orchestra.run.smithi115.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-19T09:06:30.573 INFO:teuthology.orchestra.run.smithi099.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-19T09:06:30.581 INFO:teuthology.orchestra.run.smithi115.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-09-19T09:06:30.731 INFO:teuthology.orchestra.run.smithi115.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-19T09:06:30.732 INFO:teuthology.orchestra.run.smithi099.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 917 kB/s | 145 kB 00:00 2024-09-19T09:06:30.756 INFO:teuthology.orchestra.run.smithi115.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 610 kB/s | 107 kB 00:00 2024-09-19T09:06:30.782 INFO:teuthology.orchestra.run.smithi115.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-19T09:06:30.832 INFO:teuthology.orchestra.run.smithi115.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-19T09:06:30.857 INFO:teuthology.orchestra.run.smithi115.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-19T09:06:30.882 INFO:teuthology.orchestra.run.smithi115.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-19T09:06:30.900 INFO:teuthology.orchestra.run.smithi115.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-09-19T09:06:30.924 INFO:teuthology.orchestra.run.smithi115.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-19T09:06:30.958 INFO:teuthology.orchestra.run.smithi115.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T09:06:30.983 INFO:teuthology.orchestra.run.smithi115.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-19T09:06:31.042 INFO:teuthology.orchestra.run.smithi115.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-19T09:06:31.076 INFO:teuthology.orchestra.run.smithi115.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T09:06:31.093 INFO:teuthology.orchestra.run.smithi115.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-19T09:06:31.126 INFO:teuthology.orchestra.run.smithi115.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-19T09:06:31.152 INFO:teuthology.orchestra.run.smithi115.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-19T09:06:31.177 INFO:teuthology.orchestra.run.smithi115.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T09:06:31.213 INFO:teuthology.orchestra.run.smithi115.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T09:06:31.236 INFO:teuthology.orchestra.run.smithi115.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 457 kB/s | 38 kB 00:00 2024-09-19T09:06:31.370 INFO:teuthology.orchestra.run.smithi115.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T09:06:31.462 INFO:teuthology.orchestra.run.smithi115.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-19T09:06:31.503 INFO:teuthology.orchestra.run.smithi115.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-19T09:06:31.532 INFO:teuthology.orchestra.run.smithi099.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.9 MB/s | 5.4 MB 00:01 2024-09-19T09:06:31.562 INFO:teuthology.orchestra.run.smithi115.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T09:06:31.587 INFO:teuthology.orchestra.run.smithi115.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-19T09:06:31.646 INFO:teuthology.orchestra.run.smithi115.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T09:06:31.671 INFO:teuthology.orchestra.run.smithi115.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T09:06:31.755 INFO:teuthology.orchestra.run.smithi115.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T09:06:31.780 INFO:teuthology.orchestra.run.smithi115.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-19T09:06:31.814 INFO:teuthology.orchestra.run.smithi115.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-19T09:06:31.839 INFO:teuthology.orchestra.run.smithi115.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-19T09:06:31.840 INFO:teuthology.orchestra.run.smithi099.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-19T09:06:31.873 INFO:teuthology.orchestra.run.smithi115.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-19T09:06:31.898 INFO:teuthology.orchestra.run.smithi115.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-19T09:06:31.957 INFO:teuthology.orchestra.run.smithi099.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.9 MB/s | 2.4 MB 00:01 2024-09-19T09:06:31.958 INFO:teuthology.orchestra.run.smithi046.stdout:(10/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 22 MB/s | 49 MB 00:02 2024-09-19T09:06:31.973 INFO:teuthology.orchestra.run.smithi115.stdout:(80/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-19T09:06:31.999 INFO:teuthology.orchestra.run.smithi115.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-19T09:06:32.017 INFO:teuthology.orchestra.run.smithi046.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.9 MB/s | 228 kB 00:00 2024-09-19T09:06:32.032 INFO:teuthology.orchestra.run.smithi115.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-19T09:06:32.066 INFO:teuthology.orchestra.run.smithi115.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.6 MB/s | 250 kB 00:00 2024-09-19T09:06:32.084 INFO:teuthology.orchestra.run.smithi046.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 405 kB/s | 27 kB 00:00 2024-09-19T09:06:32.091 INFO:teuthology.orchestra.run.smithi115.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-19T09:06:32.125 INFO:teuthology.orchestra.run.smithi115.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T09:06:32.150 INFO:teuthology.orchestra.run.smithi115.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-19T09:06:32.150 INFO:teuthology.orchestra.run.smithi046.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 477 kB/s | 32 kB 00:00 2024-09-19T09:06:32.184 INFO:teuthology.orchestra.run.smithi115.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T09:06:32.243 INFO:teuthology.orchestra.run.smithi046.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T09:06:32.251 INFO:teuthology.orchestra.run.smithi115.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-19T09:06:32.276 INFO:teuthology.orchestra.run.smithi115.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-19T09:06:32.301 INFO:teuthology.orchestra.run.smithi115.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-19T09:06:32.309 INFO:teuthology.orchestra.run.smithi046.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T09:06:32.318 INFO:teuthology.orchestra.run.smithi115.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-09-19T09:06:32.335 INFO:teuthology.orchestra.run.smithi115.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-09-19T09:06:32.368 INFO:teuthology.orchestra.run.smithi115.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-19T09:06:32.394 INFO:teuthology.orchestra.run.smithi115.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 749 kB/s | 44 kB 00:00 2024-09-19T09:06:32.401 INFO:teuthology.orchestra.run.smithi046.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.3 MB/s | 127 kB 00:00 2024-09-19T09:06:32.428 INFO:teuthology.orchestra.run.smithi115.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T09:06:32.445 INFO:teuthology.orchestra.run.smithi115.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 712 kB/s | 36 kB 00:00 2024-09-19T09:06:32.470 INFO:teuthology.orchestra.run.smithi115.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T09:06:32.502 INFO:teuthology.orchestra.run.smithi046.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 4.9 MB/s | 506 kB 00:00 2024-09-19T09:06:32.540 INFO:teuthology.orchestra.run.smithi115.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.1 MB/s | 304 kB 00:00 2024-09-19T09:06:32.562 INFO:teuthology.orchestra.run.smithi115.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 630 kB/s | 58 kB 00:00 2024-09-19T09:06:32.596 INFO:teuthology.orchestra.run.smithi115.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.7 MB/s | 96 kB 00:00 2024-09-19T09:06:32.621 INFO:teuthology.orchestra.run.smithi115.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T09:06:32.638 INFO:teuthology.orchestra.run.smithi115.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-19T09:06:32.830 INFO:teuthology.orchestra.run.smithi115.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T09:06:32.844 INFO:teuthology.orchestra.run.smithi046.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T09:06:32.855 INFO:teuthology.orchestra.run.smithi115.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-09-19T09:06:32.899 INFO:teuthology.orchestra.run.smithi099.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 4.4 MB/s | 4.7 MB 00:01 2024-09-19T09:06:32.906 INFO:teuthology.orchestra.run.smithi115.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-19T09:06:32.931 INFO:teuthology.orchestra.run.smithi115.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-19T09:06:32.944 INFO:teuthology.orchestra.run.smithi046.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 452 kB/s | 45 kB 00:00 2024-09-19T09:06:32.956 INFO:teuthology.orchestra.run.smithi115.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-19T09:06:32.981 INFO:teuthology.orchestra.run.smithi115.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:06:33.034 INFO:teuthology.orchestra.run.smithi115.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 939 kB/s | 49 kB 00:00 2024-09-19T09:06:33.044 INFO:teuthology.orchestra.run.smithi046.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.3 MB/s | 136 kB 00:00 2024-09-19T09:06:33.065 INFO:teuthology.orchestra.run.smithi115.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-19T09:06:33.091 INFO:teuthology.orchestra.run.smithi115.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-09-19T09:06:33.103 INFO:teuthology.orchestra.run.smithi046.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T09:06:33.149 INFO:teuthology.orchestra.run.smithi115.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T09:06:33.183 INFO:teuthology.orchestra.run.smithi115.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-19T09:06:33.203 INFO:teuthology.orchestra.run.smithi046.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.1 MB/s | 320 kB 00:00 2024-09-19T09:06:33.216 INFO:teuthology.orchestra.run.smithi115.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-19T09:06:33.242 INFO:teuthology.orchestra.run.smithi115.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-09-19T09:06:33.267 INFO:teuthology.orchestra.run.smithi115.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-19T09:06:33.292 INFO:teuthology.orchestra.run.smithi115.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-19T09:06:33.318 INFO:teuthology.orchestra.run.smithi115.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T09:06:33.351 INFO:teuthology.orchestra.run.smithi115.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:06:33.418 INFO:teuthology.orchestra.run.smithi115.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-19T09:06:33.443 INFO:teuthology.orchestra.run.smithi115.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-19T09:06:33.469 INFO:teuthology.orchestra.run.smithi115.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-19T09:06:33.494 INFO:teuthology.orchestra.run.smithi115.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T09:06:33.519 INFO:teuthology.orchestra.run.smithi115.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-19T09:06:33.545 INFO:teuthology.orchestra.run.smithi115.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T09:06:33.570 INFO:teuthology.orchestra.run.smithi115.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-19T09:06:33.595 INFO:teuthology.orchestra.run.smithi115.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T09:06:33.620 INFO:teuthology.orchestra.run.smithi115.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T09:06:33.646 INFO:teuthology.orchestra.run.smithi115.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:06:33.671 INFO:teuthology.orchestra.run.smithi115.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:06:33.696 INFO:teuthology.orchestra.run.smithi115.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:06:33.730 INFO:teuthology.orchestra.run.smithi115.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T09:06:33.755 INFO:teuthology.orchestra.run.smithi115.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-19T09:06:33.789 INFO:teuthology.orchestra.run.smithi115.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-19T09:06:33.814 INFO:teuthology.orchestra.run.smithi115.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T09:06:33.831 INFO:teuthology.orchestra.run.smithi115.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-19T09:06:33.845 INFO:teuthology.orchestra.run.smithi046.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 469 kB/s | 300 kB 00:00 2024-09-19T09:06:33.848 INFO:teuthology.orchestra.run.smithi115.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 915 kB/s | 31 kB 00:00 2024-09-19T09:06:33.865 INFO:teuthology.orchestra.run.smithi115.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-19T09:06:33.890 INFO:teuthology.orchestra.run.smithi115.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-19T09:06:33.907 INFO:teuthology.orchestra.run.smithi115.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 858 kB/s | 36 kB 00:00 2024-09-19T09:06:33.924 INFO:teuthology.orchestra.run.smithi115.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 4.4 MB/s | 74 kB 00:00 2024-09-19T09:06:33.954 INFO:teuthology.orchestra.run.smithi046.stdout:(24/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 2.2 MB/s | 11 MB 00:04 2024-09-19T09:06:33.958 INFO:teuthology.orchestra.run.smithi115.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-19T09:06:33.979 INFO:teuthology.orchestra.run.smithi046.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 744 kB/s | 99 kB 00:00 2024-09-19T09:06:33.983 INFO:teuthology.orchestra.run.smithi115.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-19T09:06:34.008 INFO:teuthology.orchestra.run.smithi115.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T09:06:34.033 INFO:teuthology.orchestra.run.smithi115.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T09:06:34.037 INFO:teuthology.orchestra.run.smithi046.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-19T09:06:34.059 INFO:teuthology.orchestra.run.smithi115.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:06:34.084 INFO:teuthology.orchestra.run.smithi115.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T09:06:34.134 INFO:teuthology.orchestra.run.smithi115.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:06:34.213 INFO:teuthology.orchestra.run.smithi046.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 978 kB/s | 171 kB 00:00 2024-09-19T09:06:34.263 INFO:teuthology.orchestra.run.smithi046.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-19T09:06:34.281 INFO:teuthology.orchestra.run.smithi046.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 473 kB/s | 32 kB 00:00 2024-09-19T09:06:34.339 INFO:teuthology.orchestra.run.smithi046.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T09:06:34.876 INFO:teuthology.orchestra.run.smithi115.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 4.2 MB/s | 3.4 MB 00:00 2024-09-19T09:06:34.906 INFO:teuthology.orchestra.run.smithi046.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-19T09:06:34.989 INFO:teuthology.orchestra.run.smithi046.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T09:06:35.065 INFO:teuthology.orchestra.run.smithi046.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 656 kB/s | 49 kB 00:00 2024-09-19T09:06:35.148 INFO:teuthology.orchestra.run.smithi046.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 198 kB/s | 16 kB 00:00 2024-09-19T09:06:35.176 INFO:teuthology.orchestra.run.smithi115.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-09-19T09:06:35.224 INFO:teuthology.orchestra.run.smithi046.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T09:06:35.293 INFO:teuthology.orchestra.run.smithi115.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 351 kB/s | 41 kB 00:00 2024-09-19T09:06:35.324 INFO:teuthology.orchestra.run.smithi046.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.5 MB/s | 765 kB 00:00 2024-09-19T09:06:35.399 INFO:teuthology.orchestra.run.smithi046.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 243 kB/s | 18 kB 00:00 2024-09-19T09:06:35.419 INFO:teuthology.orchestra.run.smithi115.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T09:06:35.482 INFO:teuthology.orchestra.run.smithi099.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 3.7 MB/s | 21 MB 00:05 2024-09-19T09:06:35.561 INFO:teuthology.orchestra.run.smithi115.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 1.4 MB 00:00 2024-09-19T09:06:35.599 INFO:teuthology.orchestra.run.smithi099.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 11 MB 00:02 2024-09-19T09:06:35.624 INFO:teuthology.orchestra.run.smithi099.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 177 kB/s | 25 kB 00:00 2024-09-19T09:06:35.674 INFO:teuthology.orchestra.run.smithi046.stdout:(38/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 2.6 MB/s | 3.6 MB 00:01 2024-09-19T09:06:35.686 INFO:teuthology.orchestra.run.smithi115.stdout:(154/156): librbd1-19.1.1-361.g2f599a46.el9.x86 2.0 MB/s | 3.2 MB 00:01 2024-09-19T09:06:35.691 INFO:teuthology.orchestra.run.smithi099.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.4 MB/s | 228 kB 00:00 2024-09-19T09:06:35.742 INFO:teuthology.orchestra.run.smithi099.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 540 kB/s | 27 kB 00:00 2024-09-19T09:06:35.792 INFO:teuthology.orchestra.run.smithi099.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 637 kB/s | 32 kB 00:00 2024-09-19T09:06:35.875 INFO:teuthology.orchestra.run.smithi046.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 168 kB/s | 80 kB 00:00 2024-09-19T09:06:35.909 INFO:teuthology.orchestra.run.smithi099.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-19T09:06:35.911 INFO:teuthology.orchestra.run.smithi115.stdout:(155/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-09-19T09:06:35.959 INFO:teuthology.orchestra.run.smithi099.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T09:06:36.009 INFO:teuthology.orchestra.run.smithi099.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:06:36.093 INFO:teuthology.orchestra.run.smithi099.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T09:06:36.192 INFO:teuthology.orchestra.run.smithi046.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 604 kB/s | 191 kB 00:00 2024-09-19T09:06:36.511 INFO:teuthology.orchestra.run.smithi115.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 2.4 MB 00:00 2024-09-19T09:06:36.517 INFO:teuthology.orchestra.run.smithi046.stdout:(41/156): ceph-common-19.1.1-361.g2f599a46.el9. 2.1 MB/s | 21 MB 00:09 2024-09-19T09:06:36.518 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:06:36.518 INFO:teuthology.orchestra.run.smithi115.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-19T09:06:36.542 INFO:teuthology.orchestra.run.smithi046.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 723 kB/s | 253 kB 00:00 2024-09-19T09:06:36.567 INFO:teuthology.orchestra.run.smithi046.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 898 kB/s | 801 kB 00:00 2024-09-19T09:06:36.659 INFO:teuthology.orchestra.run.smithi046.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 911 kB/s | 106 kB 00:00 2024-09-19T09:06:36.685 INFO:teuthology.orchestra.run.smithi046.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T09:06:36.777 INFO:teuthology.orchestra.run.smithi046.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-19T09:06:36.802 INFO:teuthology.orchestra.run.smithi046.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-19T09:06:36.985 INFO:teuthology.orchestra.run.smithi046.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-19T09:06:37.010 INFO:teuthology.orchestra.run.smithi099.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 5.8 MB/s | 5.3 MB 00:00 2024-09-19T09:06:37.019 INFO:teuthology.orchestra.run.smithi046.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-19T09:06:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-19T09:06:37.060 INFO:teuthology.orchestra.run.smithi099.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 908 kB/s | 45 kB 00:00 2024-09-19T09:06:37.069 INFO:teuthology.orchestra.run.smithi046.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-19T09:06:37.095 INFO:teuthology.orchestra.run.smithi046.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T09:06:37.110 INFO:teuthology.orchestra.run.smithi099.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T09:06:37.120 INFO:teuthology.orchestra.run.smithi046.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-19T09:06:37.160 INFO:teuthology.orchestra.run.smithi099.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T09:06:37.162 INFO:teuthology.orchestra.run.smithi046.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-19T09:06:37.204 INFO:teuthology.orchestra.run.smithi046.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-19T09:06:37.227 INFO:teuthology.orchestra.run.smithi099.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T09:06:37.254 INFO:teuthology.orchestra.run.smithi046.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-19T09:06:37.280 INFO:teuthology.orchestra.run.smithi046.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T09:06:37.294 INFO:teuthology.orchestra.run.smithi099.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T09:06:37.305 INFO:teuthology.orchestra.run.smithi046.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-19T09:06:37.339 INFO:teuthology.orchestra.run.smithi046.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T09:06:37.344 INFO:teuthology.orchestra.run.smithi099.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:06:37.374 INFO:teuthology.orchestra.run.smithi046.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-19T09:06:37.398 INFO:teuthology.orchestra.run.smithi046.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T09:06:37.440 INFO:teuthology.orchestra.run.smithi046.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-19T09:06:37.465 INFO:teuthology.orchestra.run.smithi046.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T09:06:37.499 INFO:teuthology.orchestra.run.smithi046.stdout:(64/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-09-19T09:06:37.524 INFO:teuthology.orchestra.run.smithi046.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 655 kB/s | 38 kB 00:00 2024-09-19T09:06:37.528 INFO:teuthology.orchestra.run.smithi099.stdout:(25/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 3.0 MB/s | 17 MB 00:05 2024-09-19T09:06:37.549 INFO:teuthology.orchestra.run.smithi046.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T09:06:37.553 INFO:teuthology.orchestra.run.smithi099.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 409 kB/s | 85 kB 00:00 2024-09-19T09:06:37.604 INFO:teuthology.orchestra.run.smithi099.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.4 MB/s | 171 kB 00:00 2024-09-19T09:06:37.607 INFO:teuthology.orchestra.run.smithi046.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-19T09:06:37.645 INFO:teuthology.orchestra.run.smithi099.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 771 kB/s | 32 kB 00:00 2024-09-19T09:06:37.683 INFO:teuthology.orchestra.run.smithi046.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-19T09:06:37.696 INFO:teuthology.orchestra.run.smithi099.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T09:06:37.716 INFO:teuthology.orchestra.run.smithi046.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-19T09:06:37.742 INFO:teuthology.orchestra.run.smithi046.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T09:06:37.753 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-19T09:06:37.801 INFO:teuthology.orchestra.run.smithi046.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-19T09:06:37.876 INFO:teuthology.orchestra.run.smithi046.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-09-19T09:06:37.892 INFO:teuthology.orchestra.run.smithi046.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 956 kB/s | 87 kB 00:00 2024-09-19T09:06:37.905 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-19T09:06:37.905 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-19T09:06:37.963 INFO:teuthology.orchestra.run.smithi099.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 7.1 MB/s | 3.1 MB 00:00 2024-09-19T09:06:37.968 INFO:teuthology.orchestra.run.smithi046.stdout:(74/156): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-19T09:06:37.993 INFO:teuthology.orchestra.run.smithi046.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 610 kB/s | 61 kB 00:00 2024-09-19T09:06:38.018 INFO:teuthology.orchestra.run.smithi046.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-19T09:06:38.044 INFO:teuthology.orchestra.run.smithi046.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T09:06:38.069 INFO:teuthology.orchestra.run.smithi046.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-19T09:06:38.088 INFO:teuthology.orchestra.run.smithi099.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.1 MB/s | 3.6 MB 00:00 2024-09-19T09:06:38.094 INFO:teuthology.orchestra.run.smithi046.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T09:06:38.120 INFO:teuthology.orchestra.run.smithi046.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T09:06:38.138 INFO:teuthology.orchestra.run.smithi099.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T09:06:38.144 INFO:teuthology.orchestra.run.smithi046.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-19T09:06:38.180 INFO:teuthology.orchestra.run.smithi099.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T09:06:38.195 INFO:teuthology.orchestra.run.smithi046.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-19T09:06:38.222 INFO:teuthology.orchestra.run.smithi099.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 396 kB/s | 16 kB 00:00 2024-09-19T09:06:38.270 INFO:teuthology.orchestra.run.smithi046.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T09:06:38.289 INFO:teuthology.orchestra.run.smithi099.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T09:06:38.295 INFO:teuthology.orchestra.run.smithi046.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-19T09:06:38.321 INFO:teuthology.orchestra.run.smithi046.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:06:38.337 INFO:teuthology.orchestra.run.smithi046.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T09:06:38.390 INFO:teuthology.orchestra.run.smithi099.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.5 MB/s | 765 kB 00:00 2024-09-19T09:06:38.413 INFO:teuthology.orchestra.run.smithi046.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-19T09:06:38.439 INFO:teuthology.orchestra.run.smithi046.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-19T09:06:38.440 INFO:teuthology.orchestra.run.smithi099.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 365 kB/s | 18 kB 00:00 2024-09-19T09:06:38.464 INFO:teuthology.orchestra.run.smithi046.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-09-19T09:06:38.489 INFO:teuthology.orchestra.run.smithi046.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T09:06:38.514 INFO:teuthology.orchestra.run.smithi046.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T09:06:38.548 INFO:teuthology.orchestra.run.smithi046.stdout:(92/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-19T09:06:38.573 INFO:teuthology.orchestra.run.smithi046.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-19T09:06:38.574 INFO:teuthology.orchestra.run.smithi099.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 600 kB/s | 80 kB 00:00 2024-09-19T09:06:38.598 INFO:teuthology.orchestra.run.smithi046.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-19T09:06:38.624 INFO:teuthology.orchestra.run.smithi046.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T09:06:38.650 INFO:teuthology.orchestra.run.smithi046.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-19T09:06:38.674 INFO:teuthology.orchestra.run.smithi046.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T09:06:38.699 INFO:teuthology.orchestra.run.smithi099.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 6.3 MB/s | 801 kB 00:00 2024-09-19T09:06:38.699 INFO:teuthology.orchestra.run.smithi046.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T09:06:38.725 INFO:teuthology.orchestra.run.smithi046.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T09:06:38.749 INFO:teuthology.orchestra.run.smithi099.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:06:38.750 INFO:teuthology.orchestra.run.smithi046.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T09:06:38.775 INFO:teuthology.orchestra.run.smithi046.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:06:38.799 INFO:teuthology.orchestra.run.smithi099.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-19T09:06:38.801 INFO:teuthology.orchestra.run.smithi046.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-19T09:06:38.875 INFO:teuthology.orchestra.run.smithi099.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-19T09:06:38.884 INFO:teuthology.orchestra.run.smithi046.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-19T09:06:38.934 INFO:teuthology.orchestra.run.smithi046.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:06:38.958 INFO:teuthology.orchestra.run.smithi099.stdout:(43/156): ceph-mgr-diskprediction-local-19.1.1- 7.4 MB/s | 7.4 MB 00:00 2024-09-19T09:06:38.968 INFO:teuthology.orchestra.run.smithi046.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T09:06:38.984 INFO:teuthology.orchestra.run.smithi099.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2024-09-19T09:06:38.993 INFO:teuthology.orchestra.run.smithi046.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-19T09:06:39.034 INFO:teuthology.orchestra.run.smithi099.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T09:06:39.084 INFO:teuthology.orchestra.run.smithi099.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T09:06:39.109 INFO:teuthology.orchestra.run.smithi099.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 898 kB/s | 135 kB 00:00 2024-09-19T09:06:39.169 INFO:teuthology.orchestra.run.smithi046.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-19T09:06:39.219 INFO:teuthology.orchestra.run.smithi046.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-19T09:06:39.253 INFO:teuthology.orchestra.run.smithi046.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-09-19T09:06:39.260 INFO:teuthology.orchestra.run.smithi099.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-19T09:06:39.270 INFO:teuthology.orchestra.run.smithi046.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 4.5 MB/s | 67 kB 00:00 2024-09-19T09:06:39.295 INFO:teuthology.orchestra.run.smithi046.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 644 kB/s | 49 kB 00:00 2024-09-19T09:06:39.318 INFO:teuthology.orchestra.run.smithi099.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-19T09:06:39.320 INFO:teuthology.orchestra.run.smithi046.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-19T09:06:39.352 INFO:teuthology.orchestra.run.smithi099.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-19T09:06:39.362 INFO:teuthology.orchestra.run.smithi046.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T09:06:39.369 INFO:teuthology.orchestra.run.smithi099.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-19T09:06:39.387 INFO:teuthology.orchestra.run.smithi046.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:06:39.403 INFO:teuthology.orchestra.run.smithi099.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 986 kB/s | 33 kB 00:00 2024-09-19T09:06:39.412 INFO:teuthology.orchestra.run.smithi046.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:06:39.438 INFO:teuthology.orchestra.run.smithi046.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T09:06:39.461 INFO:teuthology.orchestra.run.smithi099.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-19T09:06:39.471 INFO:teuthology.orchestra.run.smithi046.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-19T09:06:39.494 INFO:teuthology.orchestra.run.smithi099.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 548 kB/s | 18 kB 00:00 2024-09-19T09:06:39.528 INFO:teuthology.orchestra.run.smithi099.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 335 kB/s | 11 kB 00:00 2024-09-19T09:06:39.555 INFO:teuthology.orchestra.run.smithi046.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-09-19T09:06:39.603 INFO:teuthology.orchestra.run.smithi099.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T09:06:39.622 INFO:teuthology.orchestra.run.smithi046.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2024-09-19T09:06:39.637 INFO:teuthology.orchestra.run.smithi099.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-19T09:06:39.648 INFO:teuthology.orchestra.run.smithi046.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 2.0 MB/s | 358 kB 00:00 2024-09-19T09:06:39.673 INFO:teuthology.orchestra.run.smithi046.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-19T09:06:39.698 INFO:teuthology.orchestra.run.smithi046.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-19T09:06:39.714 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-19T09:06:39.715 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-19T09:06:39.723 INFO:teuthology.orchestra.run.smithi046.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T09:06:39.770 INFO:teuthology.orchestra.run.smithi046.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 151 kB/s | 11 kB 00:00 2024-09-19T09:06:39.791 INFO:teuthology.orchestra.run.smithi046.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-09-19T09:06:39.808 INFO:teuthology.orchestra.run.smithi046.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 613 kB/s | 23 kB 00:00 2024-09-19T09:06:39.825 INFO:teuthology.orchestra.run.smithi046.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 581 kB/s | 19 kB 00:00 2024-09-19T09:06:39.829 INFO:teuthology.orchestra.run.smithi099.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-19T09:06:39.841 INFO:teuthology.orchestra.run.smithi046.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-09-19T09:06:39.859 INFO:teuthology.orchestra.run.smithi046.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T09:06:39.884 INFO:teuthology.orchestra.run.smithi046.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:06:39.909 INFO:teuthology.orchestra.run.smithi046.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:06:39.943 INFO:teuthology.orchestra.run.smithi046.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-19T09:06:39.968 INFO:teuthology.orchestra.run.smithi046.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-19T09:06:40.002 INFO:teuthology.orchestra.run.smithi046.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-19T09:06:40.013 INFO:teuthology.orchestra.run.smithi099.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T09:06:40.027 INFO:teuthology.orchestra.run.smithi046.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T09:06:40.046 INFO:teuthology.orchestra.run.smithi099.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 741 kB/s | 24 kB 00:00 2024-09-19T09:06:40.052 INFO:teuthology.orchestra.run.smithi046.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-19T09:06:40.077 INFO:teuthology.orchestra.run.smithi046.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T09:06:40.079 INFO:teuthology.orchestra.run.smithi099.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T09:06:40.102 INFO:teuthology.orchestra.run.smithi046.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:06:40.128 INFO:teuthology.orchestra.run.smithi046.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:06:40.153 INFO:teuthology.orchestra.run.smithi046.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T09:06:40.178 INFO:teuthology.orchestra.run.smithi046.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:06:40.204 INFO:teuthology.orchestra.run.smithi046.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:06:40.246 INFO:teuthology.orchestra.run.smithi046.stdout:(143/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-19T09:06:40.271 INFO:teuthology.orchestra.run.smithi046.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-19T09:06:40.296 INFO:teuthology.orchestra.run.smithi046.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-19T09:06:40.321 INFO:teuthology.orchestra.run.smithi046.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:06:40.355 INFO:teuthology.orchestra.run.smithi046.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T09:06:40.405 INFO:teuthology.orchestra.run.smithi046.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:06:40.563 INFO:teuthology.orchestra.run.smithi099.stdout:(62/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 9.8 MB/s | 49 MB 00:04 2024-09-19T09:06:40.588 INFO:teuthology.orchestra.run.smithi099.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 575 kB/s | 292 kB 00:00 2024-09-19T09:06:40.638 INFO:teuthology.orchestra.run.smithi099.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-09-19T09:06:40.655 INFO:teuthology.orchestra.run.smithi099.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-19T09:06:40.731 INFO:teuthology.orchestra.run.smithi046.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.4 MB/s | 3.2 MB 00:00 2024-09-19T09:06:40.748 INFO:teuthology.orchestra.run.smithi099.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-09-19T09:06:40.923 INFO:teuthology.orchestra.run.smithi046.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 5.7 MB/s | 3.4 MB 00:00 2024-09-19T09:06:41.065 INFO:teuthology.orchestra.run.smithi099.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-19T09:06:41.298 INFO:teuthology.orchestra.run.smithi046.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 109 kB/s | 41 kB 00:00 2024-09-19T09:06:41.332 INFO:teuthology.orchestra.run.smithi099.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-19T09:06:41.340 INFO:teuthology.orchestra.run.smithi046.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2024-09-19T09:06:41.390 INFO:teuthology.orchestra.run.smithi099.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T09:06:41.557 INFO:teuthology.orchestra.run.smithi046.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 2.2 MB/s | 1.8 MB 00:00 2024-09-19T09:06:41.599 INFO:teuthology.orchestra.run.smithi046.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-19T09:06:41.757 INFO:teuthology.orchestra.run.smithi046.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 542 kB/s | 249 kB 00:00 2024-09-19T09:06:41.849 INFO:teuthology.orchestra.run.smithi099.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-19T09:06:41.899 INFO:teuthology.orchestra.run.smithi046.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.0 MB/s | 2.4 MB 00:00 2024-09-19T09:06:41.905 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:06:41.906 INFO:teuthology.orchestra.run.smithi046.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-19T09:06:42.007 INFO:teuthology.orchestra.run.smithi099.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-19T09:06:42.057 INFO:teuthology.orchestra.run.smithi099.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T09:06:42.199 INFO:teuthology.orchestra.run.smithi099.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-19T09:06:42.241 INFO:teuthology.orchestra.run.smithi099.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:06:42.325 INFO:teuthology.orchestra.run.smithi099.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T09:06:42.409 INFO:teuthology.orchestra.run.smithi099.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T09:06:42.450 INFO:teuthology.orchestra.run.smithi099.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 620 kB/s | 26 kB 00:00 2024-09-19T09:06:42.492 INFO:teuthology.orchestra.run.smithi099.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 459 kB/s | 19 kB 00:00 2024-09-19T09:06:42.567 INFO:teuthology.orchestra.run.smithi099.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-09-19T09:06:42.609 INFO:teuthology.orchestra.run.smithi099.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 835 kB/s | 35 kB 00:00 2024-09-19T09:06:43.110 INFO:teuthology.orchestra.run.smithi099.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-19T09:06:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-19T09:06:43.201 INFO:teuthology.orchestra.run.smithi099.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-19T09:06:43.285 INFO:teuthology.orchestra.run.smithi099.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T09:06:43.343 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-19T09:06:43.343 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-19T09:06:43.344 INFO:teuthology.orchestra.run.smithi099.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T09:06:43.386 INFO:teuthology.orchestra.run.smithi099.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T09:06:43.486 INFO:teuthology.orchestra.run.smithi099.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-19T09:06:43.561 INFO:teuthology.orchestra.run.smithi099.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T09:06:43.661 INFO:teuthology.orchestra.run.smithi099.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-19T09:06:43.695 INFO:teuthology.orchestra.run.smithi099.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-09-19T09:06:43.729 INFO:teuthology.orchestra.run.smithi099.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T09:06:43.971 INFO:teuthology.orchestra.run.smithi099.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-19T09:06:44.004 INFO:teuthology.orchestra.run.smithi099.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T09:06:44.038 INFO:teuthology.orchestra.run.smithi099.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T09:06:44.130 INFO:teuthology.orchestra.run.smithi099.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.4 MB/s | 5.1 MB 00:01 2024-09-19T09:06:44.171 INFO:teuthology.orchestra.run.smithi099.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-19T09:06:44.188 INFO:teuthology.orchestra.run.smithi099.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-09-19T09:06:44.205 INFO:teuthology.orchestra.run.smithi099.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T09:06:44.239 INFO:teuthology.orchestra.run.smithi099.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2024-09-19T09:06:44.298 INFO:teuthology.orchestra.run.smithi099.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-19T09:06:44.323 INFO:teuthology.orchestra.run.smithi099.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T09:06:44.356 INFO:teuthology.orchestra.run.smithi099.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T09:06:44.382 INFO:teuthology.orchestra.run.smithi099.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-19T09:06:44.482 INFO:teuthology.orchestra.run.smithi099.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-19T09:06:44.541 INFO:teuthology.orchestra.run.smithi099.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T09:06:44.574 INFO:teuthology.orchestra.run.smithi099.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T09:06:44.591 INFO:teuthology.orchestra.run.smithi099.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-19T09:06:44.708 INFO:teuthology.orchestra.run.smithi099.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-19T09:06:44.725 INFO:teuthology.orchestra.run.smithi099.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T09:06:44.759 INFO:teuthology.orchestra.run.smithi099.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-19T09:06:44.784 INFO:teuthology.orchestra.run.smithi099.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2024-09-19T09:06:44.818 INFO:teuthology.orchestra.run.smithi099.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.7 MB/s | 151 kB 00:00 2024-09-19T09:06:44.851 INFO:teuthology.orchestra.run.smithi099.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-09-19T09:06:44.885 INFO:teuthology.orchestra.run.smithi099.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 13 MB/s | 839 kB 00:00 2024-09-19T09:06:44.910 INFO:teuthology.orchestra.run.smithi099.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:06:44.935 INFO:teuthology.orchestra.run.smithi099.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:06:44.961 INFO:teuthology.orchestra.run.smithi099.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T09:06:44.986 INFO:teuthology.orchestra.run.smithi099.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-19T09:06:45.011 INFO:teuthology.orchestra.run.smithi099.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-19T09:06:45.045 INFO:teuthology.orchestra.run.smithi099.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:06:45.070 INFO:teuthology.orchestra.run.smithi099.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T09:06:45.104 INFO:teuthology.orchestra.run.smithi099.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T09:06:45.137 INFO:teuthology.orchestra.run.smithi099.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T09:06:45.196 INFO:teuthology.orchestra.run.smithi099.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-19T09:06:45.221 INFO:teuthology.orchestra.run.smithi099.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-19T09:06:45.246 INFO:teuthology.orchestra.run.smithi099.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-19T09:06:45.288 INFO:teuthology.orchestra.run.smithi099.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-09-19T09:06:45.314 INFO:teuthology.orchestra.run.smithi099.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 291 kB/s | 19 kB 00:00 2024-09-19T09:06:45.339 INFO:teuthology.orchestra.run.smithi099.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-19T09:06:45.373 INFO:teuthology.orchestra.run.smithi099.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T09:06:45.398 INFO:teuthology.orchestra.run.smithi099.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:06:45.423 INFO:teuthology.orchestra.run.smithi099.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:06:45.457 INFO:teuthology.orchestra.run.smithi099.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T09:06:45.482 INFO:teuthology.orchestra.run.smithi099.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-19T09:06:45.516 INFO:teuthology.orchestra.run.smithi099.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-19T09:06:45.541 INFO:teuthology.orchestra.run.smithi099.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T09:06:45.566 INFO:teuthology.orchestra.run.smithi099.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-19T09:06:45.592 INFO:teuthology.orchestra.run.smithi099.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T09:06:45.617 INFO:teuthology.orchestra.run.smithi099.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:06:45.641 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-19T09:06:45.642 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-19T09:06:45.642 INFO:teuthology.orchestra.run.smithi099.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T09:06:45.659 INFO:teuthology.orchestra.run.smithi099.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-09-19T09:06:45.684 INFO:teuthology.orchestra.run.smithi099.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-19T09:06:45.710 INFO:teuthology.orchestra.run.smithi099.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:06:45.735 INFO:teuthology.orchestra.run.smithi099.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T09:06:45.752 INFO:teuthology.orchestra.run.smithi099.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T09:06:45.777 INFO:teuthology.orchestra.run.smithi099.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T09:06:45.844 INFO:teuthology.orchestra.run.smithi099.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T09:06:45.894 INFO:teuthology.orchestra.run.smithi099.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-19T09:06:46.173 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-19T09:06:46.220 INFO:teuthology.orchestra.run.smithi099.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-19T09:06:46.281 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:06:46.319 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:06:46.328 INFO:teuthology.orchestra.run.smithi099.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 7.1 MB/s | 3.4 MB 00:00 2024-09-19T09:06:46.372 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:06:46.407 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:06:46.432 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:06:46.475 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:06:46.512 INFO:teuthology.orchestra.run.smithi099.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 8.0 MB/s | 2.3 MB 00:00 2024-09-19T09:06:46.554 INFO:teuthology.orchestra.run.smithi099.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 985 kB/s | 41 kB 00:00 2024-09-19T09:06:46.604 INFO:teuthology.orchestra.run.smithi099.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T09:06:46.638 INFO:teuthology.orchestra.run.smithi099.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-09-19T09:06:46.679 INFO:teuthology.orchestra.run.smithi099.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-19T09:06:46.730 INFO:teuthology.orchestra.run.smithi099.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-19T09:06:46.806 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:06:46.911 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:06:47.039 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:06:47.068 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:06:47.158 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:06:47.189 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:06:47.338 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:06:47.394 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:06:47.421 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:06:47.525 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:06:47.547 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:06:47.610 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:06:47.632 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:06:47.655 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:06:47.850 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:06:47.996 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:06:48.130 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:06:48.239 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:06:48.306 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:06:48.526 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:06:48.627 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:06:48.715 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:06:48.745 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:06:48.788 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:06:48.846 INFO:teuthology.orchestra.run.smithi099.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.2 MB/s | 16 MB 00:05 2024-09-19T09:06:48.851 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:06:48.851 INFO:teuthology.orchestra.run.smithi099.stdout:Total 12 MB/s | 226 MB 00:19 2024-09-19T09:06:48.852 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:06:48.897 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:06:48.932 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:06:48.976 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:06:49.008 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:06:49.036 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:06:49.113 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:06:49.167 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:06:49.197 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:06:49.232 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:06:49.300 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:06:49.335 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:06:49.378 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:06:49.407 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:06:49.477 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:06:49.522 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:06:49.596 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:06:49.730 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:06:49.799 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:06:50.081 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T09:06:50.231 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T09:06:50.231 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T09:06:50.327 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:06:50.412 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:06:50.449 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:06:50.491 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:06:50.530 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:06:50.572 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:06:50.732 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:06:50.799 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:06:50.854 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:06:50.929 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:06:50.961 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:06:50.997 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:06:51.044 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:06:51.087 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:06:51.130 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:06:51.173 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:06:51.308 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:06:51.350 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:06:51.391 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:06:51.495 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:06:51.692 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:06:51.724 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:06:51.749 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:06:51.773 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:06:51.852 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:06:51.982 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:06:52.014 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:06:52.041 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T09:06:52.042 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:06:52.042 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T09:06:52.076 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:06:52.124 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:06:52.155 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:06:52.179 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-19T09:06:52.185 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:06:52.220 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:06:52.253 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:06:52.295 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:06:52.296 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:06:52.329 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:06:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:06:52.416 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:06:52.459 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:06:52.502 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:06:52.598 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:06:52.601 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:06:52.640 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:06:52.658 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:06:52.664 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:06:52.727 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:06:53.073 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:06:53.165 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:06:53.291 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:06:53.316 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:06:53.380 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:06:53.409 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:06:53.430 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:06:53.444 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:06:53.464 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:06:53.568 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:06:53.616 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:06:53.619 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:06:53.665 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:06:53.669 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:06:53.696 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:06:53.752 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:06:53.784 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:06:53.802 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:06:53.830 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:06:53.894 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:06:53.923 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:06:53.951 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:06:53.968 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:06:53.990 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:06:54.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:06:54.135 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:06:54.307 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:06:54.430 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:06:54.541 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:06:54.606 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:06:54.717 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:06:54.829 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:06:54.837 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:06:54.951 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:06:55.044 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:06:55.078 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:06:55.114 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:06:55.189 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:06:55.239 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:06:55.280 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:06:55.323 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:06:55.356 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:06:55.383 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:06:55.456 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:06:55.515 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:06:55.545 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:06:55.588 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:06:55.667 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:06:55.699 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:06:55.743 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:06:55.771 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:06:55.844 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:06:55.885 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:06:55.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:06:56.080 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:06:56.116 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:06:56.171 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:06:56.172 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:06:56.198 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:06:56.231 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:06:56.543 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:06:56.595 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:06:56.710 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:06:56.728 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:06:56.741 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:06:56.777 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:06:56.811 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:06:56.846 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:06:56.900 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:06:57.161 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:06:57.257 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:06:57.281 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:06:57.344 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:06:57.353 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:06:57.366 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:06:57.531 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:06:57.597 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:06:57.653 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:06:57.752 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:06:57.789 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:06:57.825 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:06:57.873 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:06:57.908 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:06:58.044 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:06:58.086 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:06:58.229 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:06:58.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:06:58.300 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T09:06:58.312 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:06:58.382 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:06:58.418 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:06:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:06:58.453 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:06:58.474 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:06:58.494 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:06:58.508 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:06:58.527 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:06:58.533 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:06:58.551 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:06:58.576 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:06:58.656 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:06:58.783 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:06:58.821 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:06:58.849 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:06:58.883 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:06:58.931 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:06:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:06:58.970 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:06:59.000 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:06:59.035 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:06:59.068 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:06:59.110 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:06:59.134 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:06:59.144 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:06:59.234 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:06:59.255 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:06:59.285 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:06:59.292 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:06:59.322 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:06:59.376 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:06:59.414 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:06:59.430 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:06:59.493 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:06:59.567 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:06:59.580 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:06:59.619 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:06:59.621 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:06:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:06:59.742 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:06:59.765 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:06:59.828 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:06:59.850 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:06:59.875 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:07:00.084 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:07:00.166 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:00.199 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:07:00.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:07:00.254 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:07:00.295 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:07:00.297 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:07:00.298 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:07:00.298 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:07:00.298 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:00.325 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:07:00.329 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:07:00.339 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:07:00.434 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:07:00.443 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:07:00.494 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:07:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:07:00.539 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:07:00.629 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:07:00.665 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:07:00.752 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:07:00.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:07:00.863 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:07:00.888 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:07:00.969 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:07:00.980 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:07:01.012 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:07:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:07:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:07:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:07:01.205 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:07:01.248 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:07:01.280 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:07:01.308 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:07:01.378 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:07:01.439 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:07:01.470 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:07:01.513 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:07:01.589 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:07:01.627 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:07:01.657 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:07:01.678 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:07:01.707 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:07:01.766 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:07:01.778 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:07:01.822 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:07:01.896 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:07:02.038 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:07:02.091 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:07:02.618 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:07:02.703 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:07:02.732 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:07:02.774 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:07:02.813 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:07:02.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:07:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:07:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:07:03.100 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:07:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:07:03.185 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:07:03.218 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:07:03.219 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:07:03.246 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:07:03.250 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:07:03.286 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:07:03.333 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:07:03.368 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:07:03.411 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:07:03.462 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:07:03.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:07:03.600 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:07:03.617 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:07:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:07:03.717 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:07:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:07:03.747 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:07:03.788 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:07:03.833 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:07:03.872 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:07:03.920 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:07:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:07:03.970 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:07:04.043 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:07:04.171 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:07:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:07:04.234 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:07:04.264 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:07:04.292 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:07:04.303 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:07:04.320 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:07:04.343 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:07:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:07:04.392 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:07:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:07:04.422 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:07:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:07:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:07:04.516 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:07:04.604 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:07:04.647 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:07:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:07:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:07:04.846 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:07:05.574 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:07:05.634 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:07:05.668 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:07:05.767 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:07:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:07:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:07:05.949 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:07:06.014 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:07:06.188 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:07:06.211 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:07:06.288 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:07:06.839 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:06.876 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:06.935 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:07:07.051 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:07:07.455 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:07.488 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:07:07.584 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:07:07.584 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:07:07.584 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:07:07.584 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:07.631 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:07:08.279 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:07:08.355 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:07:08.383 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:07:08.416 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:07:08.719 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:07:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:07:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:07:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:07:08.936 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:07:09.417 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:07:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:07:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:07:09.551 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:07:11.881 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:11.913 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:12.030 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-09-19T09:07:12.031 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:12.202 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:07:12.218 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:07:12.218 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:12.218 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:07:12.218 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:12.461 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:07:12.500 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:07:12.590 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:07:12.591 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:07:12.591 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:07:12.591 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:12.618 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:07:13.696 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:07:13.722 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:07:13.723 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:13.723 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:07:13.723 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:07:13.723 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:07:13.723 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:13.947 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:07:13.971 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:07:13.971 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:13.971 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:07:13.971 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:07:13.971 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:07:13.972 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:14.416 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:07:14.440 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:07:14.440 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:14.440 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:07:14.440 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:07:14.441 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:07:14.441 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:14.538 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:07:14.595 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:07:14.651 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:07:14.838 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:07:14.892 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:07:14.971 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:07:15.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:07:15.208 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:07:15.278 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:07:15.307 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:07:15.335 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:07:15.798 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:07:15.825 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:07:15.857 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:07:15.920 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:07:15.948 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:07:17.005 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:07:17.082 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:07:18.042 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:07:18.066 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:07:18.171 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:07:18.328 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:07:18.361 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:07:18.384 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:07:18.385 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:18.385 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:07:18.385 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:07:18.385 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:07:18.385 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:18.428 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:07:18.440 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:07:18.537 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:07:18.593 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:07:19.516 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:07:19.547 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:07:19.570 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:07:19.571 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:19.571 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:07:19.571 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:07:19.571 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:07:19.571 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:19.614 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:07:19.637 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:07:19.637 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:19.637 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:07:19.638 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:19.681 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:07:19.705 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:07:19.705 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:19.705 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:07:19.705 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:07:19.705 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:07:19.705 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:20.007 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:07:20.030 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:07:20.031 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:20.031 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:07:20.031 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:07:20.031 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:07:20.031 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:20.050 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-09-19T09:07:20.051 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:20.237 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:07:20.254 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:07:20.254 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:20.254 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:07:20.255 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:21.782 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:07:21.810 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:07:21.810 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:21.810 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:07:21.810 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:07:21.810 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:07:21.811 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:22.040 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:07:22.065 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:07:22.065 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:22.065 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:07:22.065 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:07:22.066 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:07:22.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:22.524 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:07:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:07:22.550 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:22.550 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:07:22.550 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:07:22.550 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:07:22.550 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:22.655 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:07:22.714 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:07:22.777 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:07:22.972 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:07:23.026 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:07:23.107 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:07:23.205 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:07:23.347 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:07:23.396 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:07:23.433 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:07:23.460 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:07:23.891 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:07:23.917 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:07:23.949 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:07:24.013 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:07:24.048 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:07:24.413 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-19T09:07:24.414 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:24.585 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:07:24.586 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:07:24.601 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:24.627 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:07:24.668 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:07:24.701 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:07:24.728 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:07:24.914 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:07:24.957 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:07:24.988 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:07:25.017 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:07:25.055 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:07:25.158 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:07:25.192 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:07:25.567 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:25.603 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:25.623 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:26.095 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:07:26.122 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:07:26.122 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:26.123 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:07:26.123 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:07:26.123 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:07:26.123 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:26.207 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:07:26.242 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:07:26.351 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:07:26.355 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:07:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:07:26.380 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:26.380 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:07:26.380 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:07:26.380 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:07:26.380 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:26.446 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:07:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:07:26.533 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:07:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:07:26.574 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:07:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:07:26.578 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:26.578 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:07:26.578 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:07:26.578 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:07:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:07:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:07:26.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:07:26.686 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:07:26.711 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:07:26.737 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:07:26.738 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:07:26.743 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:07:26.803 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:07:26.823 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:07:26.830 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:07:26.830 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:07:26.846 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:07:26.847 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:26.847 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:07:26.847 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:07:26.847 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:07:26.847 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:26.913 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:07:26.939 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:07:26.944 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:26.944 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:26.953 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:07:27.010 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:07:27.066 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:07:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:27.124 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:07:27.233 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:07:27.253 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:07:27.298 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:07:27.304 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:27.377 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:07:27.466 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:07:27.607 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:07:27.649 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:07:27.680 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:07:27.708 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:07:27.779 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:07:27.823 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:07:27.848 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:07:27.848 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:27.848 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:07:27.848 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:07:27.848 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:07:27.848 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:27.890 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:07:27.914 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:07:27.914 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:27.914 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:07:27.914 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:27.965 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:07:27.991 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:07:27.991 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:27.991 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:07:27.991 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:07:27.991 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:07:27.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:28.144 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:07:28.173 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:07:28.205 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:07:28.268 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:07:28.305 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:07:28.307 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:07:28.333 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:07:28.333 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:28.333 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:07:28.333 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:07:28.333 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:07:28.333 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:29.353 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:07:29.398 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:07:30.355 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:07:30.390 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:07:30.493 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:07:30.660 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:07:30.700 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:07:30.725 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:07:30.725 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:30.725 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:07:30.725 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:07:30.725 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:07:30.725 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:07:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:07:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:07:30.932 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:07:31.862 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:07:31.896 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:07:31.920 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:07:31.920 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:31.920 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:07:31.920 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:07:31.921 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:07:31.921 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:31.971 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:07:31.994 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:07:31.995 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:31.995 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:07:31.995 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:32.047 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:07:32.070 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:07:32.070 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:32.070 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:07:32.071 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:07:32.071 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:07:32.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:32.372 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:07:32.396 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:07:32.396 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:07:32.396 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:07:32.396 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:07:32.396 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:07:32.396 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:07:32.982 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:07:32.983 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:07:32.984 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:07:32.984 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:07:32.984 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:07:32.984 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:07:32.984 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:07:32.996 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:07:32.996 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:07:32.997 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:07:32.998 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:07:32.999 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:07:33.000 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:07:33.001 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:07:33.002 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:07:33.003 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:07:33.004 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:07:33.005 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:07:33.006 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:07:33.007 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:07:33.154 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:07:33.195 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:07:33.237 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:07:33.268 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:07:33.295 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:07:33.495 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:07:33.542 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:07:33.572 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:07:33.602 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:07:33.667 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:07:34.231 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:34.270 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:34.292 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:35.200 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:07:35.292 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:07:35.346 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:07:35.436 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:07:35.470 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:07:35.496 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:07:35.522 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:07:35.522 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:07:35.631 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:07:35.631 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:07:35.715 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:07:35.740 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:07:35.746 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:35.746 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:35.815 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.816 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.817 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:07:35.818 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:07:35.819 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:07:35.820 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:07:35.821 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:07:35.822 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:07:35.823 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:07:35.824 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:07:35.825 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:07:35.826 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:07:35.827 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:07:35.828 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-19T09:07:35.933 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:35.934 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:07:36.017 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:07:36.086 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:36.297 DEBUG:teuthology.parallel:result is None 2024-09-19T09:07:36.925 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:07:36.968 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:07:37.007 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:07:37.039 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:07:37.067 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:07:37.255 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:07:37.305 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:07:37.327 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:07:37.365 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:07:37.403 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:07:38.049 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:38.092 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:38.113 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:07:38.936 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:07:39.022 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:07:39.063 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:07:39.153 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:07:39.200 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:07:39.225 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:07:39.259 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:07:39.260 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:07:39.327 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:07:39.327 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:07:39.411 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:07:39.436 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:07:39.441 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:39.442 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:39.621 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:07:39.621 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:07:39.713 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:07:39.779 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:41.684 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:41.684 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:07:41.685 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:07:41.686 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:07:41.687 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:07:41.688 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:07:41.689 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:07:41.690 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:07:41.691 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:07:41.692 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:07:41.693 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:07:41.694 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:07:41.695 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:07:41.696 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:07:41.697 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:07:41.698 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:07:41.698 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:07:41.698 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:07:41.698 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:07:41.698 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:07:44.323 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:44.323 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:44.324 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.325 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.326 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:07:44.327 INFO:teuthology.orchestra.run.smithi046.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:07:44.328 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:07:44.328 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:07:44.328 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:07:44.328 INFO:teuthology.orchestra.run.smithi046.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:07:44.328 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:07:44.328 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:07:44.329 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:07:44.330 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:07:44.331 INFO:teuthology.orchestra.run.smithi046.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.332 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:07:44.333 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:07:44.334 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:07:44.336 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:07:44.336 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:07:44.336 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:07:44.336 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:07:44.336 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:07:44.336 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:07:44.337 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:07:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:07:44.339 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:07:44.340 INFO:teuthology.orchestra.run.smithi046.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:07:44.341 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:07:44.341 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-19T09:07:44.834 DEBUG:teuthology.parallel:result is None 2024-09-19T09:07:45.484 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:45.484 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:07:45.484 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:07:45.484 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:07:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:07:45.486 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:07:45.487 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:07:45.487 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:07:45.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:07:45.500 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:07:45.501 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:07:45.502 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:07:45.503 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:07:45.504 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:07:45.505 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:07:45.506 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:07:45.507 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:07:45.508 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:07:45.509 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:07:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:07:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:07:45.510 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:07:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:07:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:48.021 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-19T09:07:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:48.021 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.022 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:07:48.024 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.025 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:07:48.026 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:07:48.027 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:07:48.028 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:07:48.029 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:07:48.030 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.031 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:07:48.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:07:48.033 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:07:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:07:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:07:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:07:48.034 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:07:48.034 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T09:07:48.423 DEBUG:teuthology.parallel:result is None 2024-09-19T09:07:48.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:07:48.575 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:07:48.602 INFO:teuthology.orchestra.run.smithi046.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:07:48.603 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:07:48.603 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:07:48.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:07:48.748 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:07:48.772 INFO:teuthology.orchestra.run.smithi099.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:07:48.772 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:07:48.772 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:07:48.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:07:48.914 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:07:48.941 INFO:teuthology.orchestra.run.smithi115.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:07:48.941 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:07:48.941 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:07:48.943 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:07:48.943 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:07:48.943 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:07:48.978 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:07:48.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:07:49.006 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:07:49.006 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:07:49.039 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:07:49.039 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:07:49.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:07:49.069 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:07:49.138 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:07:49.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:07:49.165 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:07:49.231 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:07:49.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:07:49.262 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:07:49.345 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:07:49.345 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:07:49.345 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:07:49.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:07:49.445 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:07:49.445 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:07:49.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:07:49.536 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:07:49.536 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:07:49.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:07:49.627 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:07:49.628 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:07:49.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:07:49.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:07:49.730 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:07:49.730 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:07:49.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:07:49.820 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:07:49.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:07:49.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:07:49.911 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T09:07:50.010 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T09:07:50.010 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:07:50.011 INFO:tasks.cephadm:Cluster fsid is a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:07:50.011 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T09:07:50.011 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.46', 'mon.b': '172.21.15.99', 'mon.c': '172.21.15.115'} 2024-09-19T09:07:50.011 INFO:tasks.cephadm:First mon is mon.a on smithi046 2024-09-19T09:07:50.011 INFO:tasks.cephadm:First mgr is x 2024-09-19T09:07:50.011 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T09:07:50.012 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-09-19T09:07:50.042 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-09-19T09:07:50.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname $(hostname -s) 2024-09-19T09:07:50.094 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T09:07:50.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:07:50.240 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T09:07:50.388 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:07:50.389 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:07:50.389 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:07:50.390 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:50.794 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:07 /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:50.794 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.179 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:07 /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.179 DEBUG:teuthology.orchestra.run.smithi115:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.560 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:07 /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.560 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.581 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.601 DEBUG:teuthology.orchestra.run.smithi115:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:07:51.636 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T09:07:51.636 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:07:51.639 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:07:51.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:07:53.179 INFO:teuthology.orchestra.run.smithi115.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:07:53.277 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:07:53.360 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:08:22.659 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:08:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:08:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:08:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-09-19T09:08:22.659 INFO:teuthology.orchestra.run.smithi046.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:08:22.660 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:08:22.660 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout: "repo_digests": [ 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-09-19T09:08:22.882 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-19T09:08:24.229 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T09:08:24.230 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:08:24.230 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:08:24.230 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-09-19T09:08:24.230 INFO:teuthology.orchestra.run.smithi099.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:08:24.230 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-19T09:08:24.230 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T09:08:24.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-09-19T09:08:24.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-09-19T09:08:24.320 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph 2024-09-19T09:08:24.352 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-09-19T09:08:24.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-09-19T09:08:24.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /etc/ceph 2024-09-19T09:08:24.437 INFO:tasks.cephadm:Writing seed config... 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T09:08:24.439 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T09:08:24.440 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T09:08:24.441 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T09:08:24.442 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T09:08:24.443 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:08:24.444 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T09:08:24.462 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a514acda-7666-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T09:08:24.463 DEBUG:teuthology.orchestra.run.smithi046:mon.a> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T09:08:24.506 DEBUG:teuthology.orchestra.run.smithi046:mgr.x> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T09:08:24.549 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T09:08:24.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid a514acda-7666-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:24.764 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:08:24.764 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'a514acda-7666-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2024-09-19T09:08:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T09:08:24.765 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2024-09-19T09:08:24.797 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:08:24.797 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2024-09-19T09:08:24.797 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2024-09-19T09:08:24.805 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:08:24.805 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:08:24.812 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:08:24.812 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-19T09:08:24.818 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-19T09:08:24.825 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-19T09:08:24.825 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:08:24.825 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2024-09-19T09:08:24.848 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:08:24.848 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T09:08:24.848 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2024-09-19T09:08:24.848 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2024-09-19T09:08:24.855 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:08:24.855 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:08:24.861 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:08:24.861 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-19T09:08:24.868 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-19T09:08:24.875 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-19T09:08:24.875 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:08:24.875 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2024-09-19T09:08:24.875 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 140481906381824 on /run/cephadm/a514acda-7666-11ef-bceb-c7b262605968.lock 2024-09-19T09:08:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 140481906381824 acquired on /run/cephadm/a514acda-7666-11ef-bceb-c7b262605968.lock 2024-09-19T09:08:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2024-09-19T09:08:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2024-09-19T09:08:24.876 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-19T09:08:24.880 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.46 metric 100 2024-09-19T09:08:24.880 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2024-09-19T09:08:24.882 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T09:08:24.883 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T09:08:24.883 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-09-19T09:08:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T09:08:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T09:08:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:08:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T09:08:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-19T09:08:24.886 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:08:24.886 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-19T09:08:24.886 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-19T09:08:24.886 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T09:08:24.887 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T09:08:24.888 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:08:25.344 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:08:25.344 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:08:25.344 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T09:08:25.344 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T09:08:25.345 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T09:08:25.345 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:08:25.345 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T09:08:26.273 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:08:26.273 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:08:26.273 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T09:08:27.163 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2024-09-19T09:08:27.163 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2024-09-19T09:08:28.202 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAL6utmVUyxHRAAv/zgS0KAkyKMVSI8X+cFqQ== 2024-09-19T09:08:29.141 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAM6utmPCcwHxAAi8V03XVOTlzYU9GqoORmIw== 2024-09-19T09:08:30.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAN6utmn5NUGxAAIhB7l9Du1rNU+hVmTBu2jQ== 2024-09-19T09:08:30.006 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for a [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-09-19T09:08:31.028 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:31.029 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:08:31.029 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:08:31.029 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2024-09-19T09:08:35.406 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.a on 2024-09-19T09:08:36.037 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T09:08:36.474 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T09:08:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a514acda-7666-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-a514acda-7666-11ef-bceb-c7b262605968.target. 2024-09-19T09:08:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a514acda-7666-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-a514acda-7666-11ef-bceb-c7b262605968.target. 2024-09-19T09:08:37.911 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:08:37.911 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T09:08:38.173 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a514acda-7666-11ef-bceb-c7b262605968.target.wants/ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-a514acda-7666-11ef-bceb-c7b262605968@.service. 2024-09-19T09:08:38.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:38 smithi046 podman[30816]: 2024-09-19 09:08:38.339279309 +0000 UTC m=+0.016560432 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:08:39.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:39 smithi046 podman[30816]: 2024-09-19 09:08:39.320311757 +0000 UTC m=+0.997592945 container create ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:08:41.148 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:08:41.148 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-19T09:08:41.156 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:08:41.156 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-19T09:08:41.156 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-19T09:08:41.156 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:08:41.156 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2024-09-19T09:08:41.157 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2024-09-19T09:08:41.290 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:41 smithi046 podman[30816]: 2024-09-19 09:08:41.023588376 +0000 UTC m=+2.700869505 container init ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:08:41.291 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:41 smithi046 podman[30816]: 2024-09-19 09:08:41.028324916 +0000 UTC m=+2.705606039 container start ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:08:41.291 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:41 smithi046 ceph-mon[30835]: mkfs a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:41.291 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:41 smithi046 ceph-mon[30835]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:08:41.291 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:41 smithi046 bash[30816]: ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b 2024-09-19T09:08:41.291 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:41 smithi046 systemd[1]: Started Ceph mon.a for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:08:42.296 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T09:08:42.296 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:42.296 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T09:08:42.296 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:42.296 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.592176s) 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.592+0000 7fac415f9640 1 Processor -- start 2024-09-19T09:08:42.297 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.592+0000 7fac415f9640 1 -- start start 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.592+0000 7fac415f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c1079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.592+0000 7fac415f9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c107fc0 con 0x7fac3c1075f0 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.593+0000 7fac3affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c1079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.593+0000 7fac3affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c1079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48264/0 (socket says 172.21.15.46:48264) 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.593+0000 7fac3affd640 1 -- 172.21.15.46:0/1485718260 learned_addr learned my addr 172.21.15.46:0/1485718260 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.593+0000 7fac3affd640 1 -- 172.21.15.46:0/1485718260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c1087a0 con 0x7fac3c1075f0 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.595+0000 7fac3affd640 1 --2- 172.21.15.46:0/1485718260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c1079f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009820 tx=0x7fac2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed49013672bd02c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.595+0000 7fac3a7fc640 1 -- 172.21.15.46:0/1485718260 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c037070 con 0x7fac3c1075f0 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.595+0000 7fac3a7fc640 1 -- 172.21.15.46:0/1485718260 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c032440 con 0x7fac3c1075f0 2024-09-19T09:08:42.298 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.595+0000 7fac3a7fc640 1 -- 172.21.15.46:0/1485718260 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c032740 con 0x7fac3c1075f0 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 -- 172.21.15.46:0/1485718260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 msgr2=0x7fac3c1079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 --2- 172.21.15.46:0/1485718260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c1079f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009820 tx=0x7fac2c02a270 comp rx=0 tx=0).stop 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 -- 172.21.15.46:0/1485718260 shutdown_connections 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 --2- 172.21.15.46:0/1485718260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c1079f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 -- 172.21.15.46:0/1485718260 >> 172.21.15.46:0/1485718260 conn(0x7fac3c102dc0 msgr2=0x7fac3c1051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 -- 172.21.15.46:0/1485718260 shutdown_connections 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.596+0000 7fac415f9640 1 -- 172.21.15.46:0/1485718260 wait complete. 2024-09-19T09:08:42.299 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac415f9640 1 Processor -- start 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac415f9640 1 -- start start 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac415f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c07db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac415f9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c108d40 con 0x7fac3c1075f0 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac3affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c07db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac3affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c07db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48266/0 (socket says 172.21.15.46:48266) 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac3affd640 1 -- 172.21.15.46:0/4208788009 learned_addr learned my addr 172.21.15.46:0/4208788009 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.597+0000 7fac3affd640 1 -- 172.21.15.46:0/4208788009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c07e060 con 0x7fac3c1075f0 2024-09-19T09:08:42.300 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac3affd640 1 --2- 172.21.15.46:0/4208788009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c07db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0090b0 tx=0x7fac2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c041070 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c07c250 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac2c03c7a0 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac2c037040 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c07c790 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac2c044070 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.598+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fac2c03d3f0 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.599+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c109390 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.601+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fac2c046450 con 0x7fac3c1075f0 2024-09-19T09:08:42.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.663+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fac3c1943e0 con 0x7fac3c1075f0 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.663+0000 7fac38ff9640 1 -- 172.21.15.46:0/4208788009 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fac2c046630 con 0x7fac3c1075f0 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 msgr2=0x7fac3c07db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 --2- 172.21.15.46:0/4208788009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c07db20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0090b0 tx=0x7fac2c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 shutdown_connections 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 --2- 172.21.15.46:0/4208788009 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c1075f0 0x7fac3c07db20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 >> 172.21.15.46:0/4208788009 conn(0x7fac3c102dc0 msgr2=0x7fac3c191ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 shutdown_connections 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:41.664+0000 7fac415f9640 1 -- 172.21.15.46:0/4208788009 wait complete. 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2024-09-19T09:08:42.302 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: monmap epoch 1 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: last_changed 2024-09-19T09:08:30.337142+0000 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: min_mon_release 19 (squid) 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: election_strategy: 1 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: fsmap 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: mgrmap e1: no daemons active 2024-09-19T09:08:42.414 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:42 smithi046 ceph-mon[30835]: from='client.? 172.21.15.46:0/4208788009' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T09:08:43.416 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:43 smithi046 ceph-mon[30835]: from='client.? 172.21.15.46:0/2972649092' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:08:43.417 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:43 smithi046 ceph-mon[30835]: from='client.? 172.21.15.46:0/2972649092' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T09:08:43.531 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:08:43.532 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:43.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:08:43.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:08:43.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:08:43.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:08:43.533 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.757+0000 7f181f8b7640 1 Processor -- start 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.757+0000 7f181f8b7640 1 -- start start 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.758+0000 7f181f8b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181810a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.758+0000 7f181f8b7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f181807bda0 con 0x7f1818108040 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.758+0000 7f181d653640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181810a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.758+0000 7f181d653640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181810a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48268/0 (socket says 172.21.15.46:48268) 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.758+0000 7f181d653640 1 -- 172.21.15.46:0/943675586 learned_addr learned my addr 172.21.15.46:0/943675586 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.758+0000 7f181d653640 1 -- 172.21.15.46:0/943675586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181810a970 con 0x7f1818108040 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.759+0000 7f181d653640 1 --2- 172.21.15.46:0/943675586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181810a430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1810009820 tx=0x7f181002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e312235beb5942c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:43.534 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.759+0000 7f1817fff640 1 -- 172.21.15.46:0/943675586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1810037070 con 0x7f1818108040 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.759+0000 7f1817fff640 1 -- 172.21.15.46:0/943675586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1810032440 con 0x7f1818108040 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.759+0000 7f1817fff640 1 -- 172.21.15.46:0/943675586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1810032740 con 0x7f1818108040 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 -- 172.21.15.46:0/943675586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 msgr2=0x7f181810a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 --2- 172.21.15.46:0/943675586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181810a430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1810009820 tx=0x7f181002a270 comp rx=0 tx=0).stop 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 -- 172.21.15.46:0/943675586 shutdown_connections 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 --2- 172.21.15.46:0/943675586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181810a430 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 -- 172.21.15.46:0/943675586 >> 172.21.15.46:0/943675586 conn(0x7f1818101b80 msgr2=0x7f1818103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 -- 172.21.15.46:0/943675586 shutdown_connections 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 -- 172.21.15.46:0/943675586 wait complete. 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 Processor -- start 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.760+0000 7f181f8b7640 1 -- start start 2024-09-19T09:08:43.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181f8b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181819afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181f8b7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f181810adf0 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181d653640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181819afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181d653640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181819afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48276/0 (socket says 172.21.15.46:48276) 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181d653640 1 -- 172.21.15.46:0/2972649092 learned_addr learned my addr 172.21.15.46:0/2972649092 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181d653640 1 -- 172.21.15.46:0/2972649092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181819b520 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181d653640 1 --2- 172.21.15.46:0/2972649092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181819afe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1810009820 tx=0x7f18100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1810041070 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181003c7a0 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181819b7b0 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1810037040 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.761+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181819e4a0 con 0x7f1818108040 2024-09-19T09:08:43.536 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.762+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1810044070 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.762+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1810046dd0 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.762+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18181084a0 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.765+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1810046450 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.824+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f181819f7f0 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.827+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f1810046630 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 msgr2=0x7f181819afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f18167fc640 1 -- 172.21.15.46:0/2972649092 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1810055070 con 0x7f1818108040 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 --2- 172.21.15.46:0/2972649092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181819afe0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1810009820 tx=0x7f18100046c0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.537 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 shutdown_connections 2024-09-19T09:08:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 --2- 172.21.15.46:0/2972649092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1818108040 0x7f181819afe0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 >> 172.21.15.46:0/2972649092 conn(0x7f1818101b80 msgr2=0x7f1818102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 shutdown_connections 2024-09-19T09:08:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:42.828+0000 7f181f8b7640 1 -- 172.21.15.46:0/2972649092 wait complete. 2024-09-19T09:08:43.538 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2024-09-19T09:08:44.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:44 smithi046 ceph-mon[30835]: from='client.? 172.21.15.46:0/4187901284' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:08:45.083 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.305+0000 7f25a29d5640 1 Processor -- start 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.305+0000 7f25a29d5640 1 -- start start 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.306+0000 7f25a29d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c10a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.306+0000 7f25a29d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f259c07be20 con 0x7f259c107fc0 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.306+0000 7f259bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c10a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.306+0000 7f259bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c10a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48278/0 (socket says 172.21.15.46:48278) 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.306+0000 7f259bfff640 1 -- 172.21.15.46:0/1470598605 learned_addr learned my addr 172.21.15.46:0/1470598605 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.306+0000 7f259bfff640 1 -- 172.21.15.46:0/1470598605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c10a8f0 con 0x7f259c107fc0 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.307+0000 7f259bfff640 1 --2- 172.21.15.46:0/1470598605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c10a3b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f258c009820 tx=0x7f258c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d857abd36817b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.307+0000 7f259affd640 1 -- 172.21.15.46:0/1470598605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f258c037070 con 0x7f259c107fc0 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.307+0000 7f259affd640 1 -- 172.21.15.46:0/1470598605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f258c032900 con 0x7f259c107fc0 2024-09-19T09:08:45.084 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.307+0000 7f259affd640 1 -- 172.21.15.46:0/1470598605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f258c030850 con 0x7f259c107fc0 2024-09-19T09:08:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 -- 172.21.15.46:0/1470598605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 msgr2=0x7f259c10a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.085 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 --2- 172.21.15.46:0/1470598605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c10a3b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f258c009820 tx=0x7f258c02a270 comp rx=0 tx=0).stop 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 -- 172.21.15.46:0/1470598605 shutdown_connections 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 --2- 172.21.15.46:0/1470598605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c10a3b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 -- 172.21.15.46:0/1470598605 >> 172.21.15.46:0/1470598605 conn(0x7f259c101b80 msgr2=0x7f259c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 -- 172.21.15.46:0/1470598605 shutdown_connections 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 -- 172.21.15.46:0/1470598605 wait complete. 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.308+0000 7f25a29d5640 1 Processor -- start 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f25a29d5640 1 -- start start 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f25a29d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f25a29d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f259c10b930 con 0x7f259c107fc0 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f259bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f259bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48286/0 (socket says 172.21.15.46:48286) 2024-09-19T09:08:45.086 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f259bfff640 1 -- 172.21.15.46:0/4187901284 learned_addr learned my addr 172.21.15.46:0/4187901284 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f259bfff640 1 -- 172.21.15.46:0/4187901284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c19bd70 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.309+0000 7f259bfff640 1 --2- 172.21.15.46:0/4187901284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c19b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f258c032ce0 tx=0x7f258c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f258c042070 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f258c0308c0 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259c19c000 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f258c037040 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259c19ecf0 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f258c045070 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.310+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f258c047c10 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.311+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259c108420 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.313+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f258c03c830 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.373+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f259c1953b0 con 0x7f259c107fc0 2024-09-19T09:08:45.087 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.373+0000 7f25997fa640 1 -- 172.21.15.46:0/4187901284 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f258c03ca10 con 0x7f259c107fc0 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 msgr2=0x7f259c19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 --2- 172.21.15.46:0/4187901284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c19b830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f258c032ce0 tx=0x7f258c032d10 comp rx=0 tx=0).stop 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 shutdown_connections 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 --2- 172.21.15.46:0/4187901284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f259c107fc0 0x7f259c19b830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 >> 172.21.15.46:0/4187901284 conn(0x7f259c101b80 msgr2=0x7f259c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 shutdown_connections 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:44.374+0000 7f25a29d5640 1 -- 172.21.15.46:0/4187901284 wait complete. 2024-09-19T09:08:45.088 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2024-09-19T09:08:45.371 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:45 smithi046 systemd[1]: Stopping Ceph mon.a for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:08:45.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[30831]: 2024-09-19T09:08:45.370+0000 7febb2779640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:45.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[30831]: 2024-09-19T09:08:45.370+0000 7febb2779640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T09:08:45.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:45 smithi046 podman[31077]: 2024-09-19 09:08:45.554924006 +0000 UTC m=+0.293562429 container died ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:08:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:45 smithi046 podman[31077]: 2024-09-19 09:08:45.886882924 +0000 UTC m=+0.625521334 container cleanup ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:08:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:45 smithi046 bash[31077]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:08:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 podman[31090]: 2024-09-19 09:08:47.198301056 +0000 UTC m=+1.638805389 container remove ee18bdd95ec102adc9c7a7303ac818f049a28931aa7e36289df2f7ded079a96b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:08:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T09:08:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 systemd[1]: Stopped Ceph mon.a for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:08:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 systemd[1]: Starting Ceph mon.a for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:08:47.947 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 podman[31183]: 2024-09-19 09:08:47.597707736 +0000 UTC m=+0.064525802 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:08:47.947 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 podman[31183]: 2024-09-19 09:08:47.753756912 +0000 UTC m=+0.220575009 container create 96dfa5da07047f24e6c61563fd0818d90e110da52a8c935a492db41e9c2e1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:08:48.052 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T09:08:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 podman[31183]: 2024-09-19 09:08:47.947828914 +0000 UTC m=+0.414646980 container init 96dfa5da07047f24e6c61563fd0818d90e110da52a8c935a492db41e9c2e1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T09:08:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 podman[31183]: 2024-09-19 09:08:47.951020277 +0000 UTC m=+0.417838333 container start 96dfa5da07047f24e6c61563fd0818d90e110da52a8c935a492db41e9c2e1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:08:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:08:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:08:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: pidfile_write: ignore empty --pid-file 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: load: jerasure load: lrc 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Git sha 0 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: DB SUMMARY 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: DB Session ID: 64J6HGEMS2IYINC8QYDJ 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T09:08:48.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104826 ; 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.env: 0x5561a8f4f940 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.info_log: 0x5561aa0276e0 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.statistics: (nil) 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.use_fsync: 0 2024-09-19T09:08:48.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.db_log_dir: 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.wal_dir: 2024-09-19T09:08:48.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.write_buffer_manager: 0x5561aa036dc0 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:08:48.235 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.unordered_write: 0 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.row_cache: None 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.wal_filter: None 2024-09-19T09:08:48.236 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.wal_compression: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:08:48.238 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:08:48.239 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_open_files: -1 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Compression algorithms supported: 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kZSTD supported: 0 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:08:48.240 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.merge_operator: 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_filter: None 2024-09-19T09:08:48.241 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5561aa027320) 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_type: 0 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: data_block_index_type: 0 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_shortening: 1 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: checksum: 4 2024-09-19T09:08:48.242 INFO:journalctl@ceph.mon.a.smithi046.stdout: no_block_cache: 0 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache: 0x5561aa01b1f0 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_options: 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: capacity : 536870912 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: num_shard_bits : 4 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: strict_capacity_limit : 0 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_cache_compressed: (nil) 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: persistent_cache: (nil) 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_size: 4096 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_size_deviation: 10 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_restart_interval: 16 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: index_block_restart_interval: 1 2024-09-19T09:08:48.243 INFO:journalctl@ceph.mon.a.smithi046.stdout: metadata_block_size: 4096 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: partition_filters: 0 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: use_delta_encoding: 1 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: filter_policy: bloomfilter 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: whole_key_filtering: 1 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: verify_compression: 0 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: format_version: 5 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: enable_index_compression: 1 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: block_align: 0 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: max_auto_readahead_size: 262144 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: prepopulate_block_cache: 0 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:08:48.244 INFO:journalctl@ceph.mon.a.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression: NoCompression 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.num_levels: 7 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:08:48.245 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:08:48.246 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:08:48.247 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:08:48.248 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:08:48.249 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.ttl: 2592000 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:08:48.250 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 00d4ad68-0c43-4330-8122-688c5534a3c0 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736927978238, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T09:08:48.251 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736927979882, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99930, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97816, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14179, "raw_average_key_size": 49, "raw_value_size": 90152, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726736927, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "00d4ad68-0c43-4330-8122-688c5534a3c0", "db_session_id": "64J6HGEMS2IYINC8QYDJ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726736927980017, "job": 1, "event": "recovery_finished"} 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5561aa048e00 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: DB pointer 0x5561aa144000 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** DB Stats ** 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:08:48.252 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: L0 2/0 99.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: Sum 2/0 99.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:08:48.253 INFO:journalctl@ceph.mon.a.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 97.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Cumulative compaction: 0.00 GB write, 19.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Interval compaction: 0.00 GB write, 19.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Block cache BinnedLRUCache@0x5561aa01b1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:08:48.254 INFO:journalctl@ceph.mon.a.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: starting mon.a rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???) e1 preinit fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).mds e1 new map 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).mds e1 print_map 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: e1 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: btime 2024-09-19T09:08:41:072677+0000 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: legacy client fscid: -1 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: 2024-09-19T09:08:48.255 INFO:journalctl@ceph.mon.a.smithi046.stdout: No filesystems configured 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:47 smithi046 ceph-mon[31203]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: monmap epoch 1 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: last_changed 2024-09-19T09:08:30.337142+0000 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: min_mon_release 19 (squid) 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: election_strategy: 1 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:08:48.256 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: fsmap 2024-09-19T09:08:48.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:08:48.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 ceph-mon[31203]: mgrmap e1: no daemons active 2024-09-19T09:08:48.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 bash[31183]: 96dfa5da07047f24e6c61563fd0818d90e110da52a8c935a492db41e9c2e1bf7 2024-09-19T09:08:48.257 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:48 smithi046 systemd[1]: Started Ceph mon.a for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:08:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.459+0000 7fdfbad9e640 1 Processor -- start 2024-09-19T09:08:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.459+0000 7fdfbad9e640 1 -- start start 2024-09-19T09:08:49.128 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.460+0000 7fdfbad9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb4106630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.460+0000 7fdfbad9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb4106c00 con 0x7fdfb4106230 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.460+0000 7fdfb9d9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb4106630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.460+0000 7fdfb9d9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb4106630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55676/0 (socket says 172.21.15.46:55676) 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.460+0000 7fdfb9d9c640 1 -- 172.21.15.46:0/3981294040 learned_addr learned my addr 172.21.15.46:0/3981294040 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.460+0000 7fdfb9d9c640 1 -- 172.21.15.46:0/3981294040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb4107430 con 0x7fdfb4106230 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.462+0000 7fdfb9d9c640 1 --2- 172.21.15.46:0/3981294040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb4106630 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009820 tx=0x7fdfac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48aa046a01a34da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.462+0000 7fdfb8d9a640 1 -- 172.21.15.46:0/3981294040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac037070 con 0x7fdfb4106230 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.462+0000 7fdfb8d9a640 1 -- 172.21.15.46:0/3981294040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdfac032900 con 0x7fdfb4106230 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfb8d9a640 1 -- 172.21.15.46:0/3981294040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac030850 con 0x7fdfb4106230 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3981294040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 msgr2=0x7fdfb4106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 --2- 172.21.15.46:0/3981294040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb4106630 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009820 tx=0x7fdfac02a270 comp rx=0 tx=0).stop 2024-09-19T09:08:49.129 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3981294040 shutdown_connections 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 --2- 172.21.15.46:0/3981294040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb4106630 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3981294040 >> 172.21.15.46:0/3981294040 conn(0x7fdfb41019c0 msgr2=0x7fdfb4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3981294040 shutdown_connections 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.463+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3981294040 wait complete. 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfbad9e640 1 Processor -- start 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfbad9e640 1 -- start start 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfbad9e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfbad9e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb410a7e0 con 0x7fdfb4106230 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfb9d9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfb9d9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55690/0 (socket says 172.21.15.46:55690) 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.464+0000 7fdfb9d9c640 1 -- 172.21.15.46:0/3870888517 learned_addr learned my addr 172.21.15.46:0/3870888517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb9d9c640 1 -- 172.21.15.46:0/3870888517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb419bc10 con 0x7fdfb4106230 2024-09-19T09:08:49.130 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb9d9c640 1 --2- 172.21.15.46:0/3870888517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb419b6d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009940 tx=0x7fdfac032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac042070 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdfac0308c0 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfac037040 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb419bea0 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb419eb90 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfac045070 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.465+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdfac047b70 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.466+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb410a960 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.469+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdfac0327b0 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.528+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fdfb4194d70 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.530+0000 7fdfb2ffd640 1 -- 172.21.15.46:0/3870888517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fdfac03c760 con 0x7fdfb4106230 2024-09-19T09:08:49.131 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 msgr2=0x7fdfb419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 --2- 172.21.15.46:0/3870888517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb419b6d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009940 tx=0x7fdfac032ce0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 shutdown_connections 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 --2- 172.21.15.46:0/3870888517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfb4106230 0x7fdfb419b6d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 >> 172.21.15.46:0/3870888517 conn(0x7fdfb41019c0 msgr2=0x7fdfb4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 shutdown_connections 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:48.531+0000 7fdfbad9e640 1 -- 172.21.15.46:0/3870888517 wait complete. 2024-09-19T09:08:49.132 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T09:08:49.153 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2024-09-19T09:08:49.154 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T09:08:49.155 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T09:08:49.411 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:08:49.411 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T09:08:49.568 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a514acda-7666-11ef-bceb-c7b262605968.target.wants/ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-a514acda-7666-11ef-bceb-c7b262605968@.service. 2024-09-19T09:08:49.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:49 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3870888517' entity='client.admin' 2024-09-19T09:08:49.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:49 smithi046 systemd[1]: Starting Ceph mgr.x for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:08:50.058 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:49 smithi046 podman[31415]: 2024-09-19 09:08:49.70189375 +0000 UTC m=+0.016520092 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:08:50.058 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:49 smithi046 podman[31415]: 2024-09-19 09:08:49.848035695 +0000 UTC m=+0.162662021 container create baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:08:50.058 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 podman[31415]: 2024-09-19 09:08:50.058387335 +0000 UTC m=+0.373013678 container init baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:08:50.180 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:08:50.181 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-19T09:08:50.188 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:08:50.188 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-19T09:08:50.189 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-19T09:08:50.189 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:08:50.197 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:08:50.197 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-19T09:08:50.206 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:08:50.207 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-19T09:08:50.207 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-19T09:08:50.207 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T09:08:50.207 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2024-09-19T09:08:50.207 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2024-09-19T09:08:50.335 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 podman[31415]: 2024-09-19 09:08:50.061368718 +0000 UTC m=+0.375995049 container start baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:08:50.335 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 bash[31415]: baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb 2024-09-19T09:08:50.335 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 systemd[1]: Started Ceph mgr.x for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:08:50.336 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:50.185+0000 7f01c1d99040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:08:50.336 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:50.255+0000 7f01c1d99040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:08:50.611 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:50.413+0000 7f01c1d99040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:08:50.611 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:50.485+0000 7f01c1d99040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:08:50.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1161280423' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:08:50.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:50.646+0000 7f01c1d99040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:08:50.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:50 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:50.797+0000 7f01c1d99040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:08:51.299 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:51 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:51.133+0000 7f01c1d99040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:08:51.299 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:51 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:51.197+0000 7f01c1d99040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:08:51.301 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:08:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:08:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:08:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:08:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:08:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:08:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:08:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T09:08:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:08:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:08:51.306 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:08:51.307 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.307 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:08:51.307 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:51.307 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:08:51.307 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:08:51.308 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:08:51.319 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:08:41:072677+0000", 2024-09-19T09:08:51.320 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:08:51.321 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:08:41.073408+0000", 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb39225640 1 Processor -- start 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb39225640 1 -- start start 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb39225640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb39225640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3407be00 con 0x7fdb34107fe0 2024-09-19T09:08:51.322 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55720/0 (socket says 172.21.15.46:55720) 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.617+0000 7fdb32d9d640 1 -- 172.21.15.46:0/1394426020 learned_addr learned my addr 172.21.15.46:0/1394426020 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.618+0000 7fdb32d9d640 1 -- 172.21.15.46:0/1394426020 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3410a910 con 0x7fdb34107fe0 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.618+0000 7fdb32d9d640 1 --2- 172.21.15.46:0/1394426020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3410a3d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009820 tx=0x7fdb2402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a739b354dde040 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb31d9b640 1 -- 172.21.15.46:0/1394426020 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb24037070 con 0x7fdb34107fe0 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb31d9b640 1 -- 172.21.15.46:0/1394426020 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb24032900 con 0x7fdb34107fe0 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb31d9b640 1 -- 172.21.15.46:0/1394426020 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb24030850 con 0x7fdb34107fe0 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 -- 172.21.15.46:0/1394426020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 msgr2=0x7fdb3410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 --2- 172.21.15.46:0/1394426020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3410a3d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009820 tx=0x7fdb2402a270 comp rx=0 tx=0).stop 2024-09-19T09:08:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 -- 172.21.15.46:0/1394426020 shutdown_connections 2024-09-19T09:08:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 --2- 172.21.15.46:0/1394426020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3410a3d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 -- 172.21.15.46:0/1394426020 >> 172.21.15.46:0/1394426020 conn(0x7fdb34101b80 msgr2=0x7fdb34103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 -- 172.21.15.46:0/1394426020 shutdown_connections 2024-09-19T09:08:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.619+0000 7fdb39225640 1 -- 172.21.15.46:0/1394426020 wait complete. 2024-09-19T09:08:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.620+0000 7fdb39225640 1 Processor -- start 2024-09-19T09:08:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.620+0000 7fdb39225640 1 -- start start 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb39225640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb39225640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3410b950 con 0x7fdb34107fe0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb32d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55734/0 (socket says 172.21.15.46:55734) 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb32d9d640 1 -- 172.21.15.46:0/1161280423 learned_addr learned my addr 172.21.15.46:0/1161280423 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb32d9d640 1 -- 172.21.15.46:0/1161280423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3419bd60 con 0x7fdb34107fe0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb32d9d640 1 --2- 172.21.15.46:0/1161280423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3419b820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb240097f0 tx=0x7fdb24030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb24037040 con 0x7fdb34107fe0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb24040070 con 0x7fdb34107fe0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.621+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3419bff0 con 0x7fdb34107fe0 2024-09-19T09:08:51.325 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.622+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb2403a390 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.622+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3419ece0 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.622+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb2403a630 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.622+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb24045df0 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.623+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb34108440 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.626+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdb2403b430 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.689+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdb341953b0 con 0x7fdb34107fe0 2024-09-19T09:08:51.326 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.689+0000 7fdb1bfff640 1 -- 172.21.15.46:0/1161280423 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fdb2403b7c0 con 0x7fdb34107fe0 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 msgr2=0x7fdb3419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 --2- 172.21.15.46:0/1161280423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3419b820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb240097f0 tx=0x7fdb24030d80 comp rx=0 tx=0).stop 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 shutdown_connections 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 --2- 172.21.15.46:0/1161280423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdb34107fe0 0x7fdb3419b820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 >> 172.21.15.46:0/1161280423 conn(0x7fdb34101b80 msgr2=0x7fdb34102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 shutdown_connections 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:50.691+0000 7fdb39225640 1 -- 172.21.15.46:0/1161280423 wait complete. 2024-09-19T09:08:51.327 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2024-09-19T09:08:51.730 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:51 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:51.392+0000 7f01c1d99040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:08:52.730 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:52 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:52.320+0000 7f01c1d99040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:08:52.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:52 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:52.390+0000 7f01c1d99040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:08:53.429 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.152+0000 7f01c1d99040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:08:53.429 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.272+0000 7f01c1d99040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:08:53.725 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.428+0000 7f01c1d99040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:08:53.725 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.493+0000 7f01c1d99040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:08:53.725 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.651+0000 7f01c1d99040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:08:53.725 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.724+0000 7f01c1d99040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:08:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2022561098' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:08:53.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.791+0000 7f01c1d99040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:08:53.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:53 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:53.965+0000 7f01c1d99040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:08:54.315 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:54.034+0000 7f01c1d99040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:08:54.316 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:54.104+0000 7f01c1d99040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:08:54.316 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:54.191+0000 7f01c1d99040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:08:54.316 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:54.253+0000 7f01c1d99040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:08:54.316 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:54.315+0000 7f01c1d99040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:08:54.377 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.378 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:08:54.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:54.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:08:54.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:08:54.379 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:08:54.387 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:08:41:072677+0000", 2024-09-19T09:08:54.388 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:08:54.389 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:08:41.073408+0000", 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa4421e9640 1 Processor -- start 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa4421e9640 1 -- start start 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa4421e9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c1068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa4421e9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c106ea0 con 0x7fa43c1064d0 2024-09-19T09:08:54.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa43b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c1068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa43b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c1068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55744/0 (socket says 172.21.15.46:55744) 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.747+0000 7fa43b7fe640 1 -- 172.21.15.46:0/2047827605 learned_addr learned my addr 172.21.15.46:0/2047827605 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.748+0000 7fa43b7fe640 1 -- 172.21.15.46:0/2047827605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c107680 con 0x7fa43c1064d0 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.748+0000 7fa43b7fe640 1 --2- 172.21.15.46:0/2047827605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c1068d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009820 tx=0x7fa42c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ebac716d5e9a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa43affd640 1 -- 172.21.15.46:0/2047827605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c037070 con 0x7fa43c1064d0 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa43affd640 1 -- 172.21.15.46:0/2047827605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa42c032900 con 0x7fa43c1064d0 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa43affd640 1 -- 172.21.15.46:0/2047827605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c030850 con 0x7fa43c1064d0 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 -- 172.21.15.46:0/2047827605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 msgr2=0x7fa43c1068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 --2- 172.21.15.46:0/2047827605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c1068d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009820 tx=0x7fa42c02a270 comp rx=0 tx=0).stop 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 -- 172.21.15.46:0/2047827605 shutdown_connections 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 --2- 172.21.15.46:0/2047827605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c1068d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:54.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 -- 172.21.15.46:0/2047827605 >> 172.21.15.46:0/2047827605 conn(0x7fa43c101cc0 msgr2=0x7fa43c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 -- 172.21.15.46:0/2047827605 shutdown_connections 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.749+0000 7fa4421e9640 1 -- 172.21.15.46:0/2047827605 wait complete. 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.750+0000 7fa4421e9640 1 Processor -- start 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.750+0000 7fa4421e9640 1 -- start start 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa4421e9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c07ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa4421e9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c10aa30 con 0x7fa43c1064d0 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa43b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c07ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa43b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c07ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55752/0 (socket says 172.21.15.46:55752) 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa43b7fe640 1 -- 172.21.15.46:0/2022561098 learned_addr learned my addr 172.21.15.46:0/2022561098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa43b7fe640 1 -- 172.21.15.46:0/2022561098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c19e600 con 0x7fa43c1064d0 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.751+0000 7fa43b7fe640 1 --2- 172.21.15.46:0/2022561098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c07ba00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009940 tx=0x7fa42c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:54.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c042070 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa42c0308c0 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43c19e7d0 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa42c037040 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43c19eb70 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa42c045070 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.752+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa42c047b70 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.753+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43c10abb0 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.757+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa42c0327b0 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.819+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa43c194350 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.820+0000 7fa4397fa640 1 -- 172.21.15.46:0/2022561098 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa42c03c760 con 0x7fa43c1064d0 2024-09-19T09:08:54.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 msgr2=0x7fa43c07ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 --2- 172.21.15.46:0/2022561098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c07ba00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009940 tx=0x7fa42c032ce0 comp rx=0 tx=0).stop 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 shutdown_connections 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 --2- 172.21.15.46:0/2022561098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa43c1064d0 0x7fa43c07ba00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 >> 172.21.15.46:0/2022561098 conn(0x7fa43c101cc0 msgr2=0x7fa43c102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 shutdown_connections 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:53.821+0000 7fa4421e9640 1 -- 172.21.15.46:0/2022561098 wait complete. 2024-09-19T09:08:54.394 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2024-09-19T09:08:55.481 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:08:55.147+0000 7f01c1d99040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:08:55.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: Activating manager daemon x 2024-09-19T09:08:55.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: mgrmap e2: x(active, starting, since 0.00317185s) 2024-09-19T09:08:55.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:08:55.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:08:55.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: Manager daemon x is now available 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' 2024-09-19T09:08:55.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:55 smithi046 ceph-mon[31203]: from='mgr.14100 172.21.15.46:0/1215190860' entity='mgr.x' 2024-09-19T09:08:57.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:57 smithi046 ceph-mon[31203]: mgrmap e3: x(active, since 1.0073s) 2024-09-19T09:08:57.353 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:57 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/283355902' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:08:57.600 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:08:57.601 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:08:57.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:08:57.611 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:08:41:072677+0000", 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:08:57.612 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:08:41.073408+0000", 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:08:57.613 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.812+0000 7fadb0f01640 1 Processor -- start 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadb0f01640 1 -- start start 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadb0f01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac10a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadb0f01640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fadac07bdd0 con 0x7fadac108080 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadaa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac10a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadaa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac10a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55840/0 (socket says 172.21.15.46:55840) 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadaa59c640 1 -- 172.21.15.46:0/3201821331 learned_addr learned my addr 172.21.15.46:0/3201821331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.813+0000 7fadaa59c640 1 -- 172.21.15.46:0/3201821331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac10a9b0 con 0x7fadac108080 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.814+0000 7fadaa59c640 1 --2- 172.21.15.46:0/3201821331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac10a470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009820 tx=0x7fad9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627ce43360e1bd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.814+0000 7fada959a640 1 -- 172.21.15.46:0/3201821331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c037070 con 0x7fadac108080 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.814+0000 7fada959a640 1 -- 172.21.15.46:0/3201821331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad9c032900 con 0x7fadac108080 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.814+0000 7fada959a640 1 -- 172.21.15.46:0/3201821331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c030850 con 0x7fadac108080 2024-09-19T09:08:57.614 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 -- 172.21.15.46:0/3201821331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 msgr2=0x7fadac10a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 --2- 172.21.15.46:0/3201821331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac10a470 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009820 tx=0x7fad9c02a270 comp rx=0 tx=0).stop 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 -- 172.21.15.46:0/3201821331 shutdown_connections 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 --2- 172.21.15.46:0/3201821331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac10a470 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 -- 172.21.15.46:0/3201821331 >> 172.21.15.46:0/3201821331 conn(0x7fadac101cc0 msgr2=0x7fadac1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 -- 172.21.15.46:0/3201821331 shutdown_connections 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.815+0000 7fadb0f01640 1 -- 172.21.15.46:0/3201821331 wait complete. 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadb0f01640 1 Processor -- start 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadb0f01640 1 -- start start 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadb0f01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadb0f01640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fadac10b990 con 0x7fadac108080 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadaa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.615 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadaa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55846/0 (socket says 172.21.15.46:55846) 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.816+0000 7fadaa59c640 1 -- 172.21.15.46:0/283355902 learned_addr learned my addr 172.21.15.46:0/283355902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fadaa59c640 1 -- 172.21.15.46:0/283355902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac19bd80 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fadaa59c640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac19b840 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad9c032ce0 tx=0x7fad9c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c042070 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad9c0308c0 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac19c010 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c037040 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.817+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac19ed00 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.818+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7fad9c045070 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.818+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadac1084e0 con 0x7fadac108080 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.818+0000 7fad9b7fe640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7fad940390a0 0x7fad9403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:57.616 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.818+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fad9c06bfe0 con 0x7fadac108080 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.819+0000 7fada9d9b640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7fad940390a0 0x7fad9403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.819+0000 7fada9d9b640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7fad940390a0 0x7fad9403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fada00098c0 tx=0x7fada0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:56.824+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad9c03c760 con 0x7fadac108080 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.069+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fadac02d7c0 con 0x7fadac108080 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.069+0000 7fad9b7fe640 1 -- 172.21.15.46:0/283355902 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fad9c03cca0 con 0x7fadac108080 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.072+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7fad940390a0 msgr2=0x7fad9403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.072+0000 7fadb0f01640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7fad940390a0 0x7fad9403b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fada00098c0 tx=0x7fada0006db0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 msgr2=0x7fadac19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac19b840 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad9c032ce0 tx=0x7fad9c032d10 comp rx=0 tx=0).stop 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 shutdown_connections 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7fad940390a0 0x7fad9403b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.617 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 --2- 172.21.15.46:0/283355902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac108080 0x7fadac19b840 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 >> 172.21.15.46:0/283355902 conn(0x7fadac101cc0 msgr2=0x7fadac102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 shutdown_connections 2024-09-19T09:08:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:57.073+0000 7fadb0f01640 1 -- 172.21.15.46:0/283355902 wait complete. 2024-09-19T09:08:57.618 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2024-09-19T09:08:58.368 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:58 smithi046 ceph-mon[31203]: mgrmap e4: x(active, since 2s) 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:08:58.735 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.036+0000 7f3362552640 1 Processor -- start 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.036+0000 7f3362552640 1 -- start start 2024-09-19T09:08:58.736 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.036+0000 7f3362552640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.036+0000 7f3362552640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f335c07be60 con 0x7f335c107f80 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.037+0000 7f335bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.037+0000 7f335bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55862/0 (socket says 172.21.15.46:55862) 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.037+0000 7f335bfff640 1 -- 172.21.15.46:0/517444394 learned_addr learned my addr 172.21.15.46:0/517444394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.037+0000 7f335bfff640 1 -- 172.21.15.46:0/517444394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c10a8b0 con 0x7f335c107f80 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.038+0000 7f335bfff640 1 --2- 172.21.15.46:0/517444394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c10a370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243db4f98d72a518 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.038+0000 7f335affd640 1 -- 172.21.15.46:0/517444394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c037070 con 0x7f335c107f80 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.038+0000 7f335affd640 1 -- 172.21.15.46:0/517444394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f334c032900 con 0x7f335c107f80 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.038+0000 7f335affd640 1 -- 172.21.15.46:0/517444394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c030850 con 0x7f335c107f80 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 -- 172.21.15.46:0/517444394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 msgr2=0x7f335c10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 --2- 172.21.15.46:0/517444394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c10a370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c02a270 comp rx=0 tx=0).stop 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 -- 172.21.15.46:0/517444394 shutdown_connections 2024-09-19T09:08:58.737 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 --2- 172.21.15.46:0/517444394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c10a370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 -- 172.21.15.46:0/517444394 >> 172.21.15.46:0/517444394 conn(0x7f335c101b80 msgr2=0x7f335c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 -- 172.21.15.46:0/517444394 shutdown_connections 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 -- 172.21.15.46:0/517444394 wait complete. 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 Processor -- start 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.039+0000 7f3362552640 1 -- start start 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f3362552640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f3362552640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f335c10b950 con 0x7f335c107f80 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f335bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f335bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c19da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55870/0 (socket says 172.21.15.46:55870) 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f335bfff640 1 -- 172.21.15.46:0/3152311028 learned_addr learned my addr 172.21.15.46:0/3152311028 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f335bfff640 1 -- 172.21.15.46:0/3152311028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c19dfd0 con 0x7f335c107f80 2024-09-19T09:08:58.738 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.040+0000 7f335bfff640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c19da90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f334c0097f0 tx=0x7f334c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.041+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c037040 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.041+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f334c040070 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.041+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c19e260 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.041+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334c03a390 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.041+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c1a0f50 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.041+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f334c03a5e0 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.042+0000 7f33597fa640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f33440391b0 0x7f334403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.042+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f334c06d870 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.042+0000 7f335b7fe640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f33440391b0 0x7f334403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.042+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c1083e0 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.042+0000 7f335b7fe640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f33440391b0 0x7f334403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f33500098c0 tx=0x7f3350006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.047+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f334c04a200 con 0x7f335c107f80 2024-09-19T09:08:58.739 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.222+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f335c196860 con 0x7f335c107f80 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.223+0000 7f33597fa640 1 -- 172.21.15.46:0/3152311028 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f334c02ee80 con 0x7f335c107f80 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f33440391b0 msgr2=0x7f334403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f33440391b0 0x7f334403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f33500098c0 tx=0x7f3350006db0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 msgr2=0x7f335c19da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c19da90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f334c0097f0 tx=0x7f334c030d80 comp rx=0 tx=0).stop 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 shutdown_connections 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f33440391b0 0x7f334403b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 --2- 172.21.15.46:0/3152311028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f335c107f80 0x7f335c19da90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.225+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 >> 172.21.15.46:0/3152311028 conn(0x7f335c101b80 msgr2=0x7f335c1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.226+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 shutdown_connections 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:58.226+0000 7f3362552640 1 -- 172.21.15.46:0/3152311028 wait complete. 2024-09-19T09:08:58.740 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2024-09-19T09:08:59.326 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:08:59 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3152311028' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:09:00.474 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1026030008' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T09:09:00.474 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: ignoring --setuser ceph since I am not root 2024-09-19T09:09:00.475 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: ignoring --setgroup ceph since I am not root 2024-09-19T09:09:00.475 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:00.314+0000 7f9516a68040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:09:00.475 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:00.373+0000 7f9516a68040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:09:00.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:00.533+0000 7f9516a68040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:09:00.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:00.602+0000 7f9516a68040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:09:00.768 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.093+0000 7ff319f16640 1 Processor -- start 2024-09-19T09:09:00.774 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.093+0000 7ff319f16640 1 -- start start 2024-09-19T09:09:00.774 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.093+0000 7ff319f16640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff314106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:00.774 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.093+0000 7ff319f16640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff314106de0 con 0x7ff314106410 2024-09-19T09:09:00.774 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.094+0000 7ff3137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff314106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.094+0000 7ff3137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff314106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51576/0 (socket says 172.21.15.46:51576) 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.094+0000 7ff3137fe640 1 -- 172.21.15.46:0/4009511527 learned_addr learned my addr 172.21.15.46:0/4009511527 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.094+0000 7ff3137fe640 1 -- 172.21.15.46:0/4009511527 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff314107610 con 0x7ff314106410 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.095+0000 7ff3137fe640 1 --2- 172.21.15.46:0/4009511527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff314106810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff304009820 tx=0x7ff30402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3222220c754af3d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.095+0000 7ff312ffd640 1 -- 172.21.15.46:0/4009511527 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304037070 con 0x7ff314106410 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.095+0000 7ff312ffd640 1 -- 172.21.15.46:0/4009511527 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff304032900 con 0x7ff314106410 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.095+0000 7ff312ffd640 1 -- 172.21.15.46:0/4009511527 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304030850 con 0x7ff314106410 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 -- 172.21.15.46:0/4009511527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 msgr2=0x7ff314106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 --2- 172.21.15.46:0/4009511527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff314106810 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff304009820 tx=0x7ff30402a270 comp rx=0 tx=0).stop 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 -- 172.21.15.46:0/4009511527 shutdown_connections 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 --2- 172.21.15.46:0/4009511527 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff314106810 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:00.775 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 -- 172.21.15.46:0/4009511527 >> 172.21.15.46:0/4009511527 conn(0x7ff314101b80 msgr2=0x7ff314103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 -- 172.21.15.46:0/4009511527 shutdown_connections 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 -- 172.21.15.46:0/4009511527 wait complete. 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 Processor -- start 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.096+0000 7ff319f16640 1 -- start start 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff319f16640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff31419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff319f16640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff31410a9c0 con 0x7ff314106410 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff3137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff31419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:00.776 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff3137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff31419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51578/0 (socket says 172.21.15.46:51578) 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff3137fe640 1 -- 172.21.15.46:0/1026030008 learned_addr learned my addr 172.21.15.46:0/1026030008 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff3137fe640 1 -- 172.21.15.46:0/1026030008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff31419bdb0 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff3137fe640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff31419b870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3040097f0 tx=0x7ff304030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.097+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff304037040 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.098+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff304040070 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.098+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff31419c040 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.098+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff30403a390 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.098+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff31419ed30 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.099+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7ff30403b430 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.099+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31410ab40 con 0x7ff314106410 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.099+0000 7ff3117fa640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7ff300039160 0x7ff30003b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:00.777 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.099+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff30406c3d0 con 0x7ff314106410 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.099+0000 7ff30affd640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7ff300039160 0x7ff30003b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.099+0000 7ff30affd640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7ff300039160 0x7ff30003b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098c0 tx=0x7ff2fc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.104+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff30406c130 con 0x7ff314106410 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:08:59.325+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff31402d7c0 con 0x7ff314106410 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.159+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7ff304032900 con 0x7ff314106410 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.161+0000 7ff3117fa640 1 -- 172.21.15.46:0/1026030008 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7ff304040cc0 con 0x7ff314106410 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7ff300039160 msgr2=0x7ff30003b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7ff300039160 0x7ff30003b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0098c0 tx=0x7ff2fc006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 msgr2=0x7ff31419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff31419b870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3040097f0 tx=0x7ff304030d80 comp rx=0 tx=0).stop 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 shutdown_connections 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7ff300039160 0x7ff30003b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:00.778 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 --2- 172.21.15.46:0/1026030008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff314106410 0x7ff31419b870 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:00.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 >> 172.21.15.46:0/1026030008 conn(0x7ff314101b80 msgr2=0x7ff314102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:00.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 shutdown_connections 2024-09-19T09:09:00.779 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:00.163+0000 7ff319f16640 1 -- 172.21.15.46:0/1026030008 wait complete. 2024-09-19T09:09:01.068 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:00.757+0000 7f9516a68040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:09:01.069 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:00.915+0000 7f9516a68040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:09:01.354 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:01 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1026030008' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T09:09:01.354 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:01 smithi046 ceph-mon[31203]: mgrmap e5: x(active, since 5s) 2024-09-19T09:09:01.355 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:01 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:01.250+0000 7f9516a68040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:09:01.355 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:01 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:01.313+0000 7f9516a68040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:09:01.671 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:01 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:01.523+0000 7f9516a68040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:09:01.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:09:01.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T09:09:01.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:09:01.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:09:01.939 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.147+0000 7f2b6319c640 1 Processor -- start 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.147+0000 7f2b6319c640 1 -- start start 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.148+0000 7f2b6319c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c10a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.148+0000 7f2b6319c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c07bd80 con 0x7f2b5c108060 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.148+0000 7f2b60f38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c10a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.148+0000 7f2b60f38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c10a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51608/0 (socket says 172.21.15.46:51608) 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.148+0000 7f2b60f38640 1 -- 172.21.15.46:0/128608254 learned_addr learned my addr 172.21.15.46:0/128608254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.148+0000 7f2b60f38640 1 -- 172.21.15.46:0/128608254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c10a990 con 0x7f2b5c108060 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.149+0000 7f2b60f38640 1 --2- 172.21.15.46:0/128608254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c10a450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009820 tx=0x7f2b5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e2a28d38b1bb74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.149+0000 7f2b5b7fe640 1 -- 172.21.15.46:0/128608254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b50037070 con 0x7f2b5c108060 2024-09-19T09:09:01.940 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.149+0000 7f2b5b7fe640 1 -- 172.21.15.46:0/128608254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b50032900 con 0x7f2b5c108060 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b5b7fe640 1 -- 172.21.15.46:0/128608254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b50030850 con 0x7f2b5c108060 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 -- 172.21.15.46:0/128608254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 msgr2=0x7f2b5c10a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 --2- 172.21.15.46:0/128608254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c10a450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009820 tx=0x7f2b5002a270 comp rx=0 tx=0).stop 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 -- 172.21.15.46:0/128608254 shutdown_connections 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 --2- 172.21.15.46:0/128608254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c10a450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 -- 172.21.15.46:0/128608254 >> 172.21.15.46:0/128608254 conn(0x7f2b5c101b80 msgr2=0x7f2b5c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 -- 172.21.15.46:0/128608254 shutdown_connections 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.150+0000 7f2b6319c640 1 -- 172.21.15.46:0/128608254 wait complete. 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b6319c640 1 Processor -- start 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b6319c640 1 -- start start 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b6319c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c1078e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:01.941 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b6319c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c10b910 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b60f38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c1078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b60f38640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c1078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51622/0 (socket says 172.21.15.46:51622) 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b60f38640 1 -- 172.21.15.46:0/3483510880 learned_addr learned my addr 172.21.15.46:0/3483510880 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.151+0000 7f2b60f38640 1 -- 172.21.15.46:0/3483510880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c107e20 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.152+0000 7f2b60f38640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c1078e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b500097f0 tx=0x7f2b50030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.152+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b50037040 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.152+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c106010 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.152+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b50040070 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.152+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b5003a390 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.152+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c1064f0 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.153+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f2b5003a630 con 0x7f2b5c108060 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.153+0000 7f2b59ffb640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 0x7f2b4c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:01.942 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.153+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b5006c470 con 0x7f2b5c108060 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.153+0000 7f2b5bfff640 1 -- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 msgr2=0x7f2b4c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2938067554 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.153+0000 7f2b5bfff640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 0x7f2b4c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.153+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c1084c0 con 0x7f2b5c108060 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.158+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b5004a200 con 0x7f2b5c108060 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.354+0000 7f2b5bfff640 1 -- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 msgr2=0x7f2b4c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2938067554 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.354+0000 7f2b5bfff640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 0x7f2b4c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.384+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2b5c194e30 con 0x7f2b5c108060 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.384+0000 7f2b59ffb640 1 -- 172.21.15.46:0/3483510880 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f2b5002ee80 con 0x7f2b5c108060 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 msgr2=0x7f2b4c03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 0x7f2b4c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 msgr2=0x7f2b5c1078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:01.943 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c1078e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b500097f0 tx=0x7f2b50030d80 comp rx=0 tx=0).stop 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 shutdown_connections 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f2b4c0391b0 0x7f2b4c03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 --2- 172.21.15.46:0/3483510880 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b5c108060 0x7f2b5c1078e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 >> 172.21.15.46:0/3483510880 conn(0x7f2b5c101b80 msgr2=0x7f2b5c102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 shutdown_connections 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:01.388+0000 7f2b6319c640 1 -- 172.21.15.46:0/3483510880 wait complete. 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-19T09:09:01.944 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2024-09-19T09:09:02.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:02 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3483510880' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:09:02.520 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:02 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:02.457+0000 7f9516a68040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:09:02.921 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:02 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:02.530+0000 7f9516a68040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:09:03.551 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.279+0000 7f9516a68040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:09:03.552 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.402+0000 7f9516a68040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:09:03.842 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.551+0000 7f9516a68040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:09:03.843 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.615+0000 7f9516a68040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:09:03.843 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.771+0000 7f9516a68040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:09:03.843 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.842+0000 7f9516a68040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:09:04.138 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:03.905+0000 7f9516a68040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:09:04.139 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:04.070+0000 7f9516a68040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:09:04.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:04.138+0000 7f9516a68040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:09:04.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:04.207+0000 7f9516a68040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:09:04.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:04.293+0000 7f9516a68040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:09:04.417 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:04.355+0000 7f9516a68040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:09:04.418 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:04.417+0000 7f9516a68040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:05.241+0000 7f9516a68040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: Active manager daemon x restarted 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: Activating manager daemon x 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: mgrmap e6: x(active, starting, since 0.0035022s) 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:09:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: Manager daemon x is now available 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:09:05.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:05 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:09:06.561 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:06 smithi046 ceph-mon[31203]: Found migration_current of "None". Setting to last migration. 2024-09-19T09:09:06.561 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:06 smithi046 ceph-mon[31203]: mgrmap e7: x(active, since 1.00565s) 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.313+0000 7f5c44590640 1 Processor -- start 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.313+0000 7f5c44590640 1 -- start start 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.313+0000 7f5c44590640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c10a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:06.850 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.313+0000 7f5c44590640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c07bde0 con 0x7f5c3c108030 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.314+0000 7f5c4232c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c10a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.314+0000 7f5c4232c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c10a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51634/0 (socket says 172.21.15.46:51634) 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.314+0000 7f5c4232c640 1 -- 172.21.15.46:0/1377387849 learned_addr learned my addr 172.21.15.46:0/1377387849 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.314+0000 7f5c4232c640 1 -- 172.21.15.46:0/1377387849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c10a960 con 0x7f5c3c108030 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c4232c640 1 --2- 172.21.15.46:0/1377387849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c10a420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009820 tx=0x7f5c3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57708597dae7da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c4132a640 1 -- 172.21.15.46:0/1377387849 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38037070 con 0x7f5c3c108030 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c4132a640 1 -- 172.21.15.46:0/1377387849 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c38032900 con 0x7f5c3c108030 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c4132a640 1 -- 172.21.15.46:0/1377387849 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38030850 con 0x7f5c3c108030 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c44590640 1 -- 172.21.15.46:0/1377387849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 msgr2=0x7f5c3c10a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:06.851 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c44590640 1 --2- 172.21.15.46:0/1377387849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c10a420 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009820 tx=0x7f5c3802a270 comp rx=0 tx=0).stop 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c44590640 1 -- 172.21.15.46:0/1377387849 shutdown_connections 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c44590640 1 --2- 172.21.15.46:0/1377387849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c10a420 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.315+0000 7f5c44590640 1 -- 172.21.15.46:0/1377387849 >> 172.21.15.46:0/1377387849 conn(0x7f5c3c101b90 msgr2=0x7f5c3c104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c44590640 1 -- 172.21.15.46:0/1377387849 shutdown_connections 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c44590640 1 -- 172.21.15.46:0/1377387849 wait complete. 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c44590640 1 Processor -- start 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c44590640 1 -- start start 2024-09-19T09:09:06.852 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c44590640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:06.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c44590640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c10b940 con 0x7f5c3c108030 2024-09-19T09:09:06.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.316+0000 7f5c4232c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:06.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c4232c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c19b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51636/0 (socket says 172.21.15.46:51636) 2024-09-19T09:09:06.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c4232c640 1 -- 172.21.15.46:0/1927445701 learned_addr learned my addr 172.21.15.46:0/1927445701 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:06.853 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c4232c640 1 -- 172.21.15.46:0/1927445701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c19bda0 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c4232c640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c19b860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c380097f0 tx=0x7f5c38030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c38037040 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c38040070 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c3803a390 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c19c030 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.317+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c19ed20 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.318+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f5c3803b430 con 0x7f5c3c108030 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.318+0000 7f5c337fe640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:06.857 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.318+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 --> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5c2803bdd0 con 0x7f5c28039200 2024-09-19T09:09:06.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.318+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c3806c430 con 0x7f5c3c108030 2024-09-19T09:09:06.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.318+0000 7f5c41b2b640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 msgr2=0x7f5c2803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2938067554 2024-09-19T09:09:06.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.319+0000 7f5c41b2b640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:09:06.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.520+0000 7f5c41b2b640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 msgr2=0x7f5c2803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2938067554 2024-09-19T09:09:06.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.520+0000 7f5c41b2b640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:09:06.858 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.921+0000 7f5c41b2b640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 msgr2=0x7f5c2803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2938067554 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:02.921+0000 7f5c41b2b640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:03.722+0000 7f5c41b2b640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 msgr2=0x7f5c2803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/2938067554 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:03.722+0000 7f5c41b2b640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:05.245+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f5c3806b230 con 0x7f5c3c108030 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:05.245+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 msgr2=0x7f5c2803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:05.245+0000 7f5c337fe640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.246+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f5c38040cc0 con 0x7f5c3c108030 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.246+0000 7f5c337fe640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f5c2803cb30 0x7f5c2803ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:06.859 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.246+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5c38006810 con 0x7f5c2803cb30 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.247+0000 7f5c41b2b640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f5c2803cb30 0x7f5c2803ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.248+0000 7f5c41b2b640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f5c2803cb30 0x7f5c2803ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c003980 tx=0x7f5c2c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.248+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f5c38006810 con 0x7f5c2803cb30 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.255+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f5c3c108490 con 0x7f5c2803cb30 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c337fe640 1 -- 172.21.15.46:0/1927445701 <== mgr.14118 v2:172.21.15.46:6800/4173084876 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f5c3c108490 con 0x7f5c2803cb30 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f5c2803cb30 msgr2=0x7f5c2803ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f5c2803cb30 0x7f5c2803ef20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c003980 tx=0x7f5c2c0092b0 comp rx=0 tx=0).stop 2024-09-19T09:09:06.860 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 msgr2=0x7f5c3c19b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c19b860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c380097f0 tx=0x7f5c38030d80 comp rx=0 tx=0).stop 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 shutdown_connections 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f5c2803cb30 0x7f5c2803ef20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:6800/2938067554,v1:172.21.15.46:6801/2938067554] conn(0x7f5c28039200 0x7f5c2803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 --2- 172.21.15.46:0/1927445701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c3c108030 0x7f5c3c19b860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 >> 172.21.15.46:0/1927445701 conn(0x7f5c3c101b90 msgr2=0x7f5c3c102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 shutdown_connections 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:06.256+0000 7f5c44590640 1 -- 172.21.15.46:0/1927445701 wait complete. 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2024-09-19T09:09:06.861 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2024-09-19T09:09:07.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:07 smithi046 ceph-mon[31203]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:09:07.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:07 smithi046 ceph-mon[31203]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:09:07.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:07 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:07.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:07 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:07.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:07 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:07.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:07 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.237+0000 7fadb2304640 1 Processor -- start 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.237+0000 7fadb2304640 1 -- start start 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.237+0000 7fadb2304640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.237+0000 7fadb2304640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fadac07be60 con 0x7fadac107f80 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.237+0000 7fadabfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.238+0000 7fadabfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51710/0 (socket says 172.21.15.46:51710) 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.238+0000 7fadabfff640 1 -- 172.21.15.46:0/3176281996 learned_addr learned my addr 172.21.15.46:0/3176281996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.238+0000 7fadabfff640 1 -- 172.21.15.46:0/3176281996 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac10a8b0 con 0x7fadac107f80 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.238+0000 7fadabfff640 1 --2- 172.21.15.46:0/3176281996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac10a370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009820 tx=0x7fad9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2c26863a7c759b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadab7fe640 1 -- 172.21.15.46:0/3176281996 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c037070 con 0x7fadac107f80 2024-09-19T09:09:08.001 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadab7fe640 1 -- 172.21.15.46:0/3176281996 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad9c032900 con 0x7fadac107f80 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadab7fe640 1 -- 172.21.15.46:0/3176281996 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c030850 con 0x7fadac107f80 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 -- 172.21.15.46:0/3176281996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 msgr2=0x7fadac10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 --2- 172.21.15.46:0/3176281996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac10a370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009820 tx=0x7fad9c02a270 comp rx=0 tx=0).stop 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 -- 172.21.15.46:0/3176281996 shutdown_connections 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 --2- 172.21.15.46:0/3176281996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac10a370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 -- 172.21.15.46:0/3176281996 >> 172.21.15.46:0/3176281996 conn(0x7fadac101b80 msgr2=0x7fadac103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 -- 172.21.15.46:0/3176281996 shutdown_connections 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.239+0000 7fadb2304640 1 -- 172.21.15.46:0/3176281996 wait complete. 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadb2304640 1 Processor -- start 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadb2304640 1 -- start start 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadb2304640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadb2304640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fadac10b950 con 0x7fadac107f80 2024-09-19T09:09:08.002 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadabfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:08.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadabfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51714/0 (socket says 172.21.15.46:51714) 2024-09-19T09:09:08.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.240+0000 7fadabfff640 1 -- 172.21.15.46:0/3512818123 learned_addr learned my addr 172.21.15.46:0/3512818123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:08.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fadabfff640 1 -- 172.21.15.46:0/3512818123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac107d40 con 0x7fadac107f80 2024-09-19T09:09:08.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fadabfff640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac107800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad9c032ce0 tx=0x7fad9c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:08.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c042070 con 0x7fadac107f80 2024-09-19T09:09:08.003 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad9c0308c0 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac105f30 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad9c037040 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.241+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac106470 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.242+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fad9c045070 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.242+0000 7fada9ffb640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fad980390a0 0x7fad9803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.242+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fad9c06c2e0 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.242+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadac1083e0 con 0x7fadac107f80 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.242+0000 7fada3fff640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fad980390a0 0x7fad9803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.243+0000 7fada3fff640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fad980390a0 0x7fad9803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad940098c0 tx=0x7fad94006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:08.004 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.248+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad9c0464a0 con 0x7fadac107f80 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.463+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fadac194ef0 con 0x7fad980390a0 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.468+0000 7fada9ffb640 1 -- 172.21.15.46:0/3512818123 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fadac194ef0 con 0x7fad980390a0 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fad980390a0 msgr2=0x7fad9803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fad980390a0 0x7fad9803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad940098c0 tx=0x7fad94006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 msgr2=0x7fadac107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac107800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fad9c032ce0 tx=0x7fad9c032d10 comp rx=0 tx=0).stop 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 shutdown_connections 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fad980390a0 0x7fad9803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 --2- 172.21.15.46:0/3512818123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fadac107f80 0x7fadac107800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.470+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 >> 172.21.15.46:0/3512818123 conn(0x7fadac101b80 msgr2=0x7fadac102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.471+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 shutdown_connections 2024-09-19T09:09:08.005 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:07.471+0000 7fadb2304640 1 -- 172.21.15.46:0/3512818123 wait complete. 2024-09-19T09:09:08.594 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:08.317+0000 7f948358d640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:09:08] ENGINE Error in HTTPServer.serve 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: Traceback (most recent call last): 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self._connections.run(self.expiration_interval) 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self._run(expiration_interval) 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:09:08.595 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: s = self.context.wrap_socket( 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: return self.sslsocket_class._create( 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self.do_handshake() 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self._sslobj.do_handshake() 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:09:08.596 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:08.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-mon[31203]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:08.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-mon[31203]: mgrmap e8: x(active, since 2s) 2024-09-19T09:09:08.908 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:08] ENGINE Bus STARTING 2024-09-19T09:09:08.909 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:08 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T09:09:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.401+0000 7fe5b935e640 1 Processor -- start 2024-09-19T09:09:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.401+0000 7fe5b935e640 1 -- start start 2024-09-19T09:09:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.402+0000 7fe5b935e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b410a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.402+0000 7fe5b935e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b407be00 con 0x7fe5b4108040 2024-09-19T09:09:09.134 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.402+0000 7fe5b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b410a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.402+0000 7fe5b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b410a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36226/0 (socket says 172.21.15.46:36226) 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.402+0000 7fe5b2ffd640 1 -- 172.21.15.46:0/876433541 learned_addr learned my addr 172.21.15.46:0/876433541 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.402+0000 7fe5b2ffd640 1 -- 172.21.15.46:0/876433541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b410a970 con 0x7fe5b4108040 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.403+0000 7fe5b2ffd640 1 --2- 172.21.15.46:0/876433541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b410a430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009820 tx=0x7fe5a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5dc6cf2dd818b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.403+0000 7fe5b1ffb640 1 -- 172.21.15.46:0/876433541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4037070 con 0x7fe5b4108040 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.403+0000 7fe5b1ffb640 1 -- 172.21.15.46:0/876433541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5a4032900 con 0x7fe5b4108040 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.403+0000 7fe5b1ffb640 1 -- 172.21.15.46:0/876433541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4030850 con 0x7fe5b4108040 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 -- 172.21.15.46:0/876433541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 msgr2=0x7fe5b410a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 --2- 172.21.15.46:0/876433541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b410a430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009820 tx=0x7fe5a402a270 comp rx=0 tx=0).stop 2024-09-19T09:09:09.135 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 -- 172.21.15.46:0/876433541 shutdown_connections 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 --2- 172.21.15.46:0/876433541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b410a430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 -- 172.21.15.46:0/876433541 >> 172.21.15.46:0/876433541 conn(0x7fe5b4101bc0 msgr2=0x7fe5b4104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 -- 172.21.15.46:0/876433541 shutdown_connections 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.404+0000 7fe5b935e640 1 -- 172.21.15.46:0/876433541 wait complete. 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b935e640 1 Processor -- start 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b935e640 1 -- start start 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b935e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b935e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe5b410b9b0 con 0x7fe5b4108040 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:09.136 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b419b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36242/0 (socket says 172.21.15.46:36242) 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b2ffd640 1 -- 172.21.15.46:0/2902994714 learned_addr learned my addr 172.21.15.46:0/2902994714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.405+0000 7fe5b2ffd640 1 -- 172.21.15.46:0/2902994714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5b419bda0 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.406+0000 7fe5b2ffd640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b419b860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40097f0 tx=0x7fe5a4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.406+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a4037040 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.406+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5a4040070 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.406+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5b419c030 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.406+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5a403a390 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.406+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5b419ed20 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.407+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe5a403a630 con 0x7fe5b4108040 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.407+0000 7fe59bfff640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe59c0391b0 0x7fe59c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:09.137 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.407+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5b41084a0 con 0x7fe5b4108040 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.407+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe5a406d850 con 0x7fe5b4108040 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.407+0000 7fe5b27fc640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe59c0391b0 0x7fe59c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.408+0000 7fe5b27fc640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe59c0391b0 0x7fe59c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098c0 tx=0x7fe5a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.412+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5a404a200 con 0x7fe5b4108040 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.594+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fe5b4062630 con 0x7fe59c0391b0 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.594+0000 7fe59bfff640 1 -- 172.21.15.46:0/2902994714 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fe5b4062630 con 0x7fe59c0391b0 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.596+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe59c0391b0 msgr2=0x7fe59c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.596+0000 7fe5b935e640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe59c0391b0 0x7fe59c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098c0 tx=0x7fe5a8006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.596+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 msgr2=0x7fe5b419b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.596+0000 7fe5b935e640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b419b860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40097f0 tx=0x7fe5a4030d80 comp rx=0 tx=0).stop 2024-09-19T09:09:09.138 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.597+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 shutdown_connections 2024-09-19T09:09:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.597+0000 7fe5b935e640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe59c0391b0 0x7fe59c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.597+0000 7fe5b935e640 1 --2- 172.21.15.46:0/2902994714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5b4108040 0x7fe5b419b860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.597+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 >> 172.21.15.46:0/2902994714 conn(0x7fe5b4101bc0 msgr2=0x7fe5b4102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.597+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 shutdown_connections 2024-09-19T09:09:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:08.597+0000 7fe5b935e640 1 -- 172.21.15.46:0/2902994714 wait complete. 2024-09-19T09:09:09.139 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2024-09-19T09:09:10.114 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:08] ENGINE Serving on https://172.21.15.46:7150 2024-09-19T09:09:10.114 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:08] ENGINE Error in HTTPServer.serve 2024-09-19T09:09:10.114 INFO:journalctl@ceph.mon.a.smithi046.stdout: Traceback (most recent call last): 2024-09-19T09:09:10.114 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:09:10.114 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._run(expiration_interval) 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: s = self.context.wrap_socket( 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: return self.sslsocket_class._create( 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: self.do_handshake() 2024-09-19T09:09:10.115 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._sslobj.do_handshake() 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:08] ENGINE Serving on http://172.21.15.46:8765 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:08] ENGINE Bus STARTED 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: Generating public/private rsa key pair. 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: Your identification has been saved in /tmp/tmpcdj5ga2u/key 2024-09-19T09:09:10.116 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: Your public key has been saved in /tmp/tmpcdj5ga2u/key.pub 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: The key fingerprint is: 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: SHA256:4ETPpkXMtQEugC6BqjA4xk6sA3STSZ5/N9HY6B+K56c ceph-a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: The key's randomart image is: 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: +---[RSA 3072]----+ 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: |. .o+ .oooo | 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: |o.o=.o =o =o | 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: |*o.o. + *+.o | 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: |O=. .o *. . | 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: |O+ .o.S+ . | 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: |+. . o + . | 2024-09-19T09:09:10.117 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: | . . o . | 2024-09-19T09:09:10.118 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: | o . | 2024-09-19T09:09:10.118 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: | Eo | 2024-09-19T09:09:10.118 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: +----[SHA256]-----+ 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.536+0000 7f39d755f640 1 Processor -- start 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.536+0000 7f39d755f640 1 -- start start 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.536+0000 7f39d755f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d010a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.536+0000 7f39d755f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f39d007be60 con 0x7f39d0107f80 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.537+0000 7f39d52fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d010a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.537+0000 7f39d52fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d010a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36252/0 (socket says 172.21.15.46:36252) 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.537+0000 7f39d52fb640 1 -- 172.21.15.46:0/1854074205 learned_addr learned my addr 172.21.15.46:0/1854074205 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.537+0000 7f39d52fb640 1 -- 172.21.15.46:0/1854074205 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d010a8b0 con 0x7f39d0107f80 2024-09-19T09:09:10.390 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.538+0000 7f39d52fb640 1 --2- 172.21.15.46:0/1854074205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d010a370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009e80 tx=0x7f39c002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce46263985fb753 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.538+0000 7f39cffff640 1 -- 172.21.15.46:0/1854074205 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c0036070 con 0x7f39d0107f80 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.538+0000 7f39cffff640 1 -- 172.21.15.46:0/1854074205 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c00318c0 con 0x7f39d0107f80 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.538+0000 7f39cffff640 1 -- 172.21.15.46:0/1854074205 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c0007ab0 con 0x7f39d0107f80 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.538+0000 7f39d755f640 1 -- 172.21.15.46:0/1854074205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 msgr2=0x7f39d010a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 --2- 172.21.15.46:0/1854074205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d010a370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009e80 tx=0x7f39c002a7a0 comp rx=0 tx=0).stop 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 -- 172.21.15.46:0/1854074205 shutdown_connections 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 --2- 172.21.15.46:0/1854074205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d010a370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 -- 172.21.15.46:0/1854074205 >> 172.21.15.46:0/1854074205 conn(0x7f39d0101b80 msgr2=0x7f39d0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 -- 172.21.15.46:0/1854074205 shutdown_connections 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 -- 172.21.15.46:0/1854074205 wait complete. 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 Processor -- start 2024-09-19T09:09:10.391 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 -- start start 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d0107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.539+0000 7f39d755f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f39d010b950 con 0x7f39d0107f80 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d52fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d0107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d52fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d0107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36258/0 (socket says 172.21.15.46:36258) 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d52fb640 1 -- 172.21.15.46:0/3144024678 learned_addr learned my addr 172.21.15.46:0/3144024678 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d52fb640 1 -- 172.21.15.46:0/3144024678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d0107d40 con 0x7f39d0107f80 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d52fb640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d0107800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39c0031ca0 tx=0x7f39c0031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c0036050 con 0x7f39d0107f80 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39c0042070 con 0x7f39d0107f80 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d0105f30 con 0x7f39d0107f80 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c003d820 con 0x7f39d0107f80 2024-09-19T09:09:10.392 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.540+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d0106470 con 0x7f39d0107f80 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.541+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f39c003db20 con 0x7f39d0107f80 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.541+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d01083e0 con 0x7f39d0107f80 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.541+0000 7f39ce7fc640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f39b80391b0 0x7f39b803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.541+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f39c0007e00 con 0x7f39d0107f80 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.542+0000 7f39d4afa640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f39b80391b0 0x7f39b803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.542+0000 7f39d4afa640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f39b80391b0 0x7f39b803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f39c40098c0 tx=0x7f39c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.546+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39c00371f0 con 0x7f39d0107f80 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.725+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f39d0195050 con 0x7f39b80391b0 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.815+0000 7f39ce7fc640 1 -- 172.21.15.46:0/3144024678 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39d0195050 con 0x7f39b80391b0 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f39b80391b0 msgr2=0x7f39b803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f39b80391b0 0x7f39b803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f39c40098c0 tx=0x7f39c4006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:10.393 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 msgr2=0x7f39d0107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d0107800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39c0031ca0 tx=0x7f39c0031cd0 comp rx=0 tx=0).stop 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 shutdown_connections 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f39b80391b0 0x7f39b803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.817+0000 7f39d755f640 1 --2- 172.21.15.46:0/3144024678 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f39d0107f80 0x7f39d0107800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.818+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 >> 172.21.15.46:0/3144024678 conn(0x7f39d0101b80 msgr2=0x7f39d0102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.818+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 shutdown_connections 2024-09-19T09:09:10.394 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:09.818+0000 7f39d755f640 1 -- 172.21.15.46:0/3144024678 wait complete. 2024-09-19T09:09:10.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:10 smithi046 ceph-mon[31203]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:10.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:10 smithi046 ceph-mon[31203]: Generating ssh key... 2024-09-19T09:09:11.520 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.770+0000 7f2251a88640 1 Processor -- start 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f2251a88640 1 -- start start 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f2251a88640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f2251a88640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f224c07c7f0 con 0x7f224c07de00 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36264/0 (socket says 172.21.15.46:36264) 2024-09-19T09:09:11.521 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f224b7fe640 1 -- 172.21.15.46:0/4282892767 learned_addr learned my addr 172.21.15.46:0/4282892767 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.771+0000 7f224b7fe640 1 -- 172.21.15.46:0/4282892767 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c07c970 con 0x7f224c07de00 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.772+0000 7f224b7fe640 1 --2- 172.21.15.46:0/4282892767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c07c2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f223c009820 tx=0x7f223c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02ec0867a0b8e5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.772+0000 7f224a7fc640 1 -- 172.21.15.46:0/4282892767 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c037070 con 0x7f224c07de00 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.772+0000 7f224a7fc640 1 -- 172.21.15.46:0/4282892767 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f223c032900 con 0x7f224c07de00 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.772+0000 7f224a7fc640 1 -- 172.21.15.46:0/4282892767 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c0308e0 con 0x7f224c07de00 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 -- 172.21.15.46:0/4282892767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 msgr2=0x7f224c07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 --2- 172.21.15.46:0/4282892767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c07c2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f223c009820 tx=0x7f223c02a300 comp rx=0 tx=0).stop 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 -- 172.21.15.46:0/4282892767 shutdown_connections 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 --2- 172.21.15.46:0/4282892767 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c07c2b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 -- 172.21.15.46:0/4282892767 >> 172.21.15.46:0/4282892767 conn(0x7f224c102dc0 msgr2=0x7f224c1051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 -- 172.21.15.46:0/4282892767 shutdown_connections 2024-09-19T09:09:11.522 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 -- 172.21.15.46:0/4282892767 wait complete. 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.773+0000 7f2251a88640 1 Processor -- start 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f2251a88640 1 -- start start 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f2251a88640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f2251a88640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f224c10dc00 con 0x7f224c07de00 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c19da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36274/0 (socket says 172.21.15.46:36274) 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f224b7fe640 1 -- 172.21.15.46:0/4032503342 learned_addr learned my addr 172.21.15.46:0/4032503342 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.774+0000 7f224b7fe640 1 -- 172.21.15.46:0/4032503342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c19dfc0 con 0x7f224c07de00 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.775+0000 7f224b7fe640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c19da80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f223c030610 tx=0x7f223c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.775+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c037040 con 0x7f224c07de00 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.775+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f223c040070 con 0x7f224c07de00 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.775+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223c03a390 con 0x7f224c07de00 2024-09-19T09:09:11.523 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.775+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f224c19e250 con 0x7f224c07de00 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.775+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f224c1a0f40 con 0x7f224c07de00 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.776+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f223c032900 con 0x7f224c07de00 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.776+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c07c330 con 0x7f224c07de00 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.776+0000 7f2248ff9640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2234039200 0x7f223403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.776+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f223c06c520 con 0x7f224c07de00 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.776+0000 7f224affd640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2234039200 0x7f223403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.777+0000 7f224affd640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2234039200 0x7f223403b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22400098c0 tx=0x7f2240006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.781+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f223c040cc0 con 0x7f224c07de00 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.961+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f224c062630 con 0x7f2234039200 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.962+0000 7f2248ff9640 1 -- 172.21.15.46:0/4032503342 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f224c062630 con 0x7f2234039200 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2234039200 msgr2=0x7f223403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:11.524 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2234039200 0x7f223403b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f22400098c0 tx=0x7f2240006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 msgr2=0x7f224c19da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c19da80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f223c030610 tx=0x7f223c032670 comp rx=0 tx=0).stop 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 shutdown_connections 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2234039200 0x7f223403b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.964+0000 7f2251a88640 1 --2- 172.21.15.46:0/4032503342 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f224c07de00 0x7f224c19da80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.965+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 >> 172.21.15.46:0/4032503342 conn(0x7f224c102dc0 msgr2=0x7f224c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.965+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 shutdown_connections 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:10.965+0000 7f2251a88640 1 -- 172.21.15.46:0/4032503342 wait complete. 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:09:11.525 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T09:09:11.528 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2024-09-19T09:09:12.127 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:11 smithi046 ceph-mon[31203]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:13.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:12 smithi046 ceph-mon[31203]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:14.433 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:14 smithi046 ceph-mon[31203]: Deploying cephadm binary to smithi046 2024-09-19T09:09:16.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2024-09-19T09:09:16.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f221a3f4640 1 Processor -- start 2024-09-19T09:09:16.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f221a3f4640 1 -- start start 2024-09-19T09:09:16.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f221a3f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f2214105c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f221a3f4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2214106220 con 0x7f2214105850 2024-09-19T09:09:16.653 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f2213fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f2214105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f2213fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f2214105c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36278/0 (socket says 172.21.15.46:36278) 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f2213fff640 1 -- 172.21.15.46:0/2433473640 learned_addr learned my addr 172.21.15.46:0/2433473640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.936+0000 7f2213fff640 1 -- 172.21.15.46:0/2433473640 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2214108830 con 0x7f2214105850 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.937+0000 7f2213fff640 1 --2- 172.21.15.46:0/2433473640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f2214105c50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2204009820 tx=0x7f220402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15e3b079d753d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.937+0000 7f2212ffd640 1 -- 172.21.15.46:0/2433473640 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2204037070 con 0x7f2214105850 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.937+0000 7f2212ffd640 1 -- 172.21.15.46:0/2433473640 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2204032900 con 0x7f2214105850 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.937+0000 7f2212ffd640 1 -- 172.21.15.46:0/2433473640 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2204030850 con 0x7f2214105850 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 -- 172.21.15.46:0/2433473640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 msgr2=0x7f2214105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 --2- 172.21.15.46:0/2433473640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f2214105c50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2204009820 tx=0x7f220402a270 comp rx=0 tx=0).stop 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 -- 172.21.15.46:0/2433473640 shutdown_connections 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 --2- 172.21.15.46:0/2433473640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f2214105c50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.654 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 -- 172.21.15.46:0/2433473640 >> 172.21.15.46:0/2433473640 conn(0x7f2214101400 msgr2=0x7f2214103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 -- 172.21.15.46:0/2433473640 shutdown_connections 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 -- 172.21.15.46:0/2433473640 wait complete. 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.938+0000 7f221a3f4640 1 Processor -- start 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f221a3f4640 1 -- start start 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f221a3f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f22141080b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f221a3f4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f221410ba60 con 0x7f2214105850 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f2213fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f22141080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f2213fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f22141080b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36286/0 (socket says 172.21.15.46:36286) 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f2213fff640 1 -- 172.21.15.46:0/487147626 learned_addr learned my addr 172.21.15.46:0/487147626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f2213fff640 1 -- 172.21.15.46:0/487147626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141085f0 con 0x7f2214105850 2024-09-19T09:09:16.655 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.939+0000 7f2213fff640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f22141080b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f22040097f0 tx=0x7f2204030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.940+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2204037040 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.940+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2204040070 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.940+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141067e0 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.940+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f220403a390 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.940+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2214106cc0 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.941+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f220403b430 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.941+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2214105cd0 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.941+0000 7f22117fa640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f21fc039200 0x7f21fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.941+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f220406c710 con 0x7f2214105850 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.941+0000 7f22137fe640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f21fc039200 0x7f21fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:16.656 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.942+0000 7f22137fe640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f21fc039200 0x7f21fc03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22080098c0 tx=0x7f2208006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:11.946+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2204032900 con 0x7f2214105850 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:12.126+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}) -- 0x7f2214107570 con 0x7f21fc039200 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.078+0000 7f22117fa640 1 -- 172.21.15.46:0/487147626 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f2214107570 con 0x7f21fc039200 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.080+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f21fc039200 msgr2=0x7f21fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.080+0000 7f221a3f4640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f21fc039200 0x7f21fc03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22080098c0 tx=0x7f2208006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.080+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 msgr2=0x7f22141080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.080+0000 7f221a3f4640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f22141080b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f22040097f0 tx=0x7f2204030d80 comp rx=0 tx=0).stop 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.080+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 shutdown_connections 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.081+0000 7f221a3f4640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f21fc039200 0x7f21fc03b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.081+0000 7f221a3f4640 1 --2- 172.21.15.46:0/487147626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2214105850 0x7f22141080b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.081+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 >> 172.21.15.46:0/487147626 conn(0x7f2214101400 msgr2=0x7f2214101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:16.657 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.081+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 shutdown_connections 2024-09-19T09:09:16.658 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:16.081+0000 7f221a3f4640 1 -- 172.21.15.46:0/487147626 wait complete. 2024-09-19T09:09:16.658 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying unmanaged mon service... 2024-09-19T09:09:17.348 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:17 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:17.348 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:17 smithi046 ceph-mon[31203]: Added host smithi046 2024-09-19T09:09:17.349 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:17 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.140+0000 7f1d5626e640 1 Processor -- start 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d5626e640 1 -- start start 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d5626e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d5007c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d5626e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5007c8c0 con 0x7f1d5007de90 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d5007c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d5007c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36298/0 (socket says 172.21.15.46:36298) 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d4ffff640 1 -- 172.21.15.46:0/3637159675 learned_addr learned my addr 172.21.15.46:0/3637159675 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:18.468 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.141+0000 7f1d4ffff640 1 -- 172.21.15.46:0/3637159675 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5007ca40 con 0x7f1d5007de90 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.142+0000 7f1d4ffff640 1 --2- 172.21.15.46:0/3637159675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d5007c2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009820 tx=0x7f1d4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37227cb29601d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.142+0000 7f1d4effd640 1 -- 172.21.15.46:0/3637159675 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40037070 con 0x7f1d5007de90 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.142+0000 7f1d4effd640 1 -- 172.21.15.46:0/3637159675 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d40032900 con 0x7f1d5007de90 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.142+0000 7f1d4effd640 1 -- 172.21.15.46:0/3637159675 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40030850 con 0x7f1d5007de90 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 -- 172.21.15.46:0/3637159675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 msgr2=0x7f1d5007c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 --2- 172.21.15.46:0/3637159675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d5007c2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009820 tx=0x7f1d4002a270 comp rx=0 tx=0).stop 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 -- 172.21.15.46:0/3637159675 shutdown_connections 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 --2- 172.21.15.46:0/3637159675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d5007c2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 -- 172.21.15.46:0/3637159675 >> 172.21.15.46:0/3637159675 conn(0x7f1d50102d90 msgr2=0x7f1d501051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 -- 172.21.15.46:0/3637159675 shutdown_connections 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.143+0000 7f1d5626e640 1 -- 172.21.15.46:0/3637159675 wait complete. 2024-09-19T09:09:18.469 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d5626e640 1 Processor -- start 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d5626e640 1 -- start start 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d5626e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d501a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d5626e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501097a0 con 0x7f1d5007de90 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d501a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d501a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36304/0 (socket says 172.21.15.46:36304) 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d4ffff640 1 -- 172.21.15.46:0/1081664558 learned_addr learned my addr 172.21.15.46:0/1081664558 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d4ffff640 1 -- 172.21.15.46:0/1081664558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d501a23d0 con 0x7f1d5007de90 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.144+0000 7f1d4ffff640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d501a1e90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d400097f0 tx=0x7f1d40030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.145+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d40037040 con 0x7f1d5007de90 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.145+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d40040070 con 0x7f1d5007de90 2024-09-19T09:09:18.470 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.145+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d501a2660 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.145+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d4003a390 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.145+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501a5350 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.146+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1d40032900 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.146+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5007c370 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.146+0000 7f1d4d7fa640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f1d38039200 0x7f1d3803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.146+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1d4006c730 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.146+0000 7f1d4f7fe640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f1d38039200 0x7f1d3803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.147+0000 7f1d4f7fe640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f1d38039200 0x7f1d3803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d440098c0 tx=0x7f1d44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.151+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d40040ce0 con 0x7f1d5007de90 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.348+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1d5002d830 con 0x7f1d38039200 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.352+0000 7f1d4d7fa640 1 -- 172.21.15.46:0/1081664558 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1d5002d830 con 0x7f1d38039200 2024-09-19T09:09:18.471 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.354+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f1d38039200 msgr2=0x7f1d3803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.354+0000 7f1d5626e640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f1d38039200 0x7f1d3803b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d440098c0 tx=0x7f1d44006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.354+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 msgr2=0x7f1d501a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.354+0000 7f1d5626e640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d501a1e90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d400097f0 tx=0x7f1d40030d80 comp rx=0 tx=0).stop 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.355+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 shutdown_connections 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.355+0000 7f1d5626e640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f1d38039200 0x7f1d3803b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.355+0000 7f1d5626e640 1 --2- 172.21.15.46:0/1081664558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d5007de90 0x7f1d501a1e90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.355+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 >> 172.21.15.46:0/1081664558 conn(0x7f1d50102d90 msgr2=0x7f1d50198870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.355+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 shutdown_connections 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:17.355+0000 7f1d5626e640 1 -- 172.21.15.46:0/1081664558 wait complete. 2024-09-19T09:09:18.472 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying unmanaged mgr service... 2024-09-19T09:09:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:18 smithi046 ceph-mon[31203]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:18 smithi046 ceph-mon[31203]: Saving service mon spec with placement count:5 2024-09-19T09:09:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:18 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:19 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:19 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:19 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:20.006 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe694da0640 1 Processor -- start 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe694da0640 1 -- start start 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe694da0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe690108240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe694da0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe69007be10 con 0x7fe690105e30 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe68e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe690108240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe68e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe690108240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35414/0 (socket says 172.21.15.46:35414) 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.227+0000 7fe68e59c640 1 -- 172.21.15.46:0/3871511875 learned_addr learned my addr 172.21.15.46:0/3871511875 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.228+0000 7fe68e59c640 1 -- 172.21.15.46:0/3871511875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe690108780 con 0x7fe690105e30 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.228+0000 7fe68e59c640 1 --2- 172.21.15.46:0/3871511875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe690108240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe680009820 tx=0x7fe68002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25953ef7bc5d83e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe68d59a640 1 -- 172.21.15.46:0/3871511875 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680037070 con 0x7fe690105e30 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe68d59a640 1 -- 172.21.15.46:0/3871511875 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe680032920 con 0x7fe690105e30 2024-09-19T09:09:20.007 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe68d59a640 1 -- 172.21.15.46:0/3871511875 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680030810 con 0x7fe690105e30 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 -- 172.21.15.46:0/3871511875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 msgr2=0x7fe690108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 --2- 172.21.15.46:0/3871511875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe690108240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe680009820 tx=0x7fe68002a270 comp rx=0 tx=0).stop 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 -- 172.21.15.46:0/3871511875 shutdown_connections 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 --2- 172.21.15.46:0/3871511875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe690108240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 -- 172.21.15.46:0/3871511875 >> 172.21.15.46:0/3871511875 conn(0x7fe690101cc0 msgr2=0x7fe6901040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 -- 172.21.15.46:0/3871511875 shutdown_connections 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.229+0000 7fe694da0640 1 -- 172.21.15.46:0/3871511875 wait complete. 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe694da0640 1 Processor -- start 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe694da0640 1 -- start start 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe694da0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe6901a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe694da0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901098c0 con 0x7fe690105e30 2024-09-19T09:09:20.008 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe68e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe6901a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe68e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe6901a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35422/0 (socket says 172.21.15.46:35422) 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.230+0000 7fe68e59c640 1 -- 172.21.15.46:0/911512833 learned_addr learned my addr 172.21.15.46:0/911512833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe68e59c640 1 -- 172.21.15.46:0/911512833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6901a23d0 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe68e59c640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe6901a1e90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6800097f0 tx=0x7fe6800327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe680037040 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe680030cc0 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6901a2660 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe68003a6b0 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.231+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a5350 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.232+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe68003a850 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.232+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe690106230 con 0x7fe690105e30 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.232+0000 7fe67f7fe640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe678039200 0x7fe67803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:20.009 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.232+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe68006c7a0 con 0x7fe690105e30 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.232+0000 7fe68dd9b640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe678039200 0x7fe67803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.233+0000 7fe68dd9b640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe678039200 0x7fe67803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6840098c0 tx=0x7fe684006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.237+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe68002fd60 con 0x7fe690105e30 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.430+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe69010a7f0 con 0x7fe678039200 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.434+0000 7fe67f7fe640 1 -- 172.21.15.46:0/911512833 <== mgr.14118 v2:172.21.15.46:6800/4173084876 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe69010a7f0 con 0x7fe678039200 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.436+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe678039200 msgr2=0x7fe67803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.436+0000 7fe694da0640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe678039200 0x7fe67803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6840098c0 tx=0x7fe684006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.436+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 msgr2=0x7fe6901a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.436+0000 7fe694da0640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe6901a1e90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe6800097f0 tx=0x7fe6800327b0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.436+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 shutdown_connections 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.437+0000 7fe694da0640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fe678039200 0x7fe67803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.010 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.437+0000 7fe694da0640 1 --2- 172.21.15.46:0/911512833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe690105e30 0x7fe6901a1e90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.437+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 >> 172.21.15.46:0/911512833 conn(0x7fe690101cc0 msgr2=0x7fe6901040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.437+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 shutdown_connections 2024-09-19T09:09:20.011 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:19.437+0000 7fe694da0640 1 -- 172.21.15.46:0/911512833 wait complete. 2024-09-19T09:09:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:20 smithi046 ceph-mon[31203]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:20 smithi046 ceph-mon[31203]: Saving service mgr spec with placement count:2 2024-09-19T09:09:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:20 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1346486323' entity='client.admin' 2024-09-19T09:09:21.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.417+0000 7f51992de640 1 Processor -- start 2024-09-19T09:09:21.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.417+0000 7f51992de640 1 -- start start 2024-09-19T09:09:21.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.418+0000 7f51992de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f5194106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:21.668 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.418+0000 7f51992de640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5194106de0 con 0x7f5194106410 2024-09-19T09:09:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.418+0000 7f5192ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f5194106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.418+0000 7f5192ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f5194106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35432/0 (socket says 172.21.15.46:35432) 2024-09-19T09:09:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.418+0000 7f5192ffd640 1 -- 172.21.15.46:0/3400148426 learned_addr learned my addr 172.21.15.46:0/3400148426 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.418+0000 7f5192ffd640 1 -- 172.21.15.46:0/3400148426 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5194107610 con 0x7f5194106410 2024-09-19T09:09:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.419+0000 7f5192ffd640 1 --2- 172.21.15.46:0/3400148426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f5194106810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5184009820 tx=0x7f518402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a512bb704d59422 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:21.669 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.419+0000 7f51927fc640 1 -- 172.21.15.46:0/3400148426 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5184037070 con 0x7f5194106410 2024-09-19T09:09:21.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51927fc640 1 -- 172.21.15.46:0/3400148426 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5184032920 con 0x7f5194106410 2024-09-19T09:09:21.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51927fc640 1 -- 172.21.15.46:0/3400148426 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5184030810 con 0x7f5194106410 2024-09-19T09:09:21.670 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51992de640 1 -- 172.21.15.46:0/3400148426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 msgr2=0x7f5194106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:21.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51992de640 1 --2- 172.21.15.46:0/3400148426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f5194106810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5184009820 tx=0x7f518402a270 comp rx=0 tx=0).stop 2024-09-19T09:09:21.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51992de640 1 -- 172.21.15.46:0/3400148426 shutdown_connections 2024-09-19T09:09:21.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51992de640 1 --2- 172.21.15.46:0/3400148426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f5194106810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51992de640 1 -- 172.21.15.46:0/3400148426 >> 172.21.15.46:0/3400148426 conn(0x7f5194101b80 msgr2=0x7f5194103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:21.671 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.420+0000 7f51992de640 1 -- 172.21.15.46:0/3400148426 shutdown_connections 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.421+0000 7f51992de640 1 -- 172.21.15.46:0/3400148426 wait complete. 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.421+0000 7f51992de640 1 Processor -- start 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.421+0000 7f51992de640 1 -- start start 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.421+0000 7f51992de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f519419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.421+0000 7f51992de640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f519410a9c0 con 0x7f5194106410 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5192ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f519419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:21.672 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5192ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f519419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35436/0 (socket says 172.21.15.46:35436) 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5192ffd640 1 -- 172.21.15.46:0/1346486323 learned_addr learned my addr 172.21.15.46:0/1346486323 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5192ffd640 1 -- 172.21.15.46:0/1346486323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519419be10 con 0x7f5194106410 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5192ffd640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f519419b8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5184030560 tx=0x7f5184032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5184037040 con 0x7f5194106410 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5184040070 con 0x7f5194106410 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f518403a740 con 0x7f5194106410 2024-09-19T09:09:21.673 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519419c0a0 con 0x7f5194106410 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.422+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f519419ed90 con 0x7f5194106410 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.423+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f518403a9b0 con 0x7f5194106410 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.423+0000 7f5190ff9640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f51800391b0 0x7f518003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.423+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f518403b8e0 con 0x7f5194106410 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.424+0000 7f518bfff640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f51800391b0 0x7f518003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.424+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519410ab40 con 0x7f5194106410 2024-09-19T09:09:21.674 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.424+0000 7f518bfff640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f51800391b0 0x7f518003b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f517c0098c0 tx=0x7f517c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.430+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5184041270 con 0x7f5194106410 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.625+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f5194075df0 con 0x7f5194106410 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.628+0000 7f5190ff9640 1 -- 172.21.15.46:0/1346486323 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f518405d070 con 0x7f5194106410 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f51800391b0 msgr2=0x7f518003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f51800391b0 0x7f518003b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f517c0098c0 tx=0x7f517c006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 msgr2=0x7f519419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:21.675 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f519419b8d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5184030560 tx=0x7f5184032670 comp rx=0 tx=0).stop 2024-09-19T09:09:21.676 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 shutdown_connections 2024-09-19T09:09:21.676 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f51800391b0 0x7f518003b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.676 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 --2- 172.21.15.46:0/1346486323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5194106410 0x7f519419b8d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:21.676 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 >> 172.21.15.46:0/1346486323 conn(0x7f5194101b80 msgr2=0x7f5194102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:21.676 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 shutdown_connections 2024-09-19T09:09:21.676 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:20.630+0000 7f51992de640 1 -- 172.21.15.46:0/1346486323 wait complete. 2024-09-19T09:09:22.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:22 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:22.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:22 smithi046 ceph-mon[31203]: from='mgr.14118 172.21.15.46:0/2448708064' entity='mgr.x' 2024-09-19T09:09:22.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:22 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2098484195' entity='client.admin' 2024-09-19T09:09:23.046 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.174+0000 7f4103aae640 1 Processor -- start 2024-09-19T09:09:23.046 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f4103aae640 1 -- start start 2024-09-19T09:09:23.046 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f4103aae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc10a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.046 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f4103aae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc07be60 con 0x7f40fc107fe0 2024-09-19T09:09:23.046 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f410184a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc10a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.046 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f410184a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc10a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35450/0 (socket says 172.21.15.46:35450) 2024-09-19T09:09:23.048 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f410184a640 1 -- 172.21.15.46:0/2843965375 learned_addr learned my addr 172.21.15.46:0/2843965375 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:23.048 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.175+0000 7f410184a640 1 -- 172.21.15.46:0/2843965375 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc10a910 con 0x7f40fc107fe0 2024-09-19T09:09:23.048 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.176+0000 7f410184a640 1 --2- 172.21.15.46:0/2843965375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc10a3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009820 tx=0x7f40f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d474e7c23c66f024 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.176+0000 7f4100848640 1 -- 172.21.15.46:0/2843965375 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8037070 con 0x7f40fc107fe0 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.176+0000 7f4100848640 1 -- 172.21.15.46:0/2843965375 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f8032920 con 0x7f40fc107fe0 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.176+0000 7f4100848640 1 -- 172.21.15.46:0/2843965375 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8030810 con 0x7f40fc107fe0 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 -- 172.21.15.46:0/2843965375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 msgr2=0x7f40fc10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 --2- 172.21.15.46:0/2843965375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc10a3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009820 tx=0x7f40f802a270 comp rx=0 tx=0).stop 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 -- 172.21.15.46:0/2843965375 shutdown_connections 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 --2- 172.21.15.46:0/2843965375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc10a3d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 -- 172.21.15.46:0/2843965375 >> 172.21.15.46:0/2843965375 conn(0x7f40fc101c40 msgr2=0x7f40fc104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 -- 172.21.15.46:0/2843965375 shutdown_connections 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.177+0000 7f4103aae640 1 -- 172.21.15.46:0/2843965375 wait complete. 2024-09-19T09:09:23.049 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f4103aae640 1 Processor -- start 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f4103aae640 1 -- start start 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f4103aae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f4103aae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc10b9f0 con 0x7f40fc107fe0 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f410184a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f410184a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35460/0 (socket says 172.21.15.46:35460) 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f410184a640 1 -- 172.21.15.46:0/2098484195 learned_addr learned my addr 172.21.15.46:0/2098484195 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.178+0000 7f410184a640 1 -- 172.21.15.46:0/2098484195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc19bdc0 con 0x7f40fc107fe0 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.179+0000 7f410184a640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc19b880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40f80097f0 tx=0x7f40f80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.179+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f8037040 con 0x7f40fc107fe0 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.179+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f8030cc0 con 0x7f40fc107fe0 2024-09-19T09:09:23.050 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.179+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc19c050 con 0x7f40fc107fe0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.179+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f803a6b0 con 0x7f40fc107fe0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.179+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc19ed40 con 0x7f40fc107fe0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.180+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f40f803b3f0 con 0x7f40fc107fe0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.180+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc108440 con 0x7f40fc107fe0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.181+0000 7f40f2ffd640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40e80391b0 0x7f40e803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.181+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f40f806c7e0 con 0x7f40fc107fe0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.181+0000 7f4101049640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40e80391b0 0x7f40e803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.181+0000 7f4101049640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40e80391b0 0x7f40e803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0098c0 tx=0x7f40ec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:23.051 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.186+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40f8042dc0 con 0x7f40fc107fe0 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.364+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f40fc02d7c0 con 0x7f40fc107fe0 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.367+0000 7f40f2ffd640 1 -- 172.21.15.46:0/2098484195 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f40f803a8a0 con 0x7f40fc107fe0 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40e80391b0 msgr2=0x7f40e803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40e80391b0 0x7f40e803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0098c0 tx=0x7f40ec006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 msgr2=0x7f40fc19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc19b880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f40f80097f0 tx=0x7f40f80327b0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 shutdown_connections 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40e80391b0 0x7f40e803b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 --2- 172.21.15.46:0/2098484195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc107fe0 0x7f40fc19b880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 >> 172.21.15.46:0/2098484195 conn(0x7f40fc101c40 msgr2=0x7f40fc1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:23.052 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 shutdown_connections 2024-09-19T09:09:23.053 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:22.369+0000 7f4103aae640 1 -- 172.21.15.46:0/2098484195 wait complete. 2024-09-19T09:09:23.053 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2024-09-19T09:09:23.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:23 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3166139691' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T09:09:23.975 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: ignoring --setuser ceph since I am not root 2024-09-19T09:09:23.975 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: ignoring --setgroup ceph since I am not root 2024-09-19T09:09:23.976 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:23.916+0000 7f5821bcc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:09:23.976 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:23.974+0000 7f5821bcc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:09:24.231 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:24.130+0000 7f5821bcc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:09:24.231 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:24.199+0000 7f5821bcc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:09:24.637 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:24.362+0000 7f5821bcc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:09:24.637 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:24.510+0000 7f5821bcc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:09:24.896 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3166139691' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T09:09:24.896 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-mon[31203]: mgrmap e9: x(active, since 18s) 2024-09-19T09:09:24.896 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:24.841+0000 7f5821bcc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:09:25.230 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:24.906+0000 7f5821bcc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:09:25.231 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:25 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:25.100+0000 7f5821bcc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.462+0000 7fcecd8ae640 1 Processor -- start 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.462+0000 7fcecd8ae640 1 -- start start 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.462+0000 7fcecd8ae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec807c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.462+0000 7fcecd8ae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcec807c7d0 con 0x7fcec807dde0 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.462+0000 7fcec6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec807c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.463+0000 7fcec6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec807c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35466/0 (socket says 172.21.15.46:35466) 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.463+0000 7fcec6ffd640 1 -- 172.21.15.46:0/742725723 learned_addr learned my addr 172.21.15.46:0/742725723 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.463+0000 7fcec6ffd640 1 -- 172.21.15.46:0/742725723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec807c950 con 0x7fcec807dde0 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcec6ffd640 1 --2- 172.21.15.46:0/742725723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec807c290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009820 tx=0x7fceb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84512c39c91a8863 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcec67fc640 1 -- 172.21.15.46:0/742725723 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb8037070 con 0x7fcec807dde0 2024-09-19T09:09:25.357 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcec67fc640 1 -- 172.21.15.46:0/742725723 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceb8032920 con 0x7fcec807dde0 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcec67fc640 1 -- 172.21.15.46:0/742725723 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb8030810 con 0x7fcec807dde0 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcecd8ae640 1 -- 172.21.15.46:0/742725723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 msgr2=0x7fcec807c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcecd8ae640 1 --2- 172.21.15.46:0/742725723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec807c290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009820 tx=0x7fceb802a270 comp rx=0 tx=0).stop 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcecd8ae640 1 -- 172.21.15.46:0/742725723 shutdown_connections 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcecd8ae640 1 --2- 172.21.15.46:0/742725723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec807c290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.464+0000 7fcecd8ae640 1 -- 172.21.15.46:0/742725723 >> 172.21.15.46:0/742725723 conn(0x7fcec8102dc0 msgr2=0x7fcec81051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcecd8ae640 1 -- 172.21.15.46:0/742725723 shutdown_connections 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcecd8ae640 1 -- 172.21.15.46:0/742725723 wait complete. 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcecd8ae640 1 Processor -- start 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcecd8ae640 1 -- start start 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcecd8ae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec819dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcecd8ae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcec810dc20 con 0x7fcec807dde0 2024-09-19T09:09:25.358 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.465+0000 7fcec6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec819dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcec6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec819dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35472/0 (socket says 172.21.15.46:35472) 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcec6ffd640 1 -- 172.21.15.46:0/3166139691 learned_addr learned my addr 172.21.15.46:0/3166139691 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcec6ffd640 1 -- 172.21.15.46:0/3166139691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec819e000 con 0x7fcec807dde0 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcec6ffd640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec819dac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097f0 tx=0x7fceb80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb8037040 con 0x7fcec807dde0 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceb8030cc0 con 0x7fcec807dde0 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec819e290 con 0x7fcec807dde0 2024-09-19T09:09:25.359 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb803a6b0 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.466+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec81a0f80 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.467+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fceb803a850 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.467+0000 7fcecc8ac640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fceb4039200 0x7fceb403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.467+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fceb806c880 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.467+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec807c310 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.467+0000 7fcebffff640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fceb4039200 0x7fceb403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.468+0000 7fcebffff640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fceb4039200 0x7fceb403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fceb00098c0 tx=0x7fceb0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.472+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fceb80371e0 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.707+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fcec802d7c0 con 0x7fcec807dde0 2024-09-19T09:09:25.360 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.759+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fceb802cb80 con 0x7fcec807dde0 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.760+0000 7fcecc8ac640 1 -- 172.21.15.46:0/3166139691 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fceb803baf0 con 0x7fcec807dde0 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fceb4039200 msgr2=0x7fceb403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fceb4039200 0x7fceb403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fceb00098c0 tx=0x7fceb0006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 msgr2=0x7fcec819dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec819dac0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fceb80097f0 tx=0x7fceb80327b0 comp rx=0 tx=0).stop 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 shutdown_connections 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7fceb4039200 0x7fceb403b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 --2- 172.21.15.46:0/3166139691 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcec807dde0 0x7fcec819dac0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 >> 172.21.15.46:0/3166139691 conn(0x7fcec8102dc0 msgr2=0x7fcec8103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 shutdown_connections 2024-09-19T09:09:25.361 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:23.762+0000 7fcecd8ae640 1 -- 172.21.15.46:0/3166139691 wait complete. 2024-09-19T09:09:26.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:26 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/816140165' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:09:26.482 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:26.056+0000 7f5821bcc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:09:26.482 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:26.127+0000 7f5821bcc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b8e25d640 1 Processor -- start 2024-09-19T09:09:26.588 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b8e25d640 1 -- start start 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b8e25d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b88106810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b8e25d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88106de0 con 0x7f2b88106410 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b88106810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b88106810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35504/0 (socket says 172.21.15.46:35504) 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b877fe640 1 -- 172.21.15.46:0/2552239892 learned_addr learned my addr 172.21.15.46:0/2552239892 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.789+0000 7f2b877fe640 1 -- 172.21.15.46:0/2552239892 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b88107610 con 0x7f2b88106410 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.790+0000 7f2b877fe640 1 --2- 172.21.15.46:0/2552239892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b88106810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009820 tx=0x7f2b7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bddc4dc69d911a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.790+0000 7f2b867fc640 1 -- 172.21.15.46:0/2552239892 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78037070 con 0x7f2b88106410 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.790+0000 7f2b867fc640 1 -- 172.21.15.46:0/2552239892 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b78032920 con 0x7f2b88106410 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.790+0000 7f2b867fc640 1 -- 172.21.15.46:0/2552239892 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78030810 con 0x7f2b88106410 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 -- 172.21.15.46:0/2552239892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 msgr2=0x7f2b88106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:26.589 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 --2- 172.21.15.46:0/2552239892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b88106810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009820 tx=0x7f2b7802a270 comp rx=0 tx=0).stop 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 -- 172.21.15.46:0/2552239892 shutdown_connections 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 --2- 172.21.15.46:0/2552239892 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b88106810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 -- 172.21.15.46:0/2552239892 >> 172.21.15.46:0/2552239892 conn(0x7f2b88101b80 msgr2=0x7f2b88103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 -- 172.21.15.46:0/2552239892 shutdown_connections 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.791+0000 7f2b8e25d640 1 -- 172.21.15.46:0/2552239892 wait complete. 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b8e25d640 1 Processor -- start 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b8e25d640 1 -- start start 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b8e25d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b8819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b8e25d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8810a9c0 con 0x7f2b88106410 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b8819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b8819b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35512/0 (socket says 172.21.15.46:35512) 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.792+0000 7f2b877fe640 1 -- 172.21.15.46:0/816140165 learned_addr learned my addr 172.21.15.46:0/816140165 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:26.590 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b877fe640 1 -- 172.21.15.46:0/816140165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8819bde0 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b877fe640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b8819b8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b78030560 tx=0x7f2b78032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b78037040 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b78040070 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8819c070 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b7803a740 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.793+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8819ed60 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.794+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f2b7803a8e0 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.794+0000 7f2b84ff9640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 0x7f2b7003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.794+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2b7806d930 con 0x7f2b88106410 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.794+0000 7f2b86ffd640 1 -- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 msgr2=0x7f2b7003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/4173084876 2024-09-19T09:09:26.591 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.794+0000 7f2b86ffd640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 0x7f2b7003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.794+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8810ab40 con 0x7f2b88106410 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.799+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b78044c70 con 0x7f2b88106410 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.995+0000 7f2b86ffd640 1 -- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 msgr2=0x7f2b7003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/4173084876 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:25.995+0000 7f2b86ffd640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 0x7f2b7003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.024+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2b8802d7c0 con 0x7f2b88106410 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.025+0000 7f2b84ff9640 1 -- 172.21.15.46:0/816140165 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f2b78041270 con 0x7f2b88106410 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 msgr2=0x7f2b7003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 0x7f2b7003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 msgr2=0x7f2b8819b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:26.592 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b8819b8a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b78030560 tx=0x7f2b78032670 comp rx=0 tx=0).stop 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 shutdown_connections 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f2b70039260 0x7f2b7003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 --2- 172.21.15.46:0/816140165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2b88106410 0x7f2b8819b8a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 >> 172.21.15.46:0/816140165 conn(0x7f2b88101b80 msgr2=0x7f2b88102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 shutdown_connections 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:26.027+0000 7f2b8e25d640 1 -- 172.21.15.46:0/816140165 wait complete. 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-19T09:09:26.593 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2024-09-19T09:09:27.159 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:26.884+0000 7f5821bcc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:09:27.159 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.008+0000 7f5821bcc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:09:27.450 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.158+0000 7f5821bcc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:09:27.450 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.222+0000 7f5821bcc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:09:27.450 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.378+0000 7f5821bcc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:09:27.450 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.448+0000 7f5821bcc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:09:27.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.511+0000 7f5821bcc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:09:27.731 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.676+0000 7f5821bcc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:09:28.025 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.744+0000 7f5821bcc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:09:28.026 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.813+0000 7f5821bcc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:09:28.026 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.900+0000 7f5821bcc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:09:28.026 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:27.962+0000 7f5821bcc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:09:28.026 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:28.023+0000 7f5821bcc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:09:29.120 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:28.867+0000 7f5821bcc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:09:29.120 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: Active manager daemon x restarted 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: Activating manager daemon x 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: mgrmap e10: x(active, starting, since 0.00365182s) 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: Manager daemon x is now available 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:09:29.121 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:09:30.807 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:30.735+0000 7f578cee0640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:09:30] ENGINE Error in HTTPServer.serve 2024-09-19T09:09:30.807 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: Traceback (most recent call last): 2024-09-19T09:09:30.807 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self._connections.run(self.expiration_interval) 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self._run(expiration_interval) 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: s = self.context.wrap_socket( 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:09:30.808 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: return self.sslsocket_class._create( 2024-09-19T09:09:30.809 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:09:30.809 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self.do_handshake() 2024-09-19T09:09:30.809 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:09:30.809 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: self._sslobj.do_handshake() 2024-09-19T09:09:30.809 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:09:30.809 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.013+0000 7f4117ce3640 1 Processor -- start 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.013+0000 7f4117ce3640 1 -- start start 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.013+0000 7f4117ce3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411010a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.817 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.013+0000 7f4117ce3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f411007be60 con 0x7f4110107fb0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.013+0000 7f4115a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411010a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.014+0000 7f4115a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411010a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35526/0 (socket says 172.21.15.46:35526) 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.014+0000 7f4115a7f640 1 -- 172.21.15.46:0/869111538 learned_addr learned my addr 172.21.15.46:0/869111538 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.014+0000 7f4115a7f640 1 -- 172.21.15.46:0/869111538 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411010a8e0 con 0x7f4110107fb0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4115a7f640 1 --2- 172.21.15.46:0/869111538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411010a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4104009e80 tx=0x7f410402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9711fbaddf39ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4114a7d640 1 -- 172.21.15.46:0/869111538 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4104036070 con 0x7f4110107fb0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4114a7d640 1 -- 172.21.15.46:0/869111538 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41040318e0 con 0x7f4110107fb0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4114a7d640 1 -- 172.21.15.46:0/869111538 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4104007a00 con 0x7f4110107fb0 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4117ce3640 1 -- 172.21.15.46:0/869111538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 msgr2=0x7f411010a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4117ce3640 1 --2- 172.21.15.46:0/869111538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411010a3a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4104009e80 tx=0x7f410402a7a0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.818 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4117ce3640 1 -- 172.21.15.46:0/869111538 shutdown_connections 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4117ce3640 1 --2- 172.21.15.46:0/869111538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411010a3a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4117ce3640 1 -- 172.21.15.46:0/869111538 >> 172.21.15.46:0/869111538 conn(0x7f4110101b90 msgr2=0x7f4110104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.015+0000 7f4117ce3640 1 -- 172.21.15.46:0/869111538 shutdown_connections 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4117ce3640 1 -- 172.21.15.46:0/869111538 wait complete. 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4117ce3640 1 Processor -- start 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4117ce3640 1 -- start start 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4117ce3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411019dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4117ce3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f411010b9c0 con 0x7f4110107fb0 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4115a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411019dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4115a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411019dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35540/0 (socket says 172.21.15.46:35540) 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.016+0000 7f4115a7f640 1 -- 172.21.15.46:0/344196392 learned_addr learned my addr 172.21.15.46:0/344196392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:30.819 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4115a7f640 1 -- 172.21.15.46:0/344196392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411019dff0 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4115a7f640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411019dab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4104031cf0 tx=0x7f4104031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4104036050 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4104042070 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f411019e280 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f410403d9b0 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.017+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41101a0f70 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.018+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f410403dc60 con 0x7f4110107fb0 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.018+0000 7f4102ffd640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.820 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.018+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 --> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f40fc03bdd0 con 0x7f40fc039200 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.018+0000 7f411527e640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 msgr2=0x7f40fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/4173084876 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.018+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f410406d6f0 con 0x7f4110107fb0 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.018+0000 7f411527e640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.219+0000 7f411527e640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 msgr2=0x7f40fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/4173084876 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.219+0000 7f411527e640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.620+0000 7f411527e640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 msgr2=0x7f40fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/4173084876 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:27.620+0000 7f411527e640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:28.421+0000 7f411527e640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 msgr2=0x7f40fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.46:6800/4173084876 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:28.421+0000 7f411527e640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:28.871+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f410406c1a0 con 0x7f4110107fb0 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:28.871+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 msgr2=0x7f40fc03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:09:30.821 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:28.871+0000 7f4102ffd640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.872+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f410406f930 con 0x7f4110107fb0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.872+0000 7f4102ffd640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40fc03ccc0 0x7f40fc03f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.872+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f410404de50 con 0x7f40fc03ccc0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.872+0000 7f411527e640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40fc03ccc0 0x7f40fc03f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.873+0000 7f411527e640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40fc03ccc0 0x7f40fc03f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f410c003980 tx=0x7f410c006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.874+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f410404de50 con 0x7f40fc03ccc0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.881+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4110108410 con 0x7f40fc03ccc0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.881+0000 7f4102ffd640 1 -- 172.21.15.46:0/344196392 <== mgr.14150 v2:172.21.15.46:6800/1744336406 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4110108410 con 0x7f40fc03ccc0 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40fc03ccc0 msgr2=0x7f40fc03f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40fc03ccc0 0x7f40fc03f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f410c003980 tx=0x7f410c006e10 comp rx=0 tx=0).stop 2024-09-19T09:09:30.822 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 msgr2=0x7f411019dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411019dab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4104031cf0 tx=0x7f4104031d20 comp rx=0 tx=0).stop 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 shutdown_connections 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40fc03ccc0 0x7f40fc03f0b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:6800/4173084876,v1:172.21.15.46:6801/4173084876] conn(0x7f40fc039200 0x7f40fc03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 --2- 172.21.15.46:0/344196392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4110107fb0 0x7f411019dab0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 >> 172.21.15.46:0/344196392 conn(0x7f4110101b90 msgr2=0x7f41101028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 shutdown_connections 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:29.882+0000 7f4117ce3640 1 -- 172.21.15.46:0/344196392 wait complete. 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2024-09-19T09:09:30.823 INFO:teuthology.orchestra.run.smithi046.stdout:Generating a dashboard self-signed certificate... 2024-09-19T09:09:31.168 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-mon[31203]: mgrmap e11: x(active, since 1.00585s) 2024-09-19T09:09:31.168 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:31.168 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:30] ENGINE Bus STARTING 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:30] ENGINE Serving on https://172.21.15.46:7150 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:30 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:30] ENGINE Error in HTTPServer.serve 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: Traceback (most recent call last): 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._run(expiration_interval) 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:09:31.169 INFO:journalctl@ceph.mon.a.smithi046.stdout: s = self.context.wrap_socket( 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: return self.sslsocket_class._create( 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: self.do_handshake() 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: self._sslobj.do_handshake() 2024-09-19T09:09:31.170 INFO:journalctl@ceph.mon.a.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:09:32.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T09:09:32.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.248+0000 7efd03663640 1 Processor -- start 2024-09-19T09:09:32.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.248+0000 7efd03663640 1 -- start start 2024-09-19T09:09:32.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.248+0000 7efd03663640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc10a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:32.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.248+0000 7efd03663640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc07be60 con 0x7efcfc107f80 2024-09-19T09:09:32.056 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.249+0000 7efd013ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc10a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.249+0000 7efd013ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc10a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60528/0 (socket says 172.21.15.46:60528) 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.249+0000 7efd013ff640 1 -- 172.21.15.46:0/3610465826 learned_addr learned my addr 172.21.15.46:0/3610465826 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.249+0000 7efd013ff640 1 -- 172.21.15.46:0/3610465826 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc10a8b0 con 0x7efcfc107f80 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.250+0000 7efd013ff640 1 --2- 172.21.15.46:0/3610465826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc10a370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009820 tx=0x7efcf802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ad60e130b4e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.250+0000 7efcf3fff640 1 -- 172.21.15.46:0/3610465826 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8037070 con 0x7efcfc107f80 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.250+0000 7efcf3fff640 1 -- 172.21.15.46:0/3610465826 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf8032920 con 0x7efcfc107f80 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.250+0000 7efcf3fff640 1 -- 172.21.15.46:0/3610465826 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8030810 con 0x7efcfc107f80 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 -- 172.21.15.46:0/3610465826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 msgr2=0x7efcfc10a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 --2- 172.21.15.46:0/3610465826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc10a370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009820 tx=0x7efcf802a270 comp rx=0 tx=0).stop 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 -- 172.21.15.46:0/3610465826 shutdown_connections 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 --2- 172.21.15.46:0/3610465826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc10a370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 -- 172.21.15.46:0/3610465826 >> 172.21.15.46:0/3610465826 conn(0x7efcfc101b80 msgr2=0x7efcfc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 -- 172.21.15.46:0/3610465826 shutdown_connections 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.251+0000 7efd03663640 1 -- 172.21.15.46:0/3610465826 wait complete. 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd03663640 1 Processor -- start 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd03663640 1 -- start start 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd03663640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd03663640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc10b990 con 0x7efcfc107f80 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd013ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd013ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc19b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60542/0 (socket says 172.21.15.46:60542) 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd013ff640 1 -- 172.21.15.46:0/3616457384 learned_addr learned my addr 172.21.15.46:0/3616457384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd013ff640 1 -- 172.21.15.46:0/3616457384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc19bd90 con 0x7efcfc107f80 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.252+0000 7efd013ff640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc19b850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcf8030380 tx=0x7efcf8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.253+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8037040 con 0x7efcfc107f80 2024-09-19T09:09:32.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.253+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf8040070 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.253+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc19c020 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.253+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf803a7b0 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.253+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc19ed10 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.254+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7efcf803a9e0 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.254+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcfc1083e0 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.254+0000 7efcf27fc640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efce8039260 0x7efce803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.254+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efcf806c9e0 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.254+0000 7efd00bfe640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efce8039260 0x7efce803b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.255+0000 7efd00bfe640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efce8039260 0x7efce803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098c0 tx=0x7efcec006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.259+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efcf8044c70 con 0x7efcfc107f80 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.456+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7efcfc062630 con 0x7efce8039260 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.497+0000 7efcf27fc640 1 -- 172.21.15.46:0/3616457384 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7efcfc062630 con 0x7efce8039260 2024-09-19T09:09:32.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.499+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efce8039260 msgr2=0x7efce803b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:32.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.499+0000 7efd03663640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efce8039260 0x7efce803b720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efcec0098c0 tx=0x7efcec006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.499+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 msgr2=0x7efcfc19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:32.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.499+0000 7efd03663640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc19b850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcf8030380 tx=0x7efcf8032670 comp rx=0 tx=0).stop 2024-09-19T09:09:32.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.500+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 shutdown_connections 2024-09-19T09:09:32.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.500+0000 7efd03663640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efce8039260 0x7efce803b720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.500+0000 7efd03663640 1 --2- 172.21.15.46:0/3616457384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcfc107f80 0x7efcfc19b850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:32.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.500+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 >> 172.21.15.46:0/3616457384 conn(0x7efcfc101b80 msgr2=0x7efcfc102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:32.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.500+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 shutdown_connections 2024-09-19T09:09:32.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:31.500+0000 7efd03663640 1 -- 172.21.15.46:0/3616457384 wait complete. 2024-09-19T09:09:32.061 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:30] ENGINE Serving on http://172.21.15.46:8765 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: [19/Sep/2024:09:09:30] ENGINE Bus STARTED 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: mgrmap e12: x(active, since 2s) 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:33.825 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ZYD0v40XEAgyBw9UzfzY0uu19M17xVnLQNQ6gp6N1SQ/n9n4X2OC.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726736973, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.888+0000 7f30e0542640 1 Processor -- start 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.888+0000 7f30e0542640 1 -- start start 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.888+0000 7f30e0542640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d81079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.888+0000 7f30e0542640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f30d8107fc0 con 0x7f30d81075f0 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.889+0000 7f30de2de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d81079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.889+0000 7f30de2de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d81079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60546/0 (socket says 172.21.15.46:60546) 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.889+0000 7f30de2de640 1 -- 172.21.15.46:0/1304244308 learned_addr learned my addr 172.21.15.46:0/1304244308 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.889+0000 7f30de2de640 1 -- 172.21.15.46:0/1304244308 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d81087a0 con 0x7f30d81075f0 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.890+0000 7f30de2de640 1 --2- 172.21.15.46:0/1304244308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d81079f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009820 tx=0x7f30d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5746ad8ae53dab4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.890+0000 7f30dd2dc640 1 -- 172.21.15.46:0/1304244308 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d0037070 con 0x7f30d81075f0 2024-09-19T09:09:33.826 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.890+0000 7f30dd2dc640 1 -- 172.21.15.46:0/1304244308 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d0032920 con 0x7f30d81075f0 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.890+0000 7f30dd2dc640 1 -- 172.21.15.46:0/1304244308 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d0030810 con 0x7f30d81075f0 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 -- 172.21.15.46:0/1304244308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 msgr2=0x7f30d81079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 --2- 172.21.15.46:0/1304244308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d81079f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009820 tx=0x7f30d002a270 comp rx=0 tx=0).stop 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 -- 172.21.15.46:0/1304244308 shutdown_connections 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 --2- 172.21.15.46:0/1304244308 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d81079f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 -- 172.21.15.46:0/1304244308 >> 172.21.15.46:0/1304244308 conn(0x7f30d8102dc0 msgr2=0x7f30d81051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 -- 172.21.15.46:0/1304244308 shutdown_connections 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 -- 172.21.15.46:0/1304244308 wait complete. 2024-09-19T09:09:33.827 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.891+0000 7f30e0542640 1 Processor -- start 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30e0542640 1 -- start start 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30e0542640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30e0542640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810bb50 con 0x7f30d81075f0 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30de2de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30de2de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d819b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60550/0 (socket says 172.21.15.46:60550) 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30de2de640 1 -- 172.21.15.46:0/3746304479 learned_addr learned my addr 172.21.15.46:0/3746304479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30de2de640 1 -- 172.21.15.46:0/3746304479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d819bdd0 con 0x7f30d81075f0 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.892+0000 7f30de2de640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d819b890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30d0030560 tx=0x7f30d0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.828 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.893+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d0037040 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.893+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30d0040070 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.893+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30d003a740 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.893+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d819c060 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.893+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d819ed50 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.894+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f30d003bb90 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.894+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d810bcd0 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.894+0000 7f30d77fe640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30c0039200 0x7f30c003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.894+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f30d006c9e0 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.894+0000 7f30ddadd640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30c0039200 0x7f30c003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.895+0000 7f30ddadd640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30c0039200 0x7f30c003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0098c0 tx=0x7f30cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:32.899+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f30d004a200 con 0x7f30d81075f0 2024-09-19T09:09:33.829 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.093+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f30d8193d60 con 0x7f30c0039200 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.342+0000 7f30d77fe640 1 -- 172.21.15.46:0/3746304479 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f30d8193d60 con 0x7f30c0039200 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30c0039200 msgr2=0x7f30c003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30c0039200 0x7f30c003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0098c0 tx=0x7f30cc006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 msgr2=0x7f30d819b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d819b890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f30d0030560 tx=0x7f30d0032670 comp rx=0 tx=0).stop 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 shutdown_connections 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30c0039200 0x7f30c003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 --2- 172.21.15.46:0/3746304479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30d81075f0 0x7f30d819b890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 >> 172.21.15.46:0/3746304479 conn(0x7f30d8102dc0 msgr2=0x7f30d8103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 shutdown_connections 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:33.344+0000 7f30e0542640 1 -- 172.21.15.46:0/3746304479 wait complete. 2024-09-19T09:09:33.830 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2024-09-19T09:09:34.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:34 smithi046 ceph-mon[31203]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:34.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:34 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:35.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T09:09:35.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc218021640 1 Processor -- start 2024-09-19T09:09:35.057 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc218021640 1 -- start start 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc218021640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc2101079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc218021640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc210107fc0 con 0x7fc2101075f0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc215dbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc2101079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc215dbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc2101079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60562/0 (socket says 172.21.15.46:60562) 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.258+0000 7fc215dbd640 1 -- 172.21.15.46:0/2074231723 learned_addr learned my addr 172.21.15.46:0/2074231723 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.259+0000 7fc215dbd640 1 -- 172.21.15.46:0/2074231723 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2101087a0 con 0x7fc2101075f0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc215dbd640 1 --2- 172.21.15.46:0/2074231723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc2101079f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009820 tx=0x7fc20c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5105b316564ba1b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc214dbb640 1 -- 172.21.15.46:0/2074231723 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c037070 con 0x7fc2101075f0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc214dbb640 1 -- 172.21.15.46:0/2074231723 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc20c032920 con 0x7fc2101075f0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc214dbb640 1 -- 172.21.15.46:0/2074231723 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c030810 con 0x7fc2101075f0 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc218021640 1 -- 172.21.15.46:0/2074231723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 msgr2=0x7fc2101079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:35.058 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc218021640 1 --2- 172.21.15.46:0/2074231723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc2101079f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009820 tx=0x7fc20c02a270 comp rx=0 tx=0).stop 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc218021640 1 -- 172.21.15.46:0/2074231723 shutdown_connections 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc218021640 1 --2- 172.21.15.46:0/2074231723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc2101079f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.260+0000 7fc218021640 1 -- 172.21.15.46:0/2074231723 >> 172.21.15.46:0/2074231723 conn(0x7fc210102dc0 msgr2=0x7fc2101051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc218021640 1 -- 172.21.15.46:0/2074231723 shutdown_connections 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc218021640 1 -- 172.21.15.46:0/2074231723 wait complete. 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc218021640 1 Processor -- start 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc218021640 1 -- start start 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc218021640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc21019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc218021640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc21010bb50 con 0x7fc2101075f0 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.261+0000 7fc215dbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc21019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc215dbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc21019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60572/0 (socket says 172.21.15.46:60572) 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc215dbd640 1 -- 172.21.15.46:0/1784434320 learned_addr learned my addr 172.21.15.46:0/1784434320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:35.059 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc215dbd640 1 -- 172.21.15.46:0/1784434320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21019bde0 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc215dbd640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc21019b8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc20c030560 tx=0x7fc20c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c037040 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21019c070 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc20c040070 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc20c03a740 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.262+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21019ed60 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.263+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fc20c03a9b0 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.263+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc21010bcd0 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.263+0000 7fc206ffd640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1fc039200 0x7fc1fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.264+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc20c06cbe0 con 0x7fc2101075f0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.264+0000 7fc2155bc640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1fc039200 0x7fc1fc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.264+0000 7fc2155bc640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1fc039200 0x7fc1fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc2000098c0 tx=0x7fc200006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:35.060 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.268+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc20c03adf0 con 0x7fc2101075f0 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.447+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fc210107a70 con 0x7fc2101075f0 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.448+0000 7fc206ffd640 1 -- 172.21.15.46:0/1784434320 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fc20c0328f0 con 0x7fc2101075f0 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1fc039200 msgr2=0x7fc1fc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1fc039200 0x7fc1fc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc2000098c0 tx=0x7fc200006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 msgr2=0x7fc21019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc21019b8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc20c030560 tx=0x7fc20c032670 comp rx=0 tx=0).stop 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 shutdown_connections 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1fc039200 0x7fc1fc03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 --2- 172.21.15.46:0/1784434320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2101075f0 0x7fc21019b8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 >> 172.21.15.46:0/1784434320 conn(0x7fc210102dc0 msgr2=0x7fc210103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 shutdown_connections 2024-09-19T09:09:35.061 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:34.450+0000 7fc218021640 1 -- 172.21.15.46:0/1784434320 wait complete. 2024-09-19T09:09:35.066 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:09:35.067 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-19T09:09:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:09:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-19T09:09:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-19T09:09:35.076 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T09:09:35.078 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2024-09-19T09:09:35.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:35.078 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2024-09-19T09:09:35.078 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2024-09-19T09:09:35.078 INFO:teuthology.orchestra.run.smithi046.stdout: Password: z8udx94bhj 2024-09-19T09:09:35.078 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:35.079 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config directory 2024-09-19T09:09:35.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:35 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1784434320' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T09:09:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.512+0000 7fa7eb8c4640 1 Processor -- start 2024-09-19T09:09:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.512+0000 7fa7eb8c4640 1 -- start start 2024-09-19T09:09:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.513+0000 7fa7eb8c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.513+0000 7fa7eb8c4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410a240 con 0x7fa7e4109870 2024-09-19T09:09:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.513+0000 7fa7e9660640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.414 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.513+0000 7fa7e9660640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60584/0 (socket says 172.21.15.46:60584) 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.513+0000 7fa7e9660640 1 -- 172.21.15.46:0/3311982040 learned_addr learned my addr 172.21.15.46:0/3311982040 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.513+0000 7fa7e9660640 1 -- 172.21.15.46:0/3311982040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e410a980 con 0x7fa7e4109870 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.514+0000 7fa7e9660640 1 --2- 172.21.15.46:0/3311982040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e4109c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009820 tx=0x7fa7e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593fbaa768f10d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.514+0000 7fa7dbfff640 1 -- 172.21.15.46:0/3311982040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0037070 con 0x7fa7e4109870 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.514+0000 7fa7dbfff640 1 -- 172.21.15.46:0/3311982040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e0032920 con 0x7fa7e4109870 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.514+0000 7fa7dbfff640 1 -- 172.21.15.46:0/3311982040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0030810 con 0x7fa7e4109870 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/3311982040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 msgr2=0x7fa7e4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 --2- 172.21.15.46:0/3311982040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e4109c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009820 tx=0x7fa7e002a270 comp rx=0 tx=0).stop 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/3311982040 shutdown_connections 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 --2- 172.21.15.46:0/3311982040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e4109c70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/3311982040 >> 172.21.15.46:0/3311982040 conn(0x7fa7e407cdc0 msgr2=0x7fa7e407d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.415 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/3311982040 shutdown_connections 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/3311982040 wait complete. 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.515+0000 7fa7eb8c4640 1 Processor -- start 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7eb8c4640 1 -- start start 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7eb8c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e419daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7eb8c4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e410dd30 con 0x7fa7e4109870 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7e9660640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e419daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.416 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7e9660640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e419daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60586/0 (socket says 172.21.15.46:60586) 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7e9660640 1 -- 172.21.15.46:0/893228947 learned_addr learned my addr 172.21.15.46:0/893228947 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7e9660640 1 -- 172.21.15.46:0/893228947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e419dfe0 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7e9660640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e419daa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0030560 tx=0x7fa7e0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.516+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e0037040 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.517+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e0040070 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.517+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e419e270 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.517+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7e003a740 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.517+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e41a0f60 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.517+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa7e003a8e0 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.518+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e410deb0 con 0x7fa7e4109870 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.518+0000 7fa7da7fc640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa7d0039300 0x7fa7d003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:36.417 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.518+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa7e006ca80 con 0x7fa7e4109870 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.518+0000 7fa7e8e5f640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa7d0039300 0x7fa7d003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.518+0000 7fa7e8e5f640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa7d0039300 0x7fa7d003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40098c0 tx=0x7fa7d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.523+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7e0042b20 con 0x7fa7e4109870 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.791+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa7e4109cf0 con 0x7fa7e4109870 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.793+0000 7fa7da7fc640 1 -- 172.21.15.46:0/893228947 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fa7e0043360 con 0x7fa7e4109870 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa7d0039300 msgr2=0x7fa7d003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa7d0039300 0x7fa7d003b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40098c0 tx=0x7fa7d4006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 msgr2=0x7fa7e419daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e419daa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0030560 tx=0x7fa7e0032670 comp rx=0 tx=0).stop 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 shutdown_connections 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa7d0039300 0x7fa7d003b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.418 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 --2- 172.21.15.46:0/893228947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7e4109870 0x7fa7e419daa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 >> 172.21.15.46:0/893228947 conn(0x7fa7e407cdc0 msgr2=0x7fa7e4107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 shutdown_connections 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr 2024-09-19T09:09:35.795+0000 7fa7eb8c4640 1 -- 172.21.15.46:0/893228947 wait complete. 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T09:09:36.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:36.420 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2024-09-19T09:09:36.455 INFO:tasks.cephadm:Fetching config... 2024-09-19T09:09:36.455 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:09:36.455 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T09:09:36.472 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T09:09:36.472 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:09:36.472 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T09:09:36.528 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T09:09:36.528 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:09:36.528 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T09:09:36.594 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T09:09:36.594 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:09:36.594 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T09:09:36.601 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:36 smithi046 ceph-mon[31203]: mgrmap e13: x(active, since 6s) 2024-09-19T09:09:36.601 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:36 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/893228947' entity='client.admin' 2024-09-19T09:09:36.615 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T09:09:36.616 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:09:36.691 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:09:36.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:09:36.745 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:09:36.757 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:09:36.810 INFO:teuthology.orchestra.run.smithi115.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCFoUxUmHme7momEJ4Wn/d9qjXGYrnYdCo7uYydg1v6YNU+PQNjoyVYRNoE8SS+FwQCz7CgoQnQpq9cf46ljImrmNqRlEL5RIXLRVmqIg724G/678fnJthjCK8DbLA6I81nUgv9a4HuQy6q4meXh7YUdoG9igN2gQNTA2RDdxyopf1PlZ+S2oX0bdwQ/uk3lH2B5GC2yBkRCCw7M1YhebdUgIFuUebE1Se3Eq003wrq0oXsz7LRl/pkJ52C0RSiD4T31C4nlR6508FyjfHMbFM2tXE48Yiit1oDAlaTOVSMjACSAxZWkgSPEWcU9f3BiB5lfXN1tXNcuxsC2LLvMrSRLYdvp+qkp+NK14tqDxj4zDAd+8EDngkih75yjRzt+cxOZvuN6fETeKI7ffCb4uSoEL9w2Zx925/vwnnAYT/CGT8kfLqKZ5mbujp8ZJqz/2aQOWsRs60W8Vg5IFGaLg246AiYwDNQlPaJ3Ae4u7QRPavVdKsrbtZrFj5/QyUcId8= ceph-a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:09:36.824 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T09:09:37.077 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:37.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 -- 172.21.15.46:0/611724195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 msgr2=0x7f84b0104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 --2- 172.21.15.46:0/611724195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009880 tx=0x7f84a002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 -- 172.21.15.46:0/611724195 shutdown_connections 2024-09-19T09:09:37.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 --2- 172.21.15.46:0/611724195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 -- 172.21.15.46:0/611724195 >> 172.21.15.46:0/611724195 conn(0x7f84b00fbc80 msgr2=0x7f84b00fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 -- 172.21.15.46:0/611724195 shutdown_connections 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.551+0000 7f84b5d8b640 1 -- 172.21.15.46:0/611724195 wait complete. 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.552+0000 7f84b5d8b640 1 Processor -- start 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.552+0000 7f84b5d8b640 1 -- start start 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84b5d8b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84b5d8b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f84b01076b0 con 0x7f84b01020a0 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60596/0 (socket says 172.21.15.46:60596) 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84af7fe640 1 -- 172.21.15.46:0/4035117102 learned_addr learned my addr 172.21.15.46:0/4035117102 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:37.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84af7fe640 1 -- 172.21.15.46:0/4035117102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b0197240 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84af7fe640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84a0004f60 tx=0x7f84a00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a003f070 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84a0003ad0 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b0197530 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.553+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a0035030 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.554+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b019a1b0 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.554+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f84a0042070 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.555+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b0107e30 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.555+0000 7f84acff9640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8498039300 0x7f849803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.555+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f84a006cfd0 con 0x7f84b01020a0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.555+0000 7f84aeffd640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8498039300 0x7f849803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.555+0000 7f84aeffd640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8498039300 0x7f849803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84a40098c0 tx=0x7f84a4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:37.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.560+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84a004c350 con 0x7f84b01020a0 2024-09-19T09:09:37.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.737+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f84b002d940 con 0x7f84b01020a0 2024-09-19T09:09:37.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.739+0000 7f84acff9640 1 -- 172.21.15.46:0/4035117102 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f84a0040260 con 0x7f84b01020a0 2024-09-19T09:09:37.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8498039300 msgr2=0x7f849803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8498039300 0x7f849803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84a40098c0 tx=0x7f84a4006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 msgr2=0x7f84b0196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f84a0004f60 tx=0x7f84a00048f0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 shutdown_connections 2024-09-19T09:09:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8498039300 0x7f849803b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 --2- 172.21.15.46:0/4035117102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84b01020a0 0x7f84b0196d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 >> 172.21.15.46:0/4035117102 conn(0x7f84b00fbc80 msgr2=0x7f84b00fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:37.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 shutdown_connections 2024-09-19T09:09:37.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:37.742+0000 7f84b5d8b640 1 -- 172.21.15.46:0/4035117102 wait complete. 2024-09-19T09:09:38.674 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T09:09:38.674 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T09:09:38.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4035117102' entity='client.admin' 2024-09-19T09:09:38.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:38.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:38.945 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:09:38.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:38.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:38.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 -- 172.21.15.46:0/3629015893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 msgr2=0x7f08301044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 --2- 172.21.15.46:0/3629015893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f08301044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f082c009880 tx=0x7f082c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 -- 172.21.15.46:0/3629015893 shutdown_connections 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 --2- 172.21.15.46:0/3629015893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f08301044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 -- 172.21.15.46:0/3629015893 >> 172.21.15.46:0/3629015893 conn(0x7f08300fbcd0 msgr2=0x7f08300fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 -- 172.21.15.46:0/3629015893 shutdown_connections 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.629+0000 7f0837895640 1 -- 172.21.15.46:0/3629015893 wait complete. 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.630+0000 7f0837895640 1 Processor -- start 2024-09-19T09:09:39.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.630+0000 7f0837895640 1 -- start start 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.630+0000 7f0837895640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f0830101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.630+0000 7f0837895640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0830107670 con 0x7f08301020d0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.630+0000 7f0835631640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f0830101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.630+0000 7f0835631640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f0830101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34166/0 (socket says 172.21.15.46:34166) 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f0835631640 1 -- 172.21.15.46:0/2663233168 learned_addr learned my addr 172.21.15.46:0/2663233168 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f0835631640 1 -- 172.21.15.46:0/2663233168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0830101e90 con 0x7f08301020d0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f0835631640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f0830101950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f082c004f60 tx=0x7f082c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c03f070 con 0x7f08301020d0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0830100080 con 0x7f08301020d0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f082c003ad0 con 0x7f08301020d0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082c035030 con 0x7f08301020d0 2024-09-19T09:09:39.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.631+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08301005c0 con 0x7f08301020d0 2024-09-19T09:09:39.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.632+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f082c042070 con 0x7f08301020d0 2024-09-19T09:09:39.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.633+0000 7f08267fc640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f081c0392a0 0x7f081c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:39.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.633+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0830107df0 con 0x7f08301020d0 2024-09-19T09:09:39.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.633+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f082c06d0c0 con 0x7f08301020d0 2024-09-19T09:09:39.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.633+0000 7f0834e30640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f081c0392a0 0x7f081c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:39.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.633+0000 7f0834e30640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f081c0392a0 0x7f081c03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f08200098c0 tx=0x7f0820006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:39.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.638+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f082c039350 con 0x7f08301020d0 2024-09-19T09:09:39.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.833+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f08301901d0 con 0x7f081c0392a0 2024-09-19T09:09:39.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.836+0000 7f08267fc640 1 -- 172.21.15.46:0/2663233168 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f08301901d0 con 0x7f081c0392a0 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f081c0392a0 msgr2=0x7f081c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f081c0392a0 0x7f081c03b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f08200098c0 tx=0x7f0820006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 msgr2=0x7f0830101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f0830101950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f082c004f60 tx=0x7f082c0048f0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 shutdown_connections 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f081c0392a0 0x7f081c03b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 --2- 172.21.15.46:0/2663233168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08301020d0 0x7f0830101950 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 >> 172.21.15.46:0/2663233168 conn(0x7f08300fbcd0 msgr2=0x7f08300fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:39.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 shutdown_connections 2024-09-19T09:09:39.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:39.838+0000 7f0837895640 1 -- 172.21.15.46:0/2663233168 wait complete. 2024-09-19T09:09:40.672 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi099 2024-09-19T09:09:40.672 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:09:40.672 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:09:40.692 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:09:40.692 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:09:40.750 INFO:tasks.cephadm:Adding host smithi099 to orchestrator... 2024-09-19T09:09:40.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch host add smithi099 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: Updating smithi046:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:09:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: Updating smithi046:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:09:40.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:40.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:40.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:41.181 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:41.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 -- 172.21.15.46:0/3937962418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 msgr2=0x7f4018106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 --2- 172.21.15.46:0/3937962418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f4018106920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4008009c10 tx=0x7f400802aa10 comp rx=0 tx=0).stop 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 -- 172.21.15.46:0/3937962418 shutdown_connections 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 --2- 172.21.15.46:0/3937962418 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f4018106920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 -- 172.21.15.46:0/3937962418 >> 172.21.15.46:0/3937962418 conn(0x7f4018077310 msgr2=0x7f40180fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 -- 172.21.15.46:0/3937962418 shutdown_connections 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 -- 172.21.15.46:0/3937962418 wait complete. 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 Processor -- start 2024-09-19T09:09:41.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.606+0000 7f401f6cd640 1 -- start start 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401f6cd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f40181970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401f6cd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f401810ab70 con 0x7f4018106540 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401d469640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f40181970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401d469640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f40181970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34184/0 (socket says 172.21.15.46:34184) 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401d469640 1 -- 172.21.15.46:0/1288446252 learned_addr learned my addr 172.21.15.46:0/1288446252 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401d469640 1 -- 172.21.15.46:0/1288446252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4018197600 con 0x7f4018106540 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f401d469640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f40181970c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4008005dd0 tx=0x7f4008030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4008034070 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.607+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f400802f8c0 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.608+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4018197890 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.608+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4008004520 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.608+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4018197cb0 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.608+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4008037020 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.608+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4018101bb0 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.609+0000 7f40167fc640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4000039300 0x7f400003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.609+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f400806d380 con 0x7f4018106540 2024-09-19T09:09:41.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.609+0000 7f401cc68640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4000039300 0x7f400003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:41.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.609+0000 7f401cc68640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4000039300 0x7f400003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f400c0098c0 tx=0x7f400c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:41.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.613+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f400803f070 con 0x7f4018106540 2024-09-19T09:09:41.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:41.795+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}) -- 0x7f40181984c0 con 0x7f4000039300 2024-09-19T09:09:41.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:41 smithi046 ceph-mon[31203]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:44.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:43 smithi046 ceph-mon[31203]: Deploying cephadm binary to smithi099 2024-09-19T09:09:45.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.643+0000 7f40167fc640 1 -- 172.21.15.46:0/1288446252 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f40181984c0 con 0x7f4000039300 2024-09-19T09:09:45.645 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi099' with addr '172.21.15.99' 2024-09-19T09:09:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4000039300 msgr2=0x7f400003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4000039300 0x7f400003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f400c0098c0 tx=0x7f400c006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:45.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 msgr2=0x7f40181970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f40181970c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4008005dd0 tx=0x7f4008030c30 comp rx=0 tx=0).stop 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 shutdown_connections 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4000039300 0x7f400003b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 --2- 172.21.15.46:0/1288446252 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4018106540 0x7f40181970c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 >> 172.21.15.46:0/1288446252 conn(0x7f4018077310 msgr2=0x7f40180696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 shutdown_connections 2024-09-19T09:09:45.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:45.646+0000 7f401f6cd640 1 -- 172.21.15.46:0/1288446252 wait complete. 2024-09-19T09:09:46.257 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:09:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:46.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:46.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:46 smithi046 ceph-mon[31203]: Added host smithi099 2024-09-19T09:09:46.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:46.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:46.887 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 -- 172.21.15.46:0/1076885229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 msgr2=0x7f570c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 --2- 172.21.15.46:0/1076885229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009880 tx=0x7f56fc02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 -- 172.21.15.46:0/1076885229 shutdown_connections 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 --2- 172.21.15.46:0/1076885229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 -- 172.21.15.46:0/1076885229 >> 172.21.15.46:0/1076885229 conn(0x7f570c0fc1b0 msgr2=0x7f570c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 -- 172.21.15.46:0/1076885229 shutdown_connections 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.969+0000 7f571268c640 1 -- 172.21.15.46:0/1076885229 wait complete. 2024-09-19T09:09:46.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f571268c640 1 Processor -- start 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f571268c640 1 -- start start 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f571268c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f571268c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f570c10ab90 con 0x7f570c106560 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f570bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f570bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34192/0 (socket says 172.21.15.46:34192) 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.970+0000 7f570bfff640 1 -- 172.21.15.46:0/2440891862 learned_addr learned my addr 172.21.15.46:0/2440891862 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f570bfff640 1 -- 172.21.15.46:0/2440891862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570c0fe550 con 0x7f570c106560 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f570bfff640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c0fc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009230 tx=0x7f56fc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc03f070 con 0x7f570c106560 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56fc03bc80 con 0x7f570c106560 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f570c0fcba0 con 0x7f570c106560 2024-09-19T09:09:46.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56fc035030 con 0x7f570c106560 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.971+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f570c0fd060 con 0x7f570c106560 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.972+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f56fc042070 con 0x7f570c106560 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.972+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f570c101bd0 con 0x7f570c106560 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.972+0000 7f57097fa640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56f4039300 0x7f56f403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.972+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f56fc06d1f0 con 0x7f570c106560 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.973+0000 7f570b7fe640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56f4039300 0x7f56f403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.973+0000 7f570b7fe640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56f4039300 0x7f56f403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57000098c0 tx=0x7f5700006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:46.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:46.977+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56fc0314c0 con 0x7f570c106560 2024-09-19T09:09:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.173+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f570c0fdc00 con 0x7f56f4039300 2024-09-19T09:09:47.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.174+0000 7f57097fa640 1 -- 172.21.15.46:0/2440891862 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f570c0fdc00 con 0x7f56f4039300 2024-09-19T09:09:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:47.176 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}] 2024-09-19T09:09:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56f4039300 msgr2=0x7f56f403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56f4039300 0x7f56f403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57000098c0 tx=0x7f5700006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 msgr2=0x7f570c0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:47.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c0fc660 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56fc009230 tx=0x7f56fc003d40 comp rx=0 tx=0).stop 2024-09-19T09:09:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 shutdown_connections 2024-09-19T09:09:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56f4039300 0x7f56f403b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 --2- 172.21.15.46:0/2440891862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f570c106560 0x7f570c0fc660 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 >> 172.21.15.46:0/2440891862 conn(0x7f570c0fc1b0 msgr2=0x7f570c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 shutdown_connections 2024-09-19T09:09:47.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:47.177+0000 7f571268c640 1 -- 172.21.15.46:0/2440891862 wait complete. 2024-09-19T09:09:47.719 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi115 2024-09-19T09:09:47.719 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:09:47.719 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:09:47.739 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:09:47.739 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:09:47.797 INFO:tasks.cephadm:Adding host smithi115 to orchestrator... 2024-09-19T09:09:47.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch host add smithi115 2024-09-19T09:09:48.049 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:48.262 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:47 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:48.262 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:47 smithi046 ceph-mon[31203]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 -- 172.21.15.46:0/1893461855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 msgr2=0x7f0f4c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 --2- 172.21.15.46:0/1893461855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009880 tx=0x7f0f3c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 -- 172.21.15.46:0/1893461855 shutdown_connections 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 --2- 172.21.15.46:0/1893461855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 -- 172.21.15.46:0/1893461855 >> 172.21.15.46:0/1893461855 conn(0x7f0f4c0fc1b0 msgr2=0x7f0f4c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 -- 172.21.15.46:0/1893461855 shutdown_connections 2024-09-19T09:09:48.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.459+0000 7f0f52699640 1 -- 172.21.15.46:0/1893461855 wait complete. 2024-09-19T09:09:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f52699640 1 Processor -- start 2024-09-19T09:09:48.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f52699640 1 -- start start 2024-09-19T09:09:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f52699640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f52699640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c10ab90 con 0x7f0f4c106560 2024-09-19T09:09:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f4bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34712/0 (socket says 172.21.15.46:34712) 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.460+0000 7f0f4bfff640 1 -- 172.21.15.46:0/977592682 learned_addr learned my addr 172.21.15.46:0/977592682 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f4bfff640 1 -- 172.21.15.46:0/977592682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c197640 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f4bfff640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009230 tx=0x7f0f3c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f3c03f070 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c1978d0 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c03bc80 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f3c035030 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.461+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c19b9d0 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.462+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0f3c042070 con 0x7f0f4c106560 2024-09-19T09:09:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.462+0000 7f0f497fa640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0f340392a0 0x7f0f3403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.462+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4c101bd0 con 0x7f0f4c106560 2024-09-19T09:09:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.462+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0f3c06cc70 con 0x7f0f4c106560 2024-09-19T09:09:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.462+0000 7f0f4b7fe640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0f340392a0 0x7f0f3403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.463+0000 7f0f4b7fe640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0f340392a0 0x7f0f3403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f400098c0 tx=0x7f0f40006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:48.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.467+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f3c042360 con 0x7f0f4c106560 2024-09-19T09:09:48.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:48.649+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}) -- 0x7f0f4c106a20 con 0x7f0f340392a0 2024-09-19T09:09:49.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:48 smithi046 ceph-mon[31203]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: Deploying cephadm binary to smithi115 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:52.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T09:09:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: Updating smithi099:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:09:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:09:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: Updating smithi099:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:09:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:52.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:51 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:52.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.499+0000 7f0f497fa640 1 -- 172.21.15.46:0/977592682 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f0f4c106a20 con 0x7f0f340392a0 2024-09-19T09:09:52.502 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi115' with addr '172.21.15.115' 2024-09-19T09:09:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0f340392a0 msgr2=0x7f0f3403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0f340392a0 0x7f0f3403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0f400098c0 tx=0x7f0f40006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 msgr2=0x7f0f4c197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c197100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009230 tx=0x7f0f3c003d40 comp rx=0 tx=0).stop 2024-09-19T09:09:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 shutdown_connections 2024-09-19T09:09:52.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0f340392a0 0x7f0f3403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 --2- 172.21.15.46:0/977592682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0f4c106560 0x7f0f4c197100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 >> 172.21.15.46:0/977592682 conn(0x7f0f4c0fc1b0 msgr2=0x7f0f4c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 shutdown_connections 2024-09-19T09:09:52.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:52.501+0000 7f0f52699640 1 -- 172.21.15.46:0/977592682 wait complete. 2024-09-19T09:09:53.080 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:52 smithi046 ceph-mon[31203]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:09:53.081 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:53.081 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:09:53.109 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:09:53.357 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 -- 172.21.15.46:0/885550023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 msgr2=0x7fd508107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 --2- 172.21.15.46:0/885550023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd504009880 tx=0x7fd50402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 -- 172.21.15.46:0/885550023 shutdown_connections 2024-09-19T09:09:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 --2- 172.21.15.46:0/885550023 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:53.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 -- 172.21.15.46:0/885550023 >> 172.21.15.46:0/885550023 conn(0x7fd5080fd290 msgr2=0x7fd5080ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 -- 172.21.15.46:0/885550023 shutdown_connections 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.808+0000 7fd50ff45640 1 -- 172.21.15.46:0/885550023 wait complete. 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50ff45640 1 Processor -- start 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50ff45640 1 -- start start 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50ff45640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50ff45640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810bc90 con 0x7fd508107660 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50dce1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50dce1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34732/0 (socket says 172.21.15.46:34732) 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50dce1640 1 -- 172.21.15.46:0/1965166909 learned_addr learned my addr 172.21.15.46:0/1965166909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.809+0000 7fd50dce1640 1 -- 172.21.15.46:0/1965166909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5081976c0 con 0x7fd508107660 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.810+0000 7fd50dce1640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508197180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd504009230 tx=0x7fd504003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:53.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.810+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50403f070 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.810+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd50403bc80 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.810+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd504035030 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.810+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd508197950 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.810+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd508197db0 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.811+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd504042070 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.811+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd508102cd0 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.811+0000 7fd4feffd640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f4039300 0x7fd4f403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.811+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd50406cfb0 con 0x7fd508107660 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.811+0000 7fd50d4e0640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f4039300 0x7fd4f403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.812+0000 7fd50d4e0640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f4039300 0x7fd4f403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80098c0 tx=0x7fd4f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:53.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:53.816+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5040372d0 con 0x7fd508107660 2024-09-19T09:09:53.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:53 smithi046 ceph-mon[31203]: Added host smithi115 2024-09-19T09:09:53.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:53.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:54.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.002+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd508198540 con 0x7fd4f4039300 2024-09-19T09:09:54.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.003+0000 7fd4feffd640 1 -- 172.21.15.46:0/1965166909 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7fd508198540 con 0x7fd4f4039300 2024-09-19T09:09:54.005 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:09:54.005 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}] 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f4039300 msgr2=0x7fd4f403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f4039300 0x7fd4f403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80098c0 tx=0x7fd4f8006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 msgr2=0x7fd508197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508197180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd504009230 tx=0x7fd504003d40 comp rx=0 tx=0).stop 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 shutdown_connections 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f4039300 0x7fd4f403b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 --2- 172.21.15.46:0/1965166909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107660 0x7fd508197180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 >> 172.21.15.46:0/1965166909 conn(0x7fd5080fd290 msgr2=0x7fd5080feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 shutdown_connections 2024-09-19T09:09:54.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:54.005+0000 7fd50ff45640 1 -- 172.21.15.46:0/1965166909 wait complete. 2024-09-19T09:09:54.762 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T09:09:54.763 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T09:09:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:54 smithi046 ceph-mon[31203]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:09:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:55.019 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 -- 172.21.15.46:0/1230180659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 msgr2=0x7f34e0106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 --2- 172.21.15.46:0/1230180659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009880 tx=0x7f34dc02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 -- 172.21.15.46:0/1230180659 shutdown_connections 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 --2- 172.21.15.46:0/1230180659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 -- 172.21.15.46:0/1230180659 >> 172.21.15.46:0/1230180659 conn(0x7f34e00fc1b0 msgr2=0x7f34e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 -- 172.21.15.46:0/1230180659 shutdown_connections 2024-09-19T09:09:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.440+0000 7f34e842f640 1 -- 172.21.15.46:0/1230180659 wait complete. 2024-09-19T09:09:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e842f640 1 Processor -- start 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e842f640 1 -- start start 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e842f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e842f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f34e010ab90 con 0x7f34e0106560 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e61cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e61cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34764/0 (socket says 172.21.15.46:34764) 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.441+0000 7f34e61cb640 1 -- 172.21.15.46:0/1483014974 learned_addr learned my addr 172.21.15.46:0/1483014974 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34e61cb640 1 -- 172.21.15.46:0/1483014974 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e0196590 con 0x7f34e0106560 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34e61cb640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0196050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009230 tx=0x7f34dc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc046070 con 0x7f34e0106560 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34dc038b60 con 0x7f34e0106560 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e0196820 con 0x7f34e0106560 2024-09-19T09:09:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc035070 con 0x7f34e0106560 2024-09-19T09:09:55.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.442+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e0196c80 con 0x7f34e0106560 2024-09-19T09:09:55.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.443+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f34dc049070 con 0x7f34e0106560 2024-09-19T09:09:55.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.443+0000 7f34d77fe640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f34cc0392a0 0x7f34cc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:55.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.443+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f34dc03e070 con 0x7f34e0106560 2024-09-19T09:09:55.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.443+0000 7f34e59ca640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f34cc0392a0 0x7f34cc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:55.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.443+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e0101bd0 con 0x7f34e0106560 2024-09-19T09:09:55.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.444+0000 7f34e59ca640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f34cc0392a0 0x7f34cc03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34d00098c0 tx=0x7f34d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:55.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.448+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f34dc038d10 con 0x7f34e0106560 2024-09-19T09:09:55.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.629+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f34e01974c0 con 0x7f34e0106560 2024-09-19T09:09:55.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.779+0000 7f34d77fe640 1 -- 172.21.15.46:0/1483014974 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f34dc0046c0 con 0x7f34e0106560 2024-09-19T09:09:55.780 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f34cc0392a0 msgr2=0x7f34cc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f34cc0392a0 0x7f34cc03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34d00098c0 tx=0x7f34d0006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 msgr2=0x7f34e0196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0196050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f34dc009230 tx=0x7f34dc003d40 comp rx=0 tx=0).stop 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 shutdown_connections 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f34cc0392a0 0x7f34cc03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 --2- 172.21.15.46:0/1483014974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34e0106560 0x7f34e0196050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 >> 172.21.15.46:0/1483014974 conn(0x7f34e00fc1b0 msgr2=0x7f34e00fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 shutdown_connections 2024-09-19T09:09:55.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:09:55.781+0000 7f34e842f640 1 -- 172.21.15.46:0/1483014974 wait complete. 2024-09-19T09:09:56.166 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:55 smithi046 ceph-mon[31203]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:09:56.166 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:55 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1483014974' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:09:56.381 INFO:tasks.cephadm:Adding mon.a on smithi046 2024-09-19T09:09:56.381 INFO:tasks.cephadm:Adding mon.b on smithi099 2024-09-19T09:09:56.382 INFO:tasks.cephadm:Adding mon.c on smithi115 2024-09-19T09:09:56.382 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c' 2024-09-19T09:09:56.658 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:09:56.702 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:09:57.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 -- 172.21.15.115:0/562695907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 msgr2=0x7f1488100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:57.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 --2- 172.21.15.115:0/562695907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1478009880 tx=0x7f147802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:09:57.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 -- 172.21.15.115:0/562695907 shutdown_connections 2024-09-19T09:09:57.208 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 --2- 172.21.15.115:0/562695907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 -- 172.21.15.115:0/562695907 >> 172.21.15.115:0/562695907 conn(0x7f14880fbcd0 msgr2=0x7f14880fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 -- 172.21.15.115:0/562695907 shutdown_connections 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.183+0000 7f148de61640 1 -- 172.21.15.115:0/562695907 wait complete. 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f148de61640 1 Processor -- start 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f148de61640 1 -- start start 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f148de61640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f148de61640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14881065f0 con 0x7f1488100540 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f14877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:57.209 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f14877fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.115:40818/0 (socket says 172.21.15.115:40818) 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.184+0000 7f14877fe640 1 -- 172.21.15.115:0/1230356781 learned_addr learned my addr 172.21.15.115:0/1230356781 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f14877fe640 1 -- 172.21.15.115:0/1230356781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14881972d0 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f14877fe640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488196d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1478004f60 tx=0x7f14780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f147803f070 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1478004cc0 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1488197560 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1478035030 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.185+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148819a210 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.186+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1478042070 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.186+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1488106d70 con 0x7f1488100540 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.186+0000 7f1484ff9640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14700392a0 0x7f147003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:57.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.186+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f147806d170 con 0x7f1488100540 2024-09-19T09:09:57.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.187+0000 7f1486ffd640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14700392a0 0x7f147003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:57.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.187+0000 7f1486ffd640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14700392a0 0x7f147003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f147c0098c0 tx=0x7f147c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:57.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.191+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f14780433b0 con 0x7f1488100540 2024-09-19T09:09:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:09:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1483014974' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:09:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:09:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:57.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:57.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:57.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:09:57.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:57.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:09:57.387 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.387+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c", "target": ["mon-mgr", ""]}) -- 0x7f148802d960 con 0x7f14700392a0 2024-09-19T09:09:57.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.393+0000 7f1484ff9640 1 -- 172.21.15.115:0/1230356781 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f148802d960 con 0x7f14700392a0 2024-09-19T09:09:57.394 INFO:teuthology.orchestra.run.smithi115.stdout:Scheduled mon update... 2024-09-19T09:09:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14700392a0 msgr2=0x7f147003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14700392a0 0x7f147003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f147c0098c0 tx=0x7f147c006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 msgr2=0x7f1488196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488196d90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1478004f60 tx=0x7f14780048f0 comp rx=0 tx=0).stop 2024-09-19T09:09:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 shutdown_connections 2024-09-19T09:09:57.396 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14700392a0 0x7f147003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:57.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 --2- 172.21.15.115:0/1230356781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1488100540 0x7f1488196d90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:57.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 >> 172.21.15.115:0/1230356781 conn(0x7f14880fbcd0 msgr2=0x7f1488069b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:57.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 shutdown_connections 2024-09-19T09:09:57.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:57.395+0000 7f148de61640 1 -- 172.21.15.115:0/1230356781 wait complete. 2024-09-19T09:09:57.974 DEBUG:teuthology.orchestra.run.smithi099:mon.b> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T09:09:57.977 DEBUG:teuthology.orchestra.run.smithi115:mon.c> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T09:09:57.980 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:09:57.980 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:09:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:09:58.610 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:09:59.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 -- 172.21.15.115:0/2610458857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 msgr2=0x7f1e50102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:59.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 --2- 172.21.15.115:0/2610458857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e50102b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009c10 tx=0x7f1e4002aa10 comp rx=0 tx=0).stop 2024-09-19T09:09:59.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 -- 172.21.15.115:0/2610458857 shutdown_connections 2024-09-19T09:09:59.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 --2- 172.21.15.115:0/2610458857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e50102b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:59.024 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 -- 172.21.15.115:0/2610458857 >> 172.21.15.115:0/2610458857 conn(0x7f1e50077310 msgr2=0x7f1e500fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:59.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 -- 172.21.15.115:0/2610458857 shutdown_connections 2024-09-19T09:09:59.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.023+0000 7f1e554fc640 1 -- 172.21.15.115:0/2610458857 wait complete. 2024-09-19T09:09:59.025 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.024+0000 7f1e554fc640 1 Processor -- start 2024-09-19T09:09:59.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.024+0000 7f1e554fc640 1 -- start start 2024-09-19T09:09:59.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.024+0000 7f1e554fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e501971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:59.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.024+0000 7f1e554fc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5010bc80 con 0x7f1e50102730 2024-09-19T09:09:59.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.024+0000 7f1e4effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e501971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:59.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e4effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e501971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.115:40832/0 (socket says 172.21.15.115:40832) 2024-09-19T09:09:59.026 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e4effd640 1 -- 172.21.15.115:0/3342524868 learned_addr learned my addr 172.21.15.115:0/3342524868 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e4effd640 1 -- 172.21.15.115:0/3342524868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e501976f0 con 0x7f1e50102730 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e4effd640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e501971b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009d30 tx=0x7f1e40030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e40034070 con 0x7f1e50102730 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e4002f8c0 con 0x7f1e50102730 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e50197980 con 0x7f1e50102730 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e400044d0 con 0x7f1e50102730 2024-09-19T09:09:59.027 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.025+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e50197d80 con 0x7f1e50102730 2024-09-19T09:09:59.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.026+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e50069f90 con 0x7f1e50102730 2024-09-19T09:09:59.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.026+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1e40037020 con 0x7f1e50102730 2024-09-19T09:09:59.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.027+0000 7f1e47fff640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1e3c039300 0x7f1e3c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:09:59.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.027+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1e4006d210 con 0x7f1e50102730 2024-09-19T09:09:59.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.027+0000 7f1e4e7fc640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1e3c039300 0x7f1e3c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:09:59.028 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.027+0000 7f1e4e7fc640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1e3c039300 0x7f1e3c03b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e380098c0 tx=0x7f1e38006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:09:59.032 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.032+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e4003f070 con 0x7f1e50102730 2024-09-19T09:09:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:58 smithi046 ceph-mon[31203]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:09:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:58 smithi046 ceph-mon[31203]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:09:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:58 smithi046 ceph-mon[31203]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:09:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:58 smithi046 ceph-mon[31203]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:09:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:58 smithi046 ceph-mon[31203]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c;count:3 2024-09-19T09:09:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:58 smithi046 ceph-mon[31203]: Deploying daemon mon.c on smithi115 2024-09-19T09:09:59.272 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.271+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1e5019ba80 con 0x7f1e50102730 2024-09-19T09:09:59.273 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.272+0000 7f1e47fff640 1 -- 172.21.15.115:0/3342524868 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f1e4002c040 con 0x7f1e50102730 2024-09-19T09:09:59.273 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:09:59.273 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":1,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","modified":"2024-09-19T09:08:30.337142Z","created":"2024-09-19T09:08:30.337142Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:09:59.273 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 1 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1e3c039300 msgr2=0x7f1e3c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1e3c039300 0x7f1e3c03b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e380098c0 tx=0x7f1e38006db0 comp rx=0 tx=0).stop 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 msgr2=0x7f1e501971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e501971b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009d30 tx=0x7f1e40030c30 comp rx=0 tx=0).stop 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 shutdown_connections 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1e3c039300 0x7f1e3c03b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:59.275 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 --2- 172.21.15.115:0/3342524868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e50102730 0x7f1e501971b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:09:59.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 >> 172.21.15.115:0/3342524868 conn(0x7f1e50077310 msgr2=0x7f1e501054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:09:59.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 shutdown_connections 2024-09-19T09:09:59.276 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:09:59.274+0000 7f1e554fc640 1 -- 172.21.15.115:0/3342524868 wait complete. 2024-09-19T09:10:00.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:09:59 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/3342524868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:01.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:00 smithi046 ceph-mon[31203]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:02.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T09:10:02.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T09:10:02.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T09:10:02.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T09:10:02.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T09:10:02.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T09:10:02.103 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:10:02.103 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:10:02.369 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1483014974' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1483014974' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:10:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c;count:3 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: Deploying daemon mon.c on smithi115 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/3342524868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 ceph-mon[35055]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 bash[35036]: dc23161d66efe472cc27a1646a2b3950f2ff2df5a6b040fa32fd76dcf870c5f9 2024-09-19T09:10:02.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:02 smithi115 systemd[1]: Started Ceph mon.c for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:10:07.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 -- 172.21.15.115:0/325582538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614003530 msgr2=0x7f36140059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 --2- 172.21.15.115:0/325582538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614003530 0x7f36140059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f362806a240 tx=0x7f361802bfe0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 -- 172.21.15.115:0/325582538 shutdown_connections 2024-09-19T09:10:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 --2- 172.21.15.115:0/325582538 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3614003530 0x7f36140059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 -- 172.21.15.115:0/325582538 >> 172.21.15.115:0/325582538 conn(0x7f36280fc280 msgr2=0x7f36280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 -- 172.21.15.115:0/325582538 shutdown_connections 2024-09-19T09:10:07.316 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.313+0000 7f362db35640 1 -- 172.21.15.115:0/325582538 wait complete. 2024-09-19T09:10:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.314+0000 7f362db35640 1 Processor -- start 2024-09-19T09:10:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f362db35640 1 -- start start 2024-09-19T09:10:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f362db35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f362db35640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36281009e0 0x7f3628100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f362db35640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f36281097a0 con 0x7f36281009e0 2024-09-19T09:10:07.318 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f362db35640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3628109620 con 0x7f3614003530 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:50244/0 (socket says 172.21.15.115:50244) 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 -- 172.21.15.115:0/1511178791 learned_addr learned my addr 172.21.15.115:0/1511178791 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 -- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 msgr2=0x7f36281004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 -- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 msgr2=0x7f36281004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f36277fe640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.315+0000 7f3626ffd640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36281009e0 0x7f3628100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3626ffd640 1 -- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 msgr2=0x7f36281004a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3626ffd640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.319 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3626ffd640 1 -- 172.21.15.115:0/1511178791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3628102340 con 0x7f36281009e0 2024-09-19T09:10:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3626ffd640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36281009e0 0x7f3628100e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f361000b400 tx=0x7f361000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3610011630 con 0x7f36281009e0 2024-09-19T09:10:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3610011cb0 con 0x7f36281009e0 2024-09-19T09:10:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3610010d80 con 0x7f36281009e0 2024-09-19T09:10:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.316+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36281a3530 con 0x7f36281009e0 2024-09-19T09:10:07.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.317+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36281a3ac0 con 0x7f36281009e0 2024-09-19T09:10:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.317+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3610018020 con 0x7f36281009e0 2024-09-19T09:10:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.318+0000 7f3624ff9640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3608039090 0x7f360803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.318+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362806a4f0 con 0x7f36281009e0 2024-09-19T09:10:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.318+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f361004bfe0 con 0x7f36281009e0 2024-09-19T09:10:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.318+0000 7f36277fe640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3608039090 0x7f360803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:07.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.319+0000 7f36277fe640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3608039090 0x7f360803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3618009b30 tx=0x7f361802e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:07.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.323+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f361001f020 con 0x7f36281009e0 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: mon.a calling monitor election 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: mon.c calling monitor election 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: monmap epoch 2 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: last_changed 2024-09-19T09:10:02.098765+0000 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: min_mon_release 19 (squid) 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: election_strategy: 1 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.c 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: fsmap 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:07.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: mgrmap e13: x(active, since 38s) 2024-09-19T09:10:07.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: overall HEALTH_OK 2024-09-19T09:10:07.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:07.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:07.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:07.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:07.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:07.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:10:07.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: mon.a calling monitor election 2024-09-19T09:10:07.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:07.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: mon.c calling monitor election 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: monmap epoch 2 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: last_changed 2024-09-19T09:10:02.098765+0000 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: min_mon_release 19 (squid) 2024-09-19T09:10:07.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: election_strategy: 1 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.c 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: fsmap 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: mgrmap e13: x(active, since 38s) 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: overall HEALTH_OK 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:07.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:07.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.559+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3628190f00 con 0x7f36281009e0 2024-09-19T09:10:07.561 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.560+0000 7f3624ff9640 1 -- 172.21.15.115:0/1511178791 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3610018570 con 0x7f36281009e0 2024-09-19T09:10:07.562 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:10:07.562 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":2,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","modified":"2024-09-19T09:10:02.098765Z","created":"2024-09-19T09:08:30.337142Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:10:07.562 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 2 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3608039090 msgr2=0x7f360803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3608039090 0x7f360803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3618009b30 tx=0x7f361802e040 comp rx=0 tx=0).stop 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36281009e0 msgr2=0x7f3628100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36281009e0 0x7f3628100e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f361000b400 tx=0x7f361000b8c0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 shutdown_connections 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3608039090 0x7f360803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36281009e0 0x7f3628100e40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 --2- 172.21.15.115:0/1511178791 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3614003530 0x7f36281004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:07.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 >> 172.21.15.115:0/1511178791 conn(0x7f36280fc280 msgr2=0x7f36280fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:07.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 shutdown_connections 2024-09-19T09:10:07.565 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:07.562+0000 7f362db35640 1 -- 172.21.15.115:0/1511178791 wait complete. 2024-09-19T09:10:08.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:08 smithi115 ceph-mon[35055]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:08.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:08 smithi115 ceph-mon[35055]: Deploying daemon mon.b on smithi099 2024-09-19T09:10:08.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:08 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/1511178791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:08.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:08.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:08 smithi046 ceph-mon[31203]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:08.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:08 smithi046 ceph-mon[31203]: Deploying daemon mon.b on smithi099 2024-09-19T09:10:08.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:08 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/1511178791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:08.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:09.160 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:10:09.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:10:09.416 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:10:09.481 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:10:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:10:09.098+0000 7f57c08d5640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 -- 172.21.15.115:0/3880213447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 msgr2=0x7f0cb4106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 --2- 172.21.15.115:0/3880213447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb4106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009880 tx=0x7f0ca402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 -- 172.21.15.115:0/3880213447 shutdown_connections 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 --2- 172.21.15.115:0/3880213447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb4106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 -- 172.21.15.115:0/3880213447 >> 172.21.15.115:0/3880213447 conn(0x7f0cb40fc220 msgr2=0x7f0cb40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 -- 172.21.15.115:0/3880213447 shutdown_connections 2024-09-19T09:10:09.836 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.830+0000 7f0cb9564640 1 -- 172.21.15.115:0/3880213447 wait complete. 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb9564640 1 Processor -- start 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb9564640 1 -- start start 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb9564640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb41962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb9564640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 0x7f0cb419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb9564640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb410ac60 con 0x7f0cb4106630 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb9564640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb410aae0 con 0x7f0cb4196820 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cb2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb41962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.831+0000 7f0cabfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 0x7f0cb419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb41962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.115:47098/0 (socket says 172.21.15.115:47098) 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb2ffd640 1 -- 172.21.15.115:0/1061451661 learned_addr learned my addr 172.21.15.115:0/1061451661 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cabfff640 1 -- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 msgr2=0x7f0cb419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:10:09.837 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cabfff640 1 -- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 msgr2=0x7f0cb419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cabfff640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 0x7f0cb419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cabfff640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 0x7f0cb419abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb2ffd640 1 -- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 msgr2=0x7f0cb419abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb2ffd640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 0x7f0cb419abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb2ffd640 1 -- 172.21.15.115:0/1061451661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb4196e40 con 0x7f0cb4106630 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb2ffd640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb41962e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4004650 tx=0x7f0ca4032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0ca4035070 con 0x7f0cb4106630 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb419b0f0 con 0x7f0cb4106630 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb419b5d0 con 0x7f0cb4106630 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ca4003ce0 con 0x7f0cb4106630 2024-09-19T09:10:09.838 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.832+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0ca403bbd0 con 0x7f0cb4106630 2024-09-19T09:10:09.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.833+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb4101ca0 con 0x7f0cb4106630 2024-09-19T09:10:09.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.833+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0ca4042030 con 0x7f0cb4106630 2024-09-19T09:10:09.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.834+0000 7f0cb0ff9640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ca0039040 0x7f0ca003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:09.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.834+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0ca4040070 con 0x7f0cb4106630 2024-09-19T09:10:09.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.834+0000 7f0cabfff640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ca0039040 0x7f0ca003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:09.839 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.834+0000 7f0cabfff640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ca0039040 0x7f0ca003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c006a90 tx=0x7f0c9c006a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:09.840 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:09.839+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ca402fdf0 con 0x7f0cb4106630 2024-09-19T09:10:10.066 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.065+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0cb419b8f0 con 0x7f0cb4106630 2024-09-19T09:10:10.067 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.065+0000 7f0cb0ff9640 1 -- 172.21.15.115:0/1061451661 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0ca4044930 con 0x7f0cb4106630 2024-09-19T09:10:10.067 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:10:10.068 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":2,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","modified":"2024-09-19T09:10:02.098765Z","created":"2024-09-19T09:08:30.337142Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:10:10.068 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 2 2024-09-19T09:10:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.067+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ca0039040 msgr2=0x7f0ca003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.067+0000 7f0cb9564640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ca0039040 0x7f0ca003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c006a90 tx=0x7f0c9c006a20 comp rx=0 tx=0).stop 2024-09-19T09:10:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.067+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 msgr2=0x7f0cb41962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.067+0000 7f0cb9564640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb41962e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4004650 tx=0x7f0ca4032c50 comp rx=0 tx=0).stop 2024-09-19T09:10:10.069 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 shutdown_connections 2024-09-19T09:10:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ca0039040 0x7f0ca003b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cb4196820 0x7f0cb419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 --2- 172.21.15.115:0/1061451661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cb4106630 0x7f0cb41962e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 >> 172.21.15.115:0/1061451661 conn(0x7f0cb40fc220 msgr2=0x7f0cb40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 shutdown_connections 2024-09-19T09:10:10.070 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:10.068+0000 7f0cb9564640 1 -- 172.21.15.115:0/1061451661 wait complete. 2024-09-19T09:10:10.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:10 smithi115 ceph-mon[35055]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:10.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:10 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/1061451661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:10.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:10 smithi046 ceph-mon[31203]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:10.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:10 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/1061451661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:10.942 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(???) e0 preinit fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: e1 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: btime 2024-09-19T09:08:41:072677+0000 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: legacy client fscid: -1 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout: No filesystems configured 2024-09-19T09:10:10.943 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:10:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1483014974' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1483014974' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-19T09:10:11.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:10:11.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Saving service mon spec with placement smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c;count:3 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Deploying daemon mon.c on smithi115 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/3342524868' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.a calling monitor election 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.c calling monitor election 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: monmap epoch 2 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: last_changed 2024-09-19T09:10:02.098765+0000 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: min_mon_release 19 (squid) 2024-09-19T09:10:11.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: election_strategy: 1 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.c 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: fsmap 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mgrmap e13: x(active, since 38s) 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: overall HEALTH_OK 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: Deploying daemon mon.b on smithi099 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/1511178791' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/1061451661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 ceph-mon[35256]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 bash[35237]: ebf1daa339738fb6b5b90d4cad6dd9bb5c4a2e9d236541bb931e1b847b0b6db6 2024-09-19T09:10:11.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:10 smithi099 systemd[1]: Started Ceph mon.b for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:10:11.607 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:10:11.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:10:11.854 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:10:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:10:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: mon.a calling monitor election 2024-09-19T09:10:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: mon.c calling monitor election 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: mon.b calling monitor election 2024-09-19T09:10:16.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: monmap epoch 3 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:16.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: last_changed 2024-09-19T09:10:10.947756+0000 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: min_mon_release 19 (squid) 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: election_strategy: 1 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.c 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: fsmap 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: mgrmap e13: x(active, since 47s) 2024-09-19T09:10:16.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: overall HEALTH_OK 2024-09-19T09:10:16.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: mon.a calling monitor election 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: mon.c calling monitor election 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: mon.b calling monitor election 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: monmap epoch 3 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: last_changed 2024-09-19T09:10:10.947756+0000 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: min_mon_release 19 (squid) 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: election_strategy: 1 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.c 2024-09-19T09:10:16.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: fsmap 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: mgrmap e13: x(active, since 47s) 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: overall HEALTH_OK 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:10:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: mon.a calling monitor election 2024-09-19T09:10:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: mon.c calling monitor election 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: mon.b calling monitor election 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:10:16.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: monmap epoch 3 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: last_changed 2024-09-19T09:10:10.947756+0000 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: created 2024-09-19T09:08:30.337142+0000 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: min_mon_release 19 (squid) 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: election_strategy: 1 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.a 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: 1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.c 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: 2: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.b 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: fsmap 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: mgrmap e13: x(active, since 47s) 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: overall HEALTH_OK 2024-09-19T09:10:16.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.484 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:16.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/3779366377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f70003530 msgr2=0x7f7f700059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/3779366377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f70003530 0x7f7f700059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f84102b40 tx=0x7f7f7402c490 comp rx=0 tx=0).stop 2024-09-19T09:10:16.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/3779366377 shutdown_connections 2024-09-19T09:10:16.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/3779366377 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f70003530 0x7f7f700059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.716 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/3779366377 >> 172.21.15.115:0/3779366377 conn(0x7f7f840fd3b0 msgr2=0x7f7f840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/3779366377 shutdown_connections 2024-09-19T09:10:16.717 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.714+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/3779366377 wait complete. 2024-09-19T09:10:16.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 Processor -- start 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 -- start start 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f84197930 0x7f7f8419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 0x7f7f8419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84109770 con 0x7f7f84197930 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841095f0 con 0x7f7f8419c200 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8bf2e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841098f0 con 0x7f7f70003530 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.719 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33138/0 (socket says 172.21.15.115:33138) 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 -- 172.21.15.115:0/1925165972 learned_addr learned my addr 172.21.15.115:0/1925165972 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 msgr2=0x7f7f841973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 msgr2=0x7f7f841973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f894c9640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f84197930 0x7f7f8419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f89cca640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.715+0000 7f7f8a4cb640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 0x7f7f8419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f8a4cb640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 msgr2=0x7f7f8419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f8a4cb640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 msgr2=0x7f7f8419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f8a4cb640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 0x7f7f8419c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f8a4cb640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 0x7f7f8419c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:10:16.720 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f894c9640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 msgr2=0x7f7f841973f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f894c9640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f894c9640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 msgr2=0x7f7f8419c6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f894c9640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 0x7f7f8419c6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f894c9640 1 -- 172.21.15.115:0/1925165972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f841a3f70 con 0x7f7f84197930 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f894c9640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f84197930 0x7f7f8419bcc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000b450 tx=0x7f7f8000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80004230 con 0x7f7f84197930 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f841a41a0 con 0x7f7f84197930 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f841a4700 con 0x7f7f84197930 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f800043d0 con 0x7f7f84197930 2024-09-19T09:10:16.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.716+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80003b80 con 0x7f7f84197930 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.717+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7f8000f050 con 0x7f7f84197930 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.717+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8410a920 con 0x7f7f84197930 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.718+0000 7f7f7affd640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7f68039730 0x7f7f6803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.718+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7f8004be40 con 0x7f7f84197930 2024-09-19T09:10:16.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.718+0000 7f7f89cca640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7f68039730 0x7f7f6803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:16.723 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.718+0000 7f7f89cca640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7f68039730 0x7f7f6803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402ca00 tx=0x7f7f7402c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:16.724 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.723+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f8001f070 con 0x7f7f84197930 2024-09-19T09:10:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.963+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7f841060a0 con 0x7f7f84197930 2024-09-19T09:10:16.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.963+0000 7f7f7affd640 1 -- 172.21.15.115:0/1925165972 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f7f8000d040 con 0x7f7f84197930 2024-09-19T09:10:16.965 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:10:16.966 INFO:teuthology.orchestra.run.smithi115.stdout:{"epoch":3,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","modified":"2024-09-19T09:10:10.947756Z","created":"2024-09-19T09:08:30.337142Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-19T09:10:16.966 INFO:teuthology.orchestra.run.smithi115.stderr:dumped monmap epoch 3 2024-09-19T09:10:16.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7f68039730 msgr2=0x7f7f6803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7f68039730 0x7f7f6803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402ca00 tx=0x7f7f7402c990 comp rx=0 tx=0).stop 2024-09-19T09:10:16.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f84197930 msgr2=0x7f7f8419bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:16.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f84197930 0x7f7f8419bcc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000b450 tx=0x7f7f8000b910 comp rx=0 tx=0).stop 2024-09-19T09:10:16.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 shutdown_connections 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7f68039730 0x7f7f6803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7f84197930 0x7f7f8419bcc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f8419c200 0x7f7f8419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 --2- 172.21.15.115:0/1925165972 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f70003530 0x7f7f841973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.965+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 >> 172.21.15.115:0/1925165972 conn(0x7f7f840fd3b0 msgr2=0x7f7f840ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.966+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 shutdown_connections 2024-09-19T09:10:16.968 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:16.966+0000 7f7f8bf2e640 1 -- 172.21.15.115:0/1925165972 wait complete. 2024-09-19T09:10:17.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:17.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:17.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:17 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/1925165972' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:17.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:17.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:17.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:17 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/1925165972' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:17.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:17.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:10:17.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:17 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/1925165972' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:10:17.851 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T09:10:17.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T09:10:18.109 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:18.194 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:10:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:10:17.947+0000 7f57c08d5640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T09:10:18.194 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: Updating smithi099:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.195 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: Updating smithi046:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:18.196 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:18.197 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:18.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: Updating smithi099:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: Updating smithi046:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:18.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:18.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:18.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: Updating smithi099:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: Updating smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: Updating smithi046:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:18.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:18.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:18.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.039+0000 7f4df10fd640 1 -- 172.21.15.46:0/3971742148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec102730 msgr2=0x7f4dec102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.039+0000 7f4df10fd640 1 --2- 172.21.15.46:0/3971742148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec102730 0x7f4dec102b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009c10 tx=0x7f4ddc02aa10 comp rx=0 tx=0).stop 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.040+0000 7f4df10fd640 1 -- 172.21.15.46:0/3971742148 shutdown_connections 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.040+0000 7f4df10fd640 1 --2- 172.21.15.46:0/3971742148 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec102730 0x7f4dec102b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.040+0000 7f4df10fd640 1 -- 172.21.15.46:0/3971742148 >> 172.21.15.46:0/3971742148 conn(0x7f4dec077310 msgr2=0x7f4dec0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.040+0000 7f4df10fd640 1 -- 172.21.15.46:0/3971742148 shutdown_connections 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.040+0000 7f4df10fd640 1 -- 172.21.15.46:0/3971742148 wait complete. 2024-09-19T09:10:19.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.040+0000 7f4df10fd640 1 Processor -- start 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 -- start start 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dec102730 0x7f4dec199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec199b40 0x7f4dec19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 0x7f4dec19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10bc80 con 0x7f4dec19e410 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10bb00 con 0x7f4dec102730 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4df10fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec10be00 con 0x7f4dec199b40 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4deb59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 0x7f4dec19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4deb59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 0x7f4dec19e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36380/0 (socket says 172.21.15.46:36380) 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4deb59e640 1 -- 172.21.15.46:0/2321544753 learned_addr learned my addr 172.21.15.46:0/2321544753 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4dead9d640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dec102730 0x7f4dec199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:19.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.041+0000 7f4dea59c640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec199b40 0x7f4dec19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4dead9d640 1 -- 172.21.15.46:0/2321544753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec199b40 msgr2=0x7f4dec19ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4dead9d640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec199b40 0x7f4dec19ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4dead9d640 1 -- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 msgr2=0x7f4dec19e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4dead9d640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 0x7f4dec19e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4dead9d640 1 -- 172.21.15.46:0/2321544753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec1a6180 con 0x7f4dec102730 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4deb59e640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 0x7f4dec19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.042+0000 7f4dea59c640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec199b40 0x7f4dec19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.043+0000 7f4dead9d640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dec102730 0x7f4dec199600 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc02af80 tx=0x7f4ddc030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.043+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc047070 con 0x7f4dec102730 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.043+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ddc003e20 con 0x7f4dec102730 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.043+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc034070 con 0x7f4dec102730 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.043+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec1a6350 con 0x7f4dec102730 2024-09-19T09:10:19.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.043+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec1a6800 con 0x7f4dec102730 2024-09-19T09:10:19.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.044+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4ddc04a070 con 0x7f4dec102730 2024-09-19T09:10:19.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.044+0000 7f4dd3fff640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4dd4039730 0x7f4dd403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:19.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.044+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec069f90 con 0x7f4dec102730 2024-09-19T09:10:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.044+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4ddc06d320 con 0x7f4dec102730 2024-09-19T09:10:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.044+0000 7f4dea59c640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4dd4039730 0x7f4dd403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:19.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.045+0000 7f4dea59c640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4dd4039730 0x7f4dd403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009890 tx=0x7f4de0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:19.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.050+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ddc051020 con 0x7f4dec102730 2024-09-19T09:10:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.230+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f4dec1a6a60 con 0x7f4dec102730 2024-09-19T09:10:19.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.230+0000 7f4dd3fff640 1 -- 172.21.15.46:0/2321544753 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f4ddc03f070 con 0x7f4dec102730 2024-09-19T09:10:19.231 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:19.231 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-09-19T09:10:19.231 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:10:19.231 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] 2024-09-19T09:10:19.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.232+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4dd4039730 msgr2=0x7f4dd403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:19.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.232+0000 7f4df10fd640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4dd4039730 0x7f4dd403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009890 tx=0x7f4de0008040 comp rx=0 tx=0).stop 2024-09-19T09:10:19.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.232+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dec102730 msgr2=0x7f4dec199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:19.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.232+0000 7f4df10fd640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dec102730 0x7f4dec199600 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc02af80 tx=0x7f4ddc030940 comp rx=0 tx=0).stop 2024-09-19T09:10:19.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 shutdown_connections 2024-09-19T09:10:19.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4dd4039730 0x7f4dd403bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4dec19e410 0x7f4dec19e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dec199b40 0x7f4dec19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 --2- 172.21.15.46:0/2321544753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4dec102730 0x7f4dec199600 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 >> 172.21.15.46:0/2321544753 conn(0x7f4dec077310 msgr2=0x7f4dec107920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 shutdown_connections 2024-09-19T09:10:19.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:19.233+0000 7f4df10fd640 1 -- 172.21.15.46:0/2321544753 wait complete. 2024-09-19T09:10:19.428 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:19 smithi046 ceph-mon[31203]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:10:19.428 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:19 smithi046 ceph-mon[31203]: Reconfiguring daemon mon.a on smithi046 2024-09-19T09:10:19.428 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:19.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:19 smithi115 ceph-mon[35055]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:10:19.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:19 smithi115 ceph-mon[35055]: Reconfiguring daemon mon.a on smithi046 2024-09-19T09:10:19.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:19.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:19 smithi099 ceph-mon[35256]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:10:19.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:19 smithi099 ceph-mon[35256]: Reconfiguring daemon mon.a on smithi046 2024-09-19T09:10:19.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.011 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T09:10:20.011 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:10:20.011 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:10:20.041 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:10:20.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:10:20.108 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:10:20.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:10:20.138 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:10:20.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:10:20.205 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:10:20.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:10:20.237 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:10:20.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:10:20.292 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:20.292 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2321544753' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:20.292 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:10:20.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:20.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:20.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:20.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:20 smithi046 ceph-mon[31203]: Reconfiguring daemon mon.b on smithi099 2024-09-19T09:10:20.306 INFO:tasks.cephadm:Adding mgr.x on smithi046 2024-09-19T09:10:20.306 INFO:tasks.cephadm:Adding mgr.y on smithi099 2024-09-19T09:10:20.307 INFO:tasks.cephadm:Adding mgr.z on smithi115 2024-09-19T09:10:20.307 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi046=x;smithi099=y;smithi115=z' 2024-09-19T09:10:20.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2321544753' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:20.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:20 smithi115 ceph-mon[35055]: Reconfiguring daemon mon.b on smithi099 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2321544753' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:20 smithi099 ceph-mon[35256]: Reconfiguring daemon mon.b on smithi099 2024-09-19T09:10:20.588 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:10:21.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 -- 172.21.15.115:0/1831602167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 msgr2=0x7fbde81030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:21.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 --2- 172.21.15.115:0/1831602167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde81030c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009880 tx=0x7fbde002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 -- 172.21.15.115:0/1831602167 shutdown_connections 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 --2- 172.21.15.115:0/1831602167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde81030c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 -- 172.21.15.115:0/1831602167 >> 172.21.15.115:0/1831602167 conn(0x7fbde80fb510 msgr2=0x7fbde80fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 -- 172.21.15.115:0/1831602167 shutdown_connections 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.014+0000 7fbded067640 1 -- 172.21.15.115:0/1831602167 wait complete. 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 Processor -- start 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 -- start start 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde8196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde81974e0 0x7fbde819c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbde8197960 0x7fbde819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbde81077a0 con 0x7fbde8102cc0 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8107620 con 0x7fbde81974e0 2024-09-19T09:10:21.035 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbded067640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbde8107920 con 0x7fbde8197960 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbde759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbde8197960 0x7fbde819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.015+0000 7fbde6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde8196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde8196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.115:40778/0 (socket says 172.21.15.115:40778) 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde759e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbde8197960 0x7fbde819eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33144/0 (socket says 172.21.15.115:33144) 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 -- 172.21.15.115:0/4285355428 learned_addr learned my addr 172.21.15.115:0/4285355428 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde659c640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde81974e0 0x7fbde819c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 -- 172.21.15.115:0/4285355428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbde8197960 msgr2=0x7fbde819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbde8197960 0x7fbde819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 -- 172.21.15.115:0/4285355428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde81974e0 msgr2=0x7fbde819c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde81974e0 0x7fbde819c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 -- 172.21.15.115:0/4285355428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde819f3a0 con 0x7fbde8102cc0 2024-09-19T09:10:21.036 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde659c640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde81974e0 0x7fbde819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbde6d9d640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde8196fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbde0031610 tx=0x7fbde00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde003f030 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde0003ce0 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde819f630 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0035070 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.016+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde819fb90 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.017+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbde0042030 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.017+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde8190560 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.017+0000 7fbdcffff640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdd0039730 0x7fbdd003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.017+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbde006d130 con 0x7fbde8102cc0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.018+0000 7fbde659c640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdd0039730 0x7fbdd003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:21.037 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.018+0000 7fbde659c640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdd0039730 0x7fbdd003bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbddc006fd0 tx=0x7fbddc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:21.038 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.022+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbde003ac70 con 0x7fbde8102cc0 2024-09-19T09:10:21.207 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.207+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi099=y;smithi115=z", "target": ["mon-mgr", ""]}) -- 0x7fbde8062630 con 0x7fbdd0039730 2024-09-19T09:10:21.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.212+0000 7fbdcffff640 1 -- 172.21.15.115:0/4285355428 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fbde8062630 con 0x7fbdd0039730 2024-09-19T09:10:21.213 INFO:teuthology.orchestra.run.smithi115.stdout:Scheduled mgr update... 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdd0039730 msgr2=0x7fbdd003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdd0039730 0x7fbdd003bbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbddc006fd0 tx=0x7fbddc008040 comp rx=0 tx=0).stop 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 msgr2=0x7fbde8196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde8196fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbde0031610 tx=0x7fbde00043c0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 shutdown_connections 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdd0039730 0x7fbdd003bbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.215 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbde8197960 0x7fbde819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbde81974e0 0x7fbde819c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 --2- 172.21.15.115:0/4285355428 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde8102cc0 0x7fbde8196fa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 >> 172.21.15.115:0/4285355428 conn(0x7fbde80fb510 msgr2=0x7fbde80fc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 shutdown_connections 2024-09-19T09:10:21.216 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:10:21.214+0000 7fbded067640 1 -- 172.21.15.115:0/4285355428 wait complete. 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: Reconfiguring daemon mon.c on smithi115 2024-09-19T09:10:21.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:21.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: Reconfiguring daemon mon.c on smithi115 2024-09-19T09:10:21.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:22.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:22.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:10:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:10:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:10:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: Reconfiguring daemon mon.c on smithi115 2024-09-19T09:10:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:22.340 DEBUG:teuthology.orchestra.run.smithi099:mgr.y> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T09:10:22.343 DEBUG:teuthology.orchestra.run.smithi115:mgr.z> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T09:10:22.382 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T09:10:22.382 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:10:22.382 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:10:22.403 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:10:22.403 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-09-19T09:10:22.462 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 09:09:39.472845285 +0000 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 09:05:23.316902535 +0000 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 09:05:23.316902535 +0000 2024-09-19T09:10:22.463 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 09:05:23.316902535 +0000 2024-09-19T09:10:22.463 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:10:22.532 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T09:10:22.533 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T09:10:22.533 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000130019 s, 3.9 MB/s 2024-09-19T09:10:22.534 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:10:22.594 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-09-19T09:10:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:10:22.652 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 09:09:39.503844962 +0000 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 09:05:23.631899321 +0000 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 09:05:23.631899321 +0000 2024-09-19T09:10:22.653 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 09:05:23.631899321 +0000 2024-09-19T09:10:22.653 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:10:22.721 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T09:10:22.721 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T09:10:22.721 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000119361 s, 4.3 MB/s 2024-09-19T09:10:22.722 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:10:22.781 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-09-19T09:10:22.838 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 09:09:39.530844681 +0000 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 09:05:23.950896067 +0000 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 09:05:23.950896067 +0000 2024-09-19T09:10:22.839 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 09:05:23.950896067 +0000 2024-09-19T09:10:22.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:10:22.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:22 smithi046 ceph-mon[31203]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:22.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:22 smithi046 ceph-mon[31203]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi099=y;smithi115=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:22.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:22 smithi046 ceph-mon[31203]: Saving service mgr spec with placement smithi046=x;smithi099=y;smithi115=z;count:3 2024-09-19T09:10:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T09:10:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T09:10:22.905 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000114694 s, 4.5 MB/s 2024-09-19T09:10:22.907 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:10:22.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:22 smithi115 ceph-mon[35055]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:22.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:22 smithi115 ceph-mon[35055]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi099=y;smithi115=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:22.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:22 smithi115 ceph-mon[35055]: Saving service mgr spec with placement smithi046=x;smithi099=y;smithi115=z;count:3 2024-09-19T09:10:22.966 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-09-19T09:10:23.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:22 smithi099 ceph-mon[35256]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:23.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:22 smithi099 ceph-mon[35256]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi046=x;smithi099=y;smithi115=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:23.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:22 smithi099 ceph-mon[35256]: Saving service mgr spec with placement smithi046=x;smithi099=y;smithi115=z;count:3 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 09:09:39.557844400 +0000 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 09:05:24.280892701 +0000 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 09:05:24.280892701 +0000 2024-09-19T09:10:23.023 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 09:05:24.280892701 +0000 2024-09-19T09:10:23.024 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:10:23.089 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-19T09:10:23.089 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-19T09:10:23.089 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000117514 s, 4.4 MB/s 2024-09-19T09:10:23.090 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:10:23.148 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T09:10:23.148 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:10:23.167 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:10:23.168 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-19T09:10:23.225 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 09:10:10.391079212 +0000 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 09:05:31.536590110 +0000 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 09:05:31.536590110 +0000 2024-09-19T09:10:23.226 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 09:05:31.536590110 +0000 2024-09-19T09:10:23.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:10:23.293 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T09:10:23.293 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T09:10:23.293 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000267215 s, 1.9 MB/s 2024-09-19T09:10:23.294 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:10:23.353 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 09:10:10.392079190 +0000 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 09:05:31.860582335 +0000 2024-09-19T09:10:23.411 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 09:05:31.860582335 +0000 2024-09-19T09:10:23.412 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 09:05:31.860582335 +0000 2024-09-19T09:10:23.412 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:10:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T09:10:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T09:10:23.478 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000226002 s, 2.3 MB/s 2024-09-19T09:10:23.479 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:10:23.537 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-19T09:10:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:10:23.594 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:23.594 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:10:23.594 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:23.594 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:23.595 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 09:10:10.392079190 +0000 2024-09-19T09:10:23.595 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 09:05:32.184574560 +0000 2024-09-19T09:10:23.595 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 09:05:32.184574560 +0000 2024-09-19T09:10:23.595 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 09:05:32.184574560 +0000 2024-09-19T09:10:23.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:10:23.659 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T09:10:23.660 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T09:10:23.660 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000245673 s, 2.1 MB/s 2024-09-19T09:10:23.661 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:10:23.719 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 09:10:10.392079190 +0000 2024-09-19T09:10:23.776 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 09:05:32.519566521 +0000 2024-09-19T09:10:23.777 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 09:05:32.519566521 +0000 2024-09-19T09:10:23.777 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 09:05:32.519566521 +0000 2024-09-19T09:10:23.777 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:10:23.841 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T09:10:23.841 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T09:10:23.841 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000245478 s, 2.1 MB/s 2024-09-19T09:10:23.842 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:10:23.899 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-19T09:10:23.899 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:10:23.908 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:23.909 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:23.909 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:23 smithi115 ceph-mon[35055]: Deploying daemon mgr.z on smithi115 2024-09-19T09:10:23.917 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:10:23.917 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-09-19T09:10:23.973 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-19 09:10:01.547103083 +0000 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-19 09:05:44.073418492 +0000 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-19 09:05:44.073418492 +0000 2024-09-19T09:10:23.974 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-19 09:05:44.073418492 +0000 2024-09-19T09:10:23.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:10:24.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:24.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:24.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:23 smithi099 ceph-mon[35256]: Deploying daemon mgr.z on smithi115 2024-09-19T09:10:24.160 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-19T09:10:24.160 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-19T09:10:24.161 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000267226 s, 1.9 MB/s 2024-09-19T09:10:24.162 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:10:24.180 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-09-19T09:10:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:24.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:24.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:10:24.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:24.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:24.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:23 smithi046 ceph-mon[31203]: Deploying daemon mgr.z on smithi115 2024-09-19T09:10:24.238 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:10:24.238 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:24.238 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:10:24.239 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:24.239 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:24.239 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-19 09:10:24.113691417 +0000 2024-09-19T09:10:24.239 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-19 09:05:44.397412205 +0000 2024-09-19T09:10:24.239 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-19 09:05:44.397412205 +0000 2024-09-19T09:10:24.239 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-19 09:05:44.397412205 +0000 2024-09-19T09:10:24.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:10:24.344 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-19T09:10:24.344 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-19T09:10:24.344 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000177392 s, 2.9 MB/s 2024-09-19T09:10:24.345 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:10:24.361 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-09-19T09:10:24.417 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:10:24.417 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:24.417 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T09:10:24.418 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:24.418 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:24.418 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-19 09:10:24.299688024 +0000 2024-09-19T09:10:24.418 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-19 09:05:44.714406056 +0000 2024-09-19T09:10:24.418 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-19 09:05:44.714406056 +0000 2024-09-19T09:10:24.418 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-19 09:05:44.714406056 +0000 2024-09-19T09:10:24.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:10:24.459 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 systemd[1]: Starting Ceph mgr.z for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:10:24.485 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-19T09:10:24.485 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-19T09:10:24.485 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000168088 s, 3.0 MB/s 2024-09-19T09:10:24.486 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:10:24.544 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-09-19T09:10:24.600 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:10:24.600 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:10:24.600 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T09:10:24.600 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:10:24.601 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:10:24.601 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-19 09:10:24.299688024 +0000 2024-09-19T09:10:24.601 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-19 09:05:45.034399891 +0000 2024-09-19T09:10:24.601 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-19 09:05:45.034399891 +0000 2024-09-19T09:10:24.601 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-19 09:05:45.034399891 +0000 2024-09-19T09:10:24.601 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:10:24.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-19T09:10:24.664 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-19T09:10:24.664 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000166033 s, 3.1 MB/s 2024-09-19T09:10:24.665 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:10:24.733 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 podman[36755]: 2024-09-19 09:10:24.478213682 +0000 UTC m=+0.015755270 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:24.734 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 podman[36755]: 2024-09-19 09:10:24.59380499 +0000 UTC m=+0.131346562 container create ba63900103e87c4a1f8d15699796bd8a820ce7049fd610c297e89026d71ed6a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:10:24.740 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2024-09-19T09:10:24.741 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:10:25.006 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:25.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:24 smithi099 ceph-mon[35256]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:25.023 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:24 smithi115 ceph-mon[35055]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:25.023 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 podman[36755]: 2024-09-19 09:10:24.837970175 +0000 UTC m=+0.375511756 container init ba63900103e87c4a1f8d15699796bd8a820ce7049fd610c297e89026d71ed6a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T09:10:25.023 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 podman[36755]: 2024-09-19 09:10:24.841292075 +0000 UTC m=+0.378833650 container start ba63900103e87c4a1f8d15699796bd8a820ce7049fd610c297e89026d71ed6a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:25.023 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 ceph-mgr[36864]: -- 172.21.15.115:0/1674524818 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c1909cb0e0 con 0x55c1909a8800 2024-09-19T09:10:25.023 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 bash[36755]: ba63900103e87c4a1f8d15699796bd8a820ce7049fd610c297e89026d71ed6a8 2024-09-19T09:10:25.024 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 systemd[1]: Started Ceph mgr.z for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:10:25.024 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:24.964+0000 7f1f5c358040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:10:25.024 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.022+0000 7f1f5c358040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:10:25.128 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:24 smithi046 ceph-mon[31203]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:25.379 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.169+0000 7f1f5c358040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:10:25.380 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.234+0000 7f1f5c358040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:10:25.380 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.378+0000 7f1f5c358040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:10:25.709 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.516+0000 7f1f5c358040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:10:26.209 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.826+0000 7f1f5c358040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:25.885+0000 7f1f5c358040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:26.068+0000 7f1f5c358040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:26.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:25 smithi115 ceph-mon[35055]: Deploying daemon mgr.y on smithi099 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:26.211 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:10:26.212 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:26.212 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:26.212 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:25 smithi099 ceph-mon[35256]: Deploying daemon mgr.y on smithi099 2024-09-19T09:10:26.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:26.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:26.225 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:26.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:10:26.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:26.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:26.226 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:25 smithi046 ceph-mon[31203]: Deploying daemon mgr.y on smithi099 2024-09-19T09:10:26.762 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:26 smithi099 systemd[1]: Starting Ceph mgr.y for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:10:27.148 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:26 smithi099 podman[36611]: 2024-09-19 09:10:26.870595544 +0000 UTC m=+0.097184878 container create 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:10:27.148 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:26 smithi099 podman[36611]: 2024-09-19 09:10:26.789297402 +0000 UTC m=+0.015886746 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:10:27.148 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 podman[36611]: 2024-09-19 09:10:27.089470725 +0000 UTC m=+0.316060059 container init 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:10:27.149 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 podman[36611]: 2024-09-19 09:10:27.092174647 +0000 UTC m=+0.318763982 container start 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:10:27.149 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-mgr[36630]: -- 172.21.15.99:0/2029489685 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de526390e0 con 0x55de52617400 2024-09-19T09:10:27.149 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 bash[36611]: 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 2024-09-19T09:10:27.209 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:26.940+0000 7f1f5c358040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:10:27.209 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:27.008+0000 7f1f5c358040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:10:27.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 systemd[1]: Started Ceph mgr.y for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:10:27.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:27.215+0000 7fea42d74040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:10:27.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:27.272+0000 7fea42d74040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:10:27.429 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:27.428+0000 7fea42d74040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:10:27.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:10:27.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-09-19T09:10:27.716 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:10:27.762 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:27.497+0000 7fea42d74040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:10:27.762 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:27.666+0000 7fea42d74040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:10:28.040 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:27.778+0000 7f1f5c358040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:10:28.040 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:27.894+0000 7f1f5c358040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:10:28.068 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:27.812+0000 7fea42d74040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 -- 172.21.15.46:0/1290721451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 msgr2=0x7f0b68104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 --2- 172.21.15.46:0/1290721451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b68104b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009900 tx=0x7f0b5802a410 comp rx=0 tx=0).stop 2024-09-19T09:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 -- 172.21.15.46:0/1290721451 shutdown_connections 2024-09-19T09:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 --2- 172.21.15.46:0/1290721451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b681079a0 0x7f0b68109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 --2- 172.21.15.46:0/1290721451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b68105070 0x7f0b68107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 --2- 172.21.15.46:0/1290721451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b68104b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 -- 172.21.15.46:0/1290721451 >> 172.21.15.46:0/1290721451 conn(0x7f0b680fc2a0 msgr2=0x7f0b680fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 -- 172.21.15.46:0/1290721451 shutdown_connections 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.175+0000 7f0b6e511640 1 -- 172.21.15.46:0/1290721451 wait complete. 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 Processor -- start 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 -- start start 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b681020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b68105070 0x7f0b681006f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b681079a0 0x7f0b68100c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6810d8c0 con 0x7f0b68102740 2024-09-19T09:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6810d740 con 0x7f0b68105070 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6e511640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6810da40 con 0x7f0b681079a0 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b67fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b681020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b67fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b681020a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36396/0 (socket says 172.21.15.46:36396) 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b67fff640 1 -- 172.21.15.46:0/576430322 learned_addr learned my addr 172.21.15.46:0/576430322 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b6caae640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b681079a0 0x7f0b68100c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.176+0000 7f0b677fe640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b68105070 0x7f0b681006f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b67fff640 1 -- 172.21.15.46:0/576430322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b681079a0 msgr2=0x7f0b68100c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b67fff640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b681079a0 0x7f0b68100c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b67fff640 1 -- 172.21.15.46:0/576430322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b68105070 msgr2=0x7f0b681006f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b67fff640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b68105070 0x7f0b681006f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:28.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b67fff640 1 -- 172.21.15.46:0/576430322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b681014f0 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b67fff640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b681020a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009230 tx=0x7f0b580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5803f030 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b58003ce0 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b681a20a0 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58035070 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.177+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b681a2550 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.178+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0b58042030 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.178+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b680fdd90 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.178+0000 7f0b657fa640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b500394d0 0x7f0b5003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.178+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0b5806cdf0 con 0x7f0b68102740 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.178+0000 7f0b677fe640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b500394d0 0x7f0b5003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:28.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.179+0000 7f0b677fe640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b500394d0 0x7f0b5003b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b68101e20 tx=0x7f0b5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:28.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.183+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b5803b540 con 0x7f0b68102740 2024-09-19T09:10:28.334 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.048+0000 7f1f5c358040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:10:28.334 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.110+0000 7f1f5c358040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:10:28.334 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.263+0000 7f1f5c358040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.333+0000 7f1f5c358040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-mon[35055]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:28.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:28.372+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0b68062630 con 0x7f0b500394d0 2024-09-19T09:10:28.372 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:28 smithi046 ceph-mon[31203]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:28.373 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.373 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.373 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.373 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.373 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:28.398 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:28.139+0000 7fea42d74040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:10:28.398 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:28.202+0000 7fea42d74040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:10:28.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-mon[35256]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:28.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:28.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:28.626 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.399+0000 7f1f5c358040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:10:28.627 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.560+0000 7f1f5c358040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:10:28.627 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.626+0000 7f1f5c358040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:10:28.762 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:28.397+0000 7fea42d74040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:10:28.893 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.693+0000 7f1f5c358040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:10:28.893 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.775+0000 7f1f5c358040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:10:28.893 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.834+0000 7f1f5c358040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:10:28.893 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:28.892+0000 7f1f5c358040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:10:29.431 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:29.431 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:29.432 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:29.433 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.433 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: Reconfiguring daemon mgr.x on smithi046 2024-09-19T09:10:29.433 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.512 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:29.287+0000 7fea42d74040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:10:29.512 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:29.354+0000 7fea42d74040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: Reconfiguring daemon mgr.x on smithi046 2024-09-19T09:10:29.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.679 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:29.679 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:10:29.679 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:10:29.679 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.679 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: Reconfiguring daemon mgr.x on smithi046 2024-09-19T09:10:29.680 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:29.959 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:10:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z[36842]: 2024-09-19T09:10:29.678+0000 7f1f5c358040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:10:30.325 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.069+0000 7fea42d74040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:10:30.325 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.184+0000 7fea42d74040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:10:30.325 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.324+0000 7fea42d74040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:10:30.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:30.443+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f0b5803a8e0 con 0x7f0b68102740 2024-09-19T09:10:30.606 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.384+0000 7fea42d74040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:10:30.606 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.537+0000 7fea42d74040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:10:30.606 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.605+0000 7fea42d74040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:10:30.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-mon[35256]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:30.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-mon[35256]: Standby manager daemon z started 2024-09-19T09:10:30.606 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:10:30.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:10:30.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:10:30.607 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:10:30.685 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:30 smithi046 ceph-mon[31203]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:30.686 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:30 smithi046 ceph-mon[31203]: Standby manager daemon z started 2024-09-19T09:10:30.686 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:30 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:10:30.686 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:30 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:10:30.686 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:30 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:10:30.686 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:30 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:10:30.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:30 smithi115 ceph-mon[35055]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:30.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:30 smithi115 ceph-mon[35055]: Standby manager daemon z started 2024-09-19T09:10:30.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:30 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:10:30.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:30 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:10:30.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:30 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:10:30.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:30 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.115:0/680346084' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:10:30.890 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.665+0000 7fea42d74040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:10:30.890 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.824+0000 7fea42d74040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:10:30.891 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.889+0000 7fea42d74040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:10:31.160 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:30.956+0000 7fea42d74040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:10:31.160 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:31.038+0000 7fea42d74040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:10:31.160 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:31.098+0000 7fea42d74040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:10:31.160 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:31.159+0000 7fea42d74040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:10:31.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-19T09:10:31.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:10:31.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:31.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:31.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:31.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:31.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:32.262 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:10:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y[36626]: 2024-09-19T09:10:31.956+0000 7fea42d74040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:10:32.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:32.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/607235503' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84984725-789b-44a1-be8f-fef0fb7b9f20"}]: dispatch 2024-09-19T09:10:32.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/607235503' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84984725-789b-44a1-be8f-fef0fb7b9f20"}]': finished 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: Standby manager daemon y started 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:10:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:32 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3699652238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/607235503' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84984725-789b-44a1-be8f-fef0fb7b9f20"}]: dispatch 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/607235503' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84984725-789b-44a1-be8f-fef0fb7b9f20"}]': finished 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: Standby manager daemon y started 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:10:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:10:32.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:32 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3699652238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:10:32.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:32.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/607235503' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "84984725-789b-44a1-be8f-fef0fb7b9f20"}]: dispatch 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/607235503' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "84984725-789b-44a1-be8f-fef0fb7b9f20"}]': finished 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: Standby manager daemon y started 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='mgr.? 172.21.15.99:0/126928164' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:10:32.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:32 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3699652238' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:10:32.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:32.767+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mon.0 v2:172.21.15.46:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f0b5803a3c0 con 0x7f0b68102740 2024-09-19T09:10:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:33 smithi115 ceph-mon[35055]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T09:10:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:10:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:33 smithi046 ceph-mon[31203]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T09:10:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:10:34.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:33 smithi099 ceph-mon[35256]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-19T09:10:34.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:10:35.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:34 smithi115 ceph-mon[35055]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:35.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:34 smithi046 ceph-mon[31203]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:34 smithi099 ceph-mon[35256]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:36.878 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:36 smithi046 ceph-mon[31203]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:37.030 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:36 smithi115 ceph-mon[35055]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:37.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:36 smithi099 ceph-mon[35256]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:38 smithi046 ceph-mon[31203]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:39.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:38 smithi115 ceph-mon[35055]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:39.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:38 smithi099 ceph-mon[35256]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:40 smithi046 ceph-mon[31203]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:10:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:41.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:40 smithi115 ceph-mon[35055]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:41.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:10:41.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:41.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:40 smithi099 ceph-mon[35256]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:41.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:10:41.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:41.937 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:41 smithi046 ceph-mon[31203]: Deploying daemon osd.0 on smithi046 2024-09-19T09:10:42.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:41 smithi115 ceph-mon[35055]: Deploying daemon osd.0 on smithi046 2024-09-19T09:10:42.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:41 smithi099 ceph-mon[35256]: Deploying daemon osd.0 on smithi046 2024-09-19T09:10:43.055 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:42 smithi046 ceph-mon[31203]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:43.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:42 smithi115 ceph-mon[35055]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:43.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:42 smithi099 ceph-mon[35256]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:45.075 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:44 smithi046 ceph-mon[31203]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:45.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:44 smithi115 ceph-mon[35055]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:44 smithi099 ceph-mon[35256]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:47.125 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:46 smithi046 ceph-mon[31203]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:47.126 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:47.126 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:47.126 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:47.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:46 smithi115 ceph-mon[35055]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:47.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:47.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:47.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:47.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:46 smithi099 ceph-mon[35256]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:47.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:47.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:47.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:49.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:48 smithi115 ceph-mon[35055]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:49.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:48 smithi046 ceph-mon[31203]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:49.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:48 smithi099 ceph-mon[35256]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:50.205 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:49 smithi046 ceph-mon[31203]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:50.205 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.205 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.205 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:50.205 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:50.205 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:49 smithi099 ceph-mon[35256]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:50.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:49 smithi115 ceph-mon[35055]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:50.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.494+0000 7f0b657fa640 1 -- 172.21.15.46:0/576430322 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0b68062630 con 0x7f0b500394d0 2024-09-19T09:10:50.495 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2024-09-19T09:10:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.496+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b500394d0 msgr2=0x7f0b5003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.496+0000 7f0b6e511640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b500394d0 0x7f0b5003b990 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b68101e20 tx=0x7f0b5c005f90 comp rx=0 tx=0).stop 2024-09-19T09:10:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.496+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 msgr2=0x7f0b681020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.496+0000 7f0b6e511640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b681020a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009230 tx=0x7f0b580042f0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 shutdown_connections 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b500394d0 0x7f0b5003b990 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b681079a0 0x7f0b68100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b68105070 0x7f0b681006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 --2- 172.21.15.46:0/576430322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b68102740 0x7f0b681020a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 >> 172.21.15.46:0/576430322 conn(0x7f0b680fc2a0 msgr2=0x7f0b68103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 shutdown_connections 2024-09-19T09:10:50.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:10:50.497+0000 7f0b6e511640 1 -- 172.21.15.46:0/576430322 wait complete. 2024-09-19T09:10:51.067 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:51.067 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:51.068 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:51.094 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T09:10:51.097 INFO:tasks.cephadm:Deploying osd.1 on smithi099 with /dev/vg_nvme/lv_4... 2024-09-19T09:10:51.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:10:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:51.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:51.335 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:10:51.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:10:51.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:51.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:52.643 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:52 smithi099 ceph-mon[35256]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:52.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:52 smithi115 ceph-mon[35055]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:52 smithi046 ceph-mon[31203]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:52.982 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:10:52 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0[45057]: 2024-09-19T09:10:52.531+0000 7f460d698640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:10:53.671 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:53 smithi099 ceph-mon[35256]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:10:53.674 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:10:53.700 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-09-19T09:10:53.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:53 smithi046 ceph-mon[31203]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:10:53.954 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:10:53.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:53 smithi115 ceph-mon[35055]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:10:54.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 -- 172.21.15.99:0/2407301347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 msgr2=0x7fefd4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2407301347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4103280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009900 tx=0x7fefc802a410 comp rx=0 tx=0).stop 2024-09-19T09:10:54.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 -- 172.21.15.99:0/2407301347 shutdown_connections 2024-09-19T09:10:54.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2407301347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd41037c0 0x7fefd410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2407301347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4103280 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2407301347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefd4101c00 0x7fefd4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 -- 172.21.15.99:0/2407301347 >> 172.21.15.99:0/2407301347 conn(0x7fefd40fd390 msgr2=0x7fefd40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 -- 172.21.15.99:0/2407301347 shutdown_connections 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.441+0000 7fefd9a75640 1 -- 172.21.15.99:0/2407301347 wait complete. 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.442+0000 7fefd9a75640 1 Processor -- start 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.442+0000 7fefd9a75640 1 -- start start 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101c00 0x7fefd4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefd41037c0 0x7fefd419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fefd410d880 con 0x7fefd4101c00 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fefd410d700 con 0x7fefd4102e00 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fefd410da00 con 0x7fefd41037c0 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34286/0 (socket says 172.21.15.99:34286) 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101c00 0x7fefd4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 -- 172.21.15.99:0/2723600250 learned_addr learned my addr 172.21.15.99:0/2723600250 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd3fff640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefd41037c0 0x7fefd419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 -- 172.21.15.99:0/2723600250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefd41037c0 msgr2=0x7fefd419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefd41037c0 0x7fefd419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 -- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101c00 msgr2=0x7fefd4197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101c00 0x7fefd4197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 -- 172.21.15.99:0/2723600250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd419faf0 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd37fe640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101c00 0x7fefd4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd2ffd640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4198400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009230 tx=0x7fefc8031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc803f030 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefc8003ad0 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd4074420 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc8035070 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.443+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd4074900 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.444+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd4108fa0 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.445+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fefc8042030 con 0x7fefd4102e00 2024-09-19T09:10:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.446+0000 7fefd0ff9640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fefbc0a31e0 0x7fefbc0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:10:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.446+0000 7fefd37fe640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fefbc0a31e0 0x7fefbc0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:10:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.447+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7fefc80ee170 con 0x7fefd4102e00 2024-09-19T09:10:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.447+0000 7fefd37fe640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fefbc0a31e0 0x7fefbc0a56a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefc4005fd0 tx=0x7fefc400f7a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:10:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.451+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefc80bc440 con 0x7fefd4102e00 2024-09-19T09:10:54.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:10:54.626+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fefd4075d50 con 0x7fefbc0a31e0 2024-09-19T09:10:54.627 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:54.628 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:54.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:10:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:10:54.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:10:54.982 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0[45057]: 2024-09-19T09:10:54.507+0000 7f460961b640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:10:54.982 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:10:54 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0[45057]: 2024-09-19T09:10:54.511+0000 7f4605443640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:10:55.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi046 2024-09-19T09:10:55.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-19T09:10:55.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:10:55.647 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:55.648 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi046 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:55.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi046 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi046 to 17092M 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:10:55.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:10:55.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:10:55.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:10:55.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:56.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:56 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:10:56.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:56 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:10:56.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:56 smithi115 ceph-mon[35055]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:56.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:56 smithi115 ceph-mon[35055]: osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] boot 2024-09-19T09:10:56.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:56 smithi115 ceph-mon[35055]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:10:56.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:56 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:56.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:56 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:10:56.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:56 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:10:56.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:56 smithi046 ceph-mon[31203]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:56.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:56 smithi046 ceph-mon[31203]: osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] boot 2024-09-19T09:10:56.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:56 smithi046 ceph-mon[31203]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:10:56.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:56 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:56 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:10:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:56 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:10:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:56 smithi099 ceph-mon[35256]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:10:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:56 smithi099 ceph-mon[35256]: osd.0 [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] boot 2024-09-19T09:10:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:56 smithi099 ceph-mon[35256]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:10:57.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:56 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/2618662319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]: dispatch 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]: dispatch 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]': finished 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:10:57.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:57 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/1544213839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:10:57.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:10:57.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/2618662319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]: dispatch 2024-09-19T09:10:57.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]: dispatch 2024-09-19T09:10:57.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]': finished 2024-09-19T09:10:57.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:10:57.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:10:57.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:57 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/1544213839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:10:57.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:10:57.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/2618662319' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]: dispatch 2024-09-19T09:10:57.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]: dispatch 2024-09-19T09:10:57.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1fce610-b700-449a-8d05-4f83c4db271b"}]': finished 2024-09-19T09:10:57.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:10:57.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:10:57.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:57 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/1544213839' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:10:59.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:10:58 smithi115 ceph-mon[35055]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:10:59.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:10:58 smithi046 ceph-mon[31203]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:10:59.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:10:58 smithi099 ceph-mon[35256]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:01.128 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:00 smithi099 ceph-mon[35256]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:01.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:00 smithi115 ceph-mon[35055]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:01.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:00 smithi046 ceph-mon[31203]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:03.204 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:02 smithi099 ceph-mon[35256]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:03.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:02 smithi115 ceph-mon[35055]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:03.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:02 smithi046 ceph-mon[31203]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:04.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:03 smithi099 ceph-mon[35256]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:04.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:03 smithi115 ceph-mon[35055]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:04.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:03 smithi046 ceph-mon[31203]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:05.172 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:11:05.173 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:05.173 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:04 smithi099 ceph-mon[35256]: Deploying daemon osd.1 on smithi099 2024-09-19T09:11:05.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:11:05.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:05.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:04 smithi115 ceph-mon[35055]: Deploying daemon osd.1 on smithi099 2024-09-19T09:11:05.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:11:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:04 smithi046 ceph-mon[31203]: Deploying daemon osd.1 on smithi099 2024-09-19T09:11:06.160 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:05 smithi099 ceph-mon[35256]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:06.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:05 smithi115 ceph-mon[35055]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:06.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:05 smithi046 ceph-mon[31203]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:08.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:07 smithi115 ceph-mon[35055]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:08.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:07 smithi046 ceph-mon[31203]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:08.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:07 smithi099 ceph-mon[35256]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:10.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:09 smithi115 ceph-mon[35055]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:10.218 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:09 smithi099 ceph-mon[35256]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:10.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:09 smithi046 ceph-mon[31203]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:11.200 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:11.200 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:11.200 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:13.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:12 smithi099 ceph-mon[35256]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:13.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:12 smithi115 ceph-mon[35055]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:13.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:12 smithi046 ceph-mon[31203]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:14.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:14 smithi115 ceph-mon[35055]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:14.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:14.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:14.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:14 smithi046 ceph-mon[31203]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.495 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:14 smithi099 ceph-mon[35256]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:14.495 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.496 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.496 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:14.496 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:14.496 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:14.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.787+0000 7fefd0ff9640 1 -- 172.21.15.99:0/2723600250 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fefd4075d50 con 0x7fefbc0a31e0 2024-09-19T09:11:14.788 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 1 on host 'smithi099' 2024-09-19T09:11:14.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fefbc0a31e0 msgr2=0x7fefbc0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:14.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fefbc0a31e0 0x7fefbc0a56a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefc4005fd0 tx=0x7fefc400f7a0 comp rx=0 tx=0).stop 2024-09-19T09:11:14.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 msgr2=0x7fefd4198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:14.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4198400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009230 tx=0x7fefc8031b60 comp rx=0 tx=0).stop 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 shutdown_connections 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fefbc0a31e0 0x7fefbc0a56a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fefd41037c0 0x7fefd419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fefd4102e00 0x7fefd4198400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 --2- 172.21.15.99:0/2723600250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fefd4101c00 0x7fefd4197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.789+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 >> 172.21.15.99:0/2723600250 conn(0x7fefd40fd390 msgr2=0x7fefd4106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.790+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 shutdown_connections 2024-09-19T09:11:14.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:11:14.790+0000 7fefd9a75640 1 -- 172.21.15.99:0/2723600250 wait complete. 2024-09-19T09:11:15.335 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:15.335 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:15.335 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:15.364 DEBUG:teuthology.orchestra.run.smithi099:osd.1> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T09:11:15.366 INFO:tasks.cephadm:Deploying osd.2 on smithi115 with /dev/vg_nvme/lv_4... 2024-09-19T09:11:15.366 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:11:15.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:15.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:15.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:15.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:15.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:15.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:15.615 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:11:16.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:16 smithi115 ceph-mon[35055]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:17.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:16 smithi099 ceph-mon[35256]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:17.013 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1[39734]: 2024-09-19T09:11:16.811+0000 7f00c14a2640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:11:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:16 smithi046 ceph-mon[31203]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:17.806 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:11:17.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_4 2024-09-19T09:11:17.857 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:17 smithi099 ceph-mon[35256]: from='osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:11:17.857 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:17 smithi099 ceph-mon[35256]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:11:18.072 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:11:18.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:17 smithi115 ceph-mon[35055]: from='osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:11:18.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:17 smithi115 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:11:18.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:17 smithi046 ceph-mon[31203]: from='osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:11:18.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:17 smithi046 ceph-mon[31203]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:11:18.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 -- 172.21.15.115:0/2811207362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc1026d0 msgr2=0x7fd9fc108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:18.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 --2- 172.21.15.115:0/2811207362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc1026d0 0x7fd9fc108f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009ca0 tx=0x7fd9f402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:11:18.515 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 -- 172.21.15.115:0/2811207362 shutdown_connections 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 --2- 172.21.15.115:0/2811207362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc1026d0 0x7fd9fc108f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 --2- 172.21.15.115:0/2811207362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc101d10 0x7fd9fc102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 --2- 172.21.15.115:0/2811207362 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9fc100b10 0x7fd9fc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 -- 172.21.15.115:0/2811207362 >> 172.21.15.115:0/2811207362 conn(0x7fd9fc0fc2a0 msgr2=0x7fd9fc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 -- 172.21.15.115:0/2811207362 shutdown_connections 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.506+0000 7fda028da640 1 -- 172.21.15.115:0/2811207362 wait complete. 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 Processor -- start 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 -- start start 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 0x7fd9fc196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:18.516 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc101d10 0x7fd9fc197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9fc1026d0 0x7fd9fc19e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc10c7f0 con 0x7fd9fc1026d0 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc10c670 con 0x7fd9fc101d10 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda028da640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd9fc10c970 con 0x7fd9fc100b10 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 0x7fd9fc196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 0x7fd9fc196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:41092/0 (socket says 172.21.15.115:41092) 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 -- 172.21.15.115:0/2693467290 learned_addr learned my addr 172.21.15.115:0/2693467290 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fda00e77640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9fc1026d0 0x7fd9fc19e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 -- 172.21.15.115:0/2693467290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc101d10 msgr2=0x7fd9fc197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc101d10 0x7fd9fc197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:18.517 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 -- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9fc1026d0 msgr2=0x7fd9fc19e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9fc1026d0 0x7fd9fc19e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.507+0000 7fd9fbfff640 1 -- 172.21.15.115:0/2693467290 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9fc19ea40 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.508+0000 7fd9fbfff640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 0x7fd9fc196e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c970 tx=0x7fd9ec00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.508+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec004220 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.508+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9ec0043c0 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.508+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9fc19ed30 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.508+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00f450 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.508+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9fc19f290 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.509+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9fc107f10 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.510+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fd9ec0079b0 con 0x7fd9fc100b10 2024-09-19T09:11:18.518 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.511+0000 7fd9f97fa640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd9e40a31e0 0x7fd9e40a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.511+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7fd9ec0cdcd0 con 0x7fd9fc100b10 2024-09-19T09:11:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.511+0000 7fd9fb7fe640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd9e40a31e0 0x7fd9e40a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.512+0000 7fd9fb7fe640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd9e40a31e0 0x7fd9e40a56a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc198330 tx=0x7fd9f0006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:18.519 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.515+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9ec014030 con 0x7fd9fc100b10 2024-09-19T09:11:18.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:18.689+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd9fc062630 con 0x7fd9e40a31e0 2024-09-19T09:11:19.092 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:19.092 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:11:19.092 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:11:19.092 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:19.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:11:19.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:11:19.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:11:19.093 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:19.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:19.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:11:19.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:11:19.094 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:19.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:19.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:11:19.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:19.262 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1[39734]: 2024-09-19T09:11:18.800+0000 7f00bd425640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:11:19.263 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1[39734]: 2024-09-19T09:11:18.804+0000 7f00b924d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:11:19.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:19.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:11:19.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:19.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:19.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:19.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:11:19.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:11:19.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:20.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi099 2024-09-19T09:11:20.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi099 to 17088M 2024-09-19T09:11:20.136 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:20.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:11:20.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:11:20.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:20.137 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:20.154 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi099 2024-09-19T09:11:20.154 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi099 to 17088M 2024-09-19T09:11:20.154 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:20.154 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:11:20.155 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:11:20.155 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:20.155 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:20.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi099 2024-09-19T09:11:20.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi099 to 17088M 2024-09-19T09:11:20.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: from='client.24151 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:20.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:11:20.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:11:20.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:20.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] boot 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:11:21.141 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] boot 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:11:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:21.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:11:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:11:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:11:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: osd.1 [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] boot 2024-09-19T09:11:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:11:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:11:22.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:11:22.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/3286469633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]: dispatch 2024-09-19T09:11:22.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]: dispatch 2024-09-19T09:11:22.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]': finished 2024-09-19T09:11:22.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:11:22.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:22.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:21 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/687378004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/3286469633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]: dispatch 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]: dispatch 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]': finished 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:21 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/687378004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:11:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T09:11:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/3286469633' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]: dispatch 2024-09-19T09:11:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]: dispatch 2024-09-19T09:11:22.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "61ebc0bf-183f-43b4-85c4-c891cda4dc2e"}]': finished 2024-09-19T09:11:22.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:11:22.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:22.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:21 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/687378004' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:11:23.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:22 smithi115 ceph-mon[35055]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:23.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:22 smithi046 ceph-mon[31203]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:22 smithi099 ceph-mon[35256]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:25.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:24 smithi115 ceph-mon[35055]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:25.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:24 smithi046 ceph-mon[31203]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:25.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:24 smithi099 ceph-mon[35256]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:26.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:26 smithi115 ceph-mon[35055]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:27.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:26 smithi046 ceph-mon[31203]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:27.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:26 smithi099 ceph-mon[35256]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:29.006 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:28 smithi115 ceph-mon[35055]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:29.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:28 smithi046 ceph-mon[31203]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:29.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:28 smithi099 ceph-mon[35256]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:11:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:30.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:11:30.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:30.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:11:30.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:30.943 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:30 smithi115 ceph-mon[35055]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:30.943 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:30 smithi115 ceph-mon[35055]: Deploying daemon osd.2 on smithi115 2024-09-19T09:11:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:30 smithi046 ceph-mon[31203]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:30 smithi046 ceph-mon[31203]: Deploying daemon osd.2 on smithi115 2024-09-19T09:11:31.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:30 smithi099 ceph-mon[35256]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:31.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:30 smithi099 ceph-mon[35256]: Deploying daemon osd.2 on smithi115 2024-09-19T09:11:32.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:32 smithi115 ceph-mon[35055]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:32 smithi046 ceph-mon[31203]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:33.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:32 smithi099 ceph-mon[35256]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:35.057 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:34 smithi115 ceph-mon[35055]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:34 smithi046 ceph-mon[31203]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:34 smithi099 ceph-mon[35256]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:36.066 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.066 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:36.066 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:36.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:36 smithi115 ceph-mon[35055]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:37.163 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:36 smithi099 ceph-mon[35256]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:37.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:36 smithi046 ceph-mon[31203]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:39.137 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:38 smithi115 ceph-mon[35055]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:39.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:38 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:38 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:38 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:39.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:38 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:39.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:38 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.177 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 2 on host 'smithi115' 2024-09-19T09:11:39.178 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.176+0000 7fd9f97fa640 1 -- 172.21.15.115:0/2693467290 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd9fc062630 con 0x7fd9e40a31e0 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd9e40a31e0 msgr2=0x7fd9e40a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd9e40a31e0 0x7fd9e40a56a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc198330 tx=0x7fd9f0006c90 comp rx=0 tx=0).stop 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 msgr2=0x7fd9fc196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 0x7fd9fc196e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c970 tx=0x7fd9ec00ce30 comp rx=0 tx=0).stop 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 shutdown_connections 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd9e40a31e0 0x7fd9e40a56a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9fc1026d0 0x7fd9fc19e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9fc101d10 0x7fd9fc197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 --2- 172.21.15.115:0/2693467290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9fc100b10 0x7fd9fc196e10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 >> 172.21.15.115:0/2693467290 conn(0x7fd9fc0fc2a0 msgr2=0x7fd9fc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:39.180 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 shutdown_connections 2024-09-19T09:11:39.181 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:11:39.179+0000 7fda028da640 1 -- 172.21.15.115:0/2693467290 wait complete. 2024-09-19T09:11:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:38 smithi046 ceph-mon[31203]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:38 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:38 smithi099 ceph-mon[35256]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:38 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:38 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:38 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:38 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:38 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:39.862 DEBUG:teuthology.orchestra.run.smithi115:osd.2> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T09:11:39.864 INFO:tasks.cephadm:Deploying osd.3 on smithi046 with /dev/vg_nvme/lv_3... 2024-09-19T09:11:39.865 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:11:40.097 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:39 smithi115 ceph-mon[35055]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:40.098 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:40.098 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:40.098 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:40.130 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:39 smithi046 ceph-mon[31203]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:40.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:39 smithi099 ceph-mon[35256]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:40.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:11:40.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:40.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:41.710 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2[40024]: 2024-09-19T09:11:41.359+0000 7f5932ebd640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:11:42.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:41 smithi046 ceph-mon[31203]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:42.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:41 smithi046 ceph-mon[31203]: from='osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:11:42.112 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:41 smithi046 ceph-mon[31203]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:11:42.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:41 smithi115 ceph-mon[35055]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:42.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:41 smithi115 ceph-mon[35055]: from='osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:11:42.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:41 smithi115 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:11:42.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:41 smithi099 ceph-mon[35256]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:42.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:41 smithi099 ceph-mon[35256]: from='osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:11:42.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:41 smithi099 ceph-mon[35256]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:11:42.807 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:11:42.834 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-09-19T09:11:43.096 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi115 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.218 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:11:43.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-19T09:11:43.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:43.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:43.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi115 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:11:43.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-19T09:11:43.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:43.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:43.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.459 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2[40024]: 2024-09-19T09:11:42.960+0000 7f592ee40640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:11:43.460 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2[40024]: 2024-09-19T09:11:42.969+0000 7f592ac68640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi115 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:11:43.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-19T09:11:43.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:43.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:11:43.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:43.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 -- 172.21.15.46:0/2488294644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c102e00 msgr2=0x7f6c7c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:43.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 --2- 172.21.15.46:0/2488294644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c102e00 0x7f6c7c103280 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009900 tx=0x7f6c7802a410 comp rx=0 tx=0).stop 2024-09-19T09:11:43.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 -- 172.21.15.46:0/2488294644 shutdown_connections 2024-09-19T09:11:43.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 --2- 172.21.15.46:0/2488294644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c102e00 0x7f6c7c103280 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:43.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 --2- 172.21.15.46:0/2488294644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c1037c0 0x7f6c7c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:43.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 --2- 172.21.15.46:0/2488294644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c7c101c00 0x7f6c7c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 -- 172.21.15.46:0/2488294644 >> 172.21.15.46:0/2488294644 conn(0x7f6c7c0fd390 msgr2=0x7f6c7c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 -- 172.21.15.46:0/2488294644 shutdown_connections 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.550+0000 7f6c846a3640 1 -- 172.21.15.46:0/2488294644 wait complete. 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 Processor -- start 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 -- start start 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 0x7f6c7c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c102e00 0x7f6c7c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c7c1037c0 0x7f6c7c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c10d860 con 0x7f6c7c101c00 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c10d6e0 con 0x7f6c7c102e00 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c846a3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c10d9e0 con 0x7f6c7c1037c0 2024-09-19T09:11:43.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 0x7f6c7c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 0x7f6c7c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42788/0 (socket says 172.21.15.46:42788) 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 -- 172.21.15.46:0/1054280224 learned_addr learned my addr 172.21.15.46:0/1054280224 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c81c3e640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c102e00 0x7f6c7c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c82c40640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c7c1037c0 0x7f6c7c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 -- 172.21.15.46:0/1054280224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c7c1037c0 msgr2=0x7f6c7c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c7c1037c0 0x7f6c7c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 -- 172.21.15.46:0/1054280224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c102e00 msgr2=0x7f6c7c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c102e00 0x7f6c7c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c8243f640 1 -- 172.21.15.46:0/1054280224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c19fb00 con 0x7f6c7c101c00 2024-09-19T09:11:43.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.551+0000 7f6c81c3e640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c102e00 0x7f6c7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.552+0000 7f6c8243f640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 0x7f6c7c197ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00d770 tx=0x7f6c6c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.552+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c017070 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.552+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c6c009c30 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.552+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c19fdf0 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.552+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c003dd0 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.552+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1a0250 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.553+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c1090a0 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.554+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f6c6c003fb0 con 0x7f6c7c101c00 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.555+0000 7f6c737fe640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c680a3260 0x7f6c680a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.555+0000 7f6c81c3e640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c680a3260 0x7f6c680a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:11:43.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.555+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f6c6c0cdfa0 con 0x7f6c7c101c00 2024-09-19T09:11:43.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.555+0000 7f6c81c3e640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c680a3260 0x7f6c680a5720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c78000c00 tx=0x7f6c780095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:11:43.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.558+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c6c009de0 con 0x7f6c7c101c00 2024-09-19T09:11:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:43.745+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6c7c062630 con 0x7f6c680a3260 2024-09-19T09:11:44.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:11:44.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:43 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:44.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:11:44.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:43 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:11:44.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:43 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:45.650 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:45 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:11:45.650 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:45 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:11:45.651 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:45 smithi046 ceph-mon[31203]: osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] boot 2024-09-19T09:11:45.651 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:45 smithi046 ceph-mon[31203]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:11:45.651 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:45 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:45.651 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:45 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:11:45.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:45 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:11:45.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:45 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:11:45.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:45 smithi115 ceph-mon[35055]: osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] boot 2024-09-19T09:11:45.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:45 smithi115 ceph-mon[35055]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:11:45.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:45 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:45.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:45 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:11:45.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:45 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:11:45.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:45 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:11:45.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:45 smithi099 ceph-mon[35256]: osd.2 [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] boot 2024-09-19T09:11:45.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:45 smithi099 ceph-mon[35256]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:11:45.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:45 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:11:45.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:45 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/285950301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f304e-8b1b-4ca4-9eea-b0948e997f0e"}]: dispatch 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:11:46.704 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/285950301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908f304e-8b1b-4ca4-9eea-b0948e997f0e"}]': finished 2024-09-19T09:11:46.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:11:46.705 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:46 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:11:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:11:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:11:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:11:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/285950301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f304e-8b1b-4ca4-9eea-b0948e997f0e"}]: dispatch 2024-09-19T09:11:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:11:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/285950301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908f304e-8b1b-4ca4-9eea-b0948e997f0e"}]': finished 2024-09-19T09:11:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:11:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:46 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:11:46.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/285950301' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "908f304e-8b1b-4ca4-9eea-b0948e997f0e"}]: dispatch 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/285950301' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "908f304e-8b1b-4ca4-9eea-b0948e997f0e"}]': finished 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:11:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:46 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:11:46.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:46 smithi046 sudo[49484]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:11:46.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:46 smithi046 sudo[49484]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:46.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:46 smithi046 sudo[49484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:46.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:46 smithi046 sudo[49484]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:47.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:11:47.395+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6c6c098360 con 0x7f6c7c101c00 2024-09-19T09:11:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:47 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1221434782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:11:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:47 smithi046 ceph-mon[31203]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:11:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:47 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:11:47.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:47 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:47.481 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:47 smithi046 sudo[49533]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:11:47.481 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:47 smithi046 sudo[49533]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:47.481 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:47 smithi046 sudo[49533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:47.482 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:11:47 smithi046 sudo[49533]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:47.698 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:47 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1221434782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:11:47.698 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:47 smithi099 ceph-mon[35256]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:11:47.698 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:47 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:11:47.698 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:47 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:47.698 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43837]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:11:47.699 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43837]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:47.699 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:47.699 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43837]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:47.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:47 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1221434782' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:11:47.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:47 smithi115 ceph-mon[35055]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:11:47.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:47 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:11:47.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:47 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:48.012 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43840]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:11:48.012 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43840]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:48.012 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:48.012 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:11:47 smithi099 sudo[43840]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:48.228 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:47 smithi115 sudo[43652]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:11:48.228 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:47 smithi115 sudo[43652]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:48.228 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:47 smithi115 sudo[43652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:48.228 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:47 smithi115 sudo[43652]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:48.709 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:48 smithi115 sudo[43655]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:11:48.710 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:48 smithi115 sudo[43655]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:48.710 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:48 smithi115 sudo[43655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:48.710 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:11:48 smithi115 sudo[43655]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:48 smithi046 sudo[50101]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:11:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:48 smithi046 sudo[50101]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:48 smithi046 sudo[50101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:48 smithi046 sudo[50101]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:49.424 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 ceph-mon[35055]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:49.424 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 ceph-mon[35055]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:11:49.424 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:49.424 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:49.424 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:49.424 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43658]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:11:49.425 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43658]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:49.425 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:49.425 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43658]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 sudo[50287]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 sudo[50287]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 sudo[50287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 sudo[50287]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 ceph-mon[31203]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 ceph-mon[31203]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:49.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:49 smithi046 ceph-mon[31203]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:49.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 ceph-mon[35256]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:49.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 ceph-mon[35256]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:11:49.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:49.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:11:49.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 ceph-mon[35256]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:49.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:11:49.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:49.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:49.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:49 smithi115 sudo[43661]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:50.166 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 sudo[43843]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:11:50.166 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 sudo[43843]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:50.166 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 sudo[43843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:50.166 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:49 smithi099 sudo[43843]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:50.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:50.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 sudo[43846]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 sudo[43846]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 sudo[43846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 sudo[43846]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:50.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:50.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:11:50.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:11:50.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:11:51.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:51 smithi046 ceph-mon[31203]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:51.234 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:51 smithi046 ceph-mon[31203]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:51.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:51 smithi115 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:51.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:51 smithi115 ceph-mon[35055]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:51.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:51 smithi099 ceph-mon[35256]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:11:51.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:51 smithi099 ceph-mon[35256]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:11:52.262 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:52 smithi046 ceph-mon[31203]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:52.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:52 smithi115 ceph-mon[35055]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:52.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:52 smithi099 ceph-mon[35256]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:54.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:54 smithi115 ceph-mon[35055]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:54.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:11:54.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:54.471 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:54 smithi046 ceph-mon[31203]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:54.471 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:11:54.471 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:54.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:54 smithi099 ceph-mon[35256]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:54.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:11:54.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:11:55.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:55 smithi115 ceph-mon[35055]: Deploying daemon osd.3 on smithi046 2024-09-19T09:11:55.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:55 smithi046 ceph-mon[31203]: Deploying daemon osd.3 on smithi046 2024-09-19T09:11:55.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:55 smithi099 ceph-mon[35256]: Deploying daemon osd.3 on smithi046 2024-09-19T09:11:56.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:56 smithi115 ceph-mon[35055]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:56.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:56 smithi046 ceph-mon[31203]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:56.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:56 smithi099 ceph-mon[35256]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:58.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:11:58 smithi115 ceph-mon[35055]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:58.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:11:58 smithi046 ceph-mon[31203]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:11:58.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:11:58 smithi099 ceph-mon[35256]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:00.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:00 smithi115 ceph-mon[35055]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:00.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:00 smithi046 ceph-mon[31203]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:00.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:00 smithi099 ceph-mon[35256]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:01.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:01 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:01.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:01 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:01.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:01 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:01.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:01 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:01.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:01 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:01.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:01 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:01.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:01 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:01.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:01 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:01.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:01 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:02.515 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:02 smithi046 ceph-mon[31203]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:02.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:02 smithi115 ceph-mon[35055]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:02.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:02 smithi099 ceph-mon[35256]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:03.828 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:03.828 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:03.828 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:03.828 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:03.828 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:03.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.167+0000 7f6c737fe640 1 -- 172.21.15.46:0/1054280224 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6c7c062630 con 0x7f6c680a3260 2024-09-19T09:12:04.168 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 3 on host 'smithi046' 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c680a3260 msgr2=0x7f6c680a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c680a3260 0x7f6c680a5720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c78000c00 tx=0x7f6c780095f0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 msgr2=0x7f6c7c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 0x7f6c7c197ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00d770 tx=0x7f6c6c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 shutdown_connections 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c680a3260 0x7f6c680a5720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c7c1037c0 0x7f6c7c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c7c102e00 0x7f6c7c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 --2- 172.21.15.46:0/1054280224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c7c101c00 0x7f6c7c197ed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.169+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 >> 172.21.15.46:0/1054280224 conn(0x7f6c7c0fd390 msgr2=0x7f6c7c106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.170+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 shutdown_connections 2024-09-19T09:12:04.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:04.170+0000 7f6c846a3640 1 -- 172.21.15.46:0/1054280224 wait complete. 2024-09-19T09:12:04.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:04 smithi046 ceph-mon[31203]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:04.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:04.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.785 DEBUG:teuthology.orchestra.run.smithi046:osd.3> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T09:12:04.787 INFO:tasks.cephadm:Deploying osd.4 on smithi099 with /dev/vg_nvme/lv_3... 2024-09-19T09:12:04.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:12:04.815 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:04 smithi099 ceph-mon[35256]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:04.815 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:04.816 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.816 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:04 smithi115 ceph-mon[35055]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:04.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:04.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:04.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:12:05.932 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:12:05 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:12:05.660+0000 7f551ffd6640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:12:06.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:06 smithi099 ceph-mon[35256]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:06.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:06 smithi099 ceph-mon[35256]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:12:06.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:06 smithi115 ceph-mon[35055]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:06.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:06 smithi115 ceph-mon[35055]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:12:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:06 smithi046 ceph-mon[31203]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:06 smithi046 ceph-mon[31203]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:12:07.649 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:07 smithi099 ceph-mon[35256]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:12:07.649 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:07 smithi099 ceph-mon[35256]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:12:07.649 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:07 smithi099 ceph-mon[35256]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:12:07.649 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:07 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:07.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:12:07.679 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-09-19T09:12:07.699 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:07 smithi046 ceph-mon[31203]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:12:07.700 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:07 smithi046 ceph-mon[31203]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:12:07.700 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:07 smithi046 ceph-mon[31203]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:12:07.700 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:07 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:07.700 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:12:07 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:12:07.570+0000 7f551bf59640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:12:07.700 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:12:07 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:12:07.575+0000 7f5517d81640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:12:07.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:07 smithi115 ceph-mon[35055]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:12:07.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:07 smithi115 ceph-mon[35055]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:12:07.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:07 smithi115 ceph-mon[35055]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:12:07.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:07 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:07.973 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 -- 172.21.15.99:0/2307887959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 msgr2=0x7f5b2c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 --2- 172.21.15.99:0/2307887959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c103280 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009900 tx=0x7f5b2002a410 comp rx=0 tx=0).stop 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 -- 172.21.15.99:0/2307887959 shutdown_connections 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 --2- 172.21.15.99:0/2307887959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 0x7f5b2c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 --2- 172.21.15.99:0/2307887959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c103280 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 --2- 172.21.15.99:0/2307887959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b2c101c00 0x7f5b2c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 -- 172.21.15.99:0/2307887959 >> 172.21.15.99:0/2307887959 conn(0x7f5b2c0fd390 msgr2=0x7f5b2c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 -- 172.21.15.99:0/2307887959 shutdown_connections 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.489+0000 7f5b326c2640 1 -- 172.21.15.99:0/2307887959 wait complete. 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 Processor -- start 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 -- start start 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b2c101c00 0x7f5b2c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 0x7f5b2c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10d880 con 0x7f5b2c101c00 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10d700 con 0x7f5b2c102e00 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b326c2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c10da00 con 0x7f5b2c1037c0 2024-09-19T09:12:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b2b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b2b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35972/0 (socket says 172.21.15.99:35972) 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b2b7fe640 1 -- 172.21.15.99:0/3255913351 learned_addr learned my addr 172.21.15.99:0/3255913351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.490+0000 7f5b2bfff640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b2c101c00 0x7f5b2c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b30c5f640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 0x7f5b2c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b2b7fe640 1 -- 172.21.15.99:0/3255913351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 msgr2=0x7f5b2c19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b2b7fe640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 0x7f5b2c19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b2b7fe640 1 -- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b2c101c00 msgr2=0x7f5b2c197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b2b7fe640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b2c101c00 0x7f5b2c197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b2b7fe640 1 -- 172.21.15.99:0/3255913351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c19fae0 con 0x7f5b2c102e00 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b30c5f640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 0x7f5b2c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:12:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b2b7fe640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c1983f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009230 tx=0x7f5b20004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2003f030 con 0x7f5b2c102e00 2024-09-19T09:12:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c19fd70 con 0x7f5b2c102e00 2024-09-19T09:12:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b20003ce0 con 0x7f5b2c102e00 2024-09-19T09:12:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b20035070 con 0x7f5b2c102e00 2024-09-19T09:12:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.491+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c1a01f0 con 0x7f5b2c102e00 2024-09-19T09:12:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.492+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2c109050 con 0x7f5b2c102e00 2024-09-19T09:12:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.493+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5b20042030 con 0x7f5b2c102e00 2024-09-19T09:12:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.494+0000 7f5b297fa640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5b140a3270 0x7f5b140a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.494+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3702+0+0 (secure 0 0 0) 0x7f5b200eed40 con 0x7f5b2c102e00 2024-09-19T09:12:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.494+0000 7f5b2bfff640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5b140a3270 0x7f5b140a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.495+0000 7f5b2bfff640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5b140a3270 0x7f5b140a5730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c102c60 tx=0x7f5b1c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.498+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b200bcc60 con 0x7f5b2c102e00 2024-09-19T09:12:08.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:08.672+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5b2c062630 con 0x7f5b140a3270 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi046 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.674 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:08.675 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:08.675 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.675 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] boot 2024-09-19T09:12:08.675 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T09:12:08.675 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.861 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:08.861 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:12:08.861 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi046 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-19T09:12:08.862 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.863 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:08.863 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:08.863 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.863 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] boot 2024-09-19T09:12:08.863 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T09:12:08.863 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi046 2024-09-19T09:12:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi046 to 8546M 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: osd.3 [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] boot 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T09:12:08.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:12:09.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:12:09.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:12:09.735 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:09.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:12:09.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:12:09.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:09.736 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:09 smithi099 ceph-mon[35256]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:12:09.825 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:12:09.825 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:12:09.825 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:09.825 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:12:09.825 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:12:09.825 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:09.826 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:09 smithi046 ceph-mon[31203]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:09.873 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:09 smithi115 ceph-mon[35055]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:12:10.709 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:10 smithi099 ceph-mon[35256]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:10.709 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:10 smithi099 ceph-mon[35256]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:12:10.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:10 smithi046 ceph-mon[31203]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:10.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:10 smithi046 ceph-mon[31203]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:12:10.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:10 smithi115 ceph-mon[35055]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:10.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:10 smithi115 ceph-mon[35055]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:12:12.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:12:12.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T09:12:12.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/4086775822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]: dispatch 2024-09-19T09:12:12.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]: dispatch 2024-09-19T09:12:12.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]': finished 2024-09-19T09:12:12.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:12:12.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:12.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:12 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/4288410921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/4086775822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]: dispatch 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]: dispatch 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]': finished 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:12 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/4288410921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:12:12.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:12:12.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T09:12:12.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/4086775822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]: dispatch 2024-09-19T09:12:12.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]: dispatch 2024-09-19T09:12:12.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20a50b73-a051-4d3d-927d-1a9ea780e1c2"}]': finished 2024-09-19T09:12:12.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:12:12.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:12.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:12 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/4288410921' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:12:14.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:14 smithi115 ceph-mon[35055]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:12:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:14 smithi046 ceph-mon[31203]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:12:14.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:14 smithi099 ceph-mon[35256]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:12:16.310 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:16 smithi099 ceph-mon[35256]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T09:12:16.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:16 smithi115 ceph-mon[35055]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T09:12:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:16 smithi046 ceph-mon[31203]: pgmap v101: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T09:12:18.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:18 smithi099 ceph-mon[35256]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T09:12:18.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:18 smithi115 ceph-mon[35055]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T09:12:18.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:18 smithi046 ceph-mon[31203]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T09:12:19.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:12:19.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:19.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:12:19.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:19.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:12:19.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:20.374 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:20 smithi099 ceph-mon[35256]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:20.374 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:20 smithi099 ceph-mon[35256]: Deploying daemon osd.4 on smithi099 2024-09-19T09:12:20.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:20 smithi115 ceph-mon[35055]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:20.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:20 smithi115 ceph-mon[35055]: Deploying daemon osd.4 on smithi099 2024-09-19T09:12:20.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:20 smithi046 ceph-mon[31203]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:20.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:20 smithi046 ceph-mon[31203]: Deploying daemon osd.4 on smithi099 2024-09-19T09:12:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:22 smithi099 ceph-mon[35256]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:22.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:22 smithi115 ceph-mon[35055]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:22.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:22 smithi046 ceph-mon[31203]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:24.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:24 smithi099 ceph-mon[35256]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:24.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:24 smithi115 ceph-mon[35055]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:24.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:24 smithi046 ceph-mon[31203]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:26.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:26 smithi099 ceph-mon[35256]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:26 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:26 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:26 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:26.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:26 smithi115 ceph-mon[35055]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:26.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:26 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:26 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:26 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:26.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:26 smithi046 ceph-mon[31203]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:26.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:26 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:26.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:26 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:26.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:26 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.619+0000 7f5b297fa640 1 -- 172.21.15.99:0/3255913351 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5b2c062630 con 0x7f5b140a3270 2024-09-19T09:12:28.621 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 4 on host 'smithi099' 2024-09-19T09:12:28.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.621+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5b140a3270 msgr2=0x7f5b140a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:28.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.621+0000 7f5b326c2640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5b140a3270 0x7f5b140a5730 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c102c60 tx=0x7f5b1c00b390 comp rx=0 tx=0).stop 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 msgr2=0x7f5b2c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c1983f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009230 tx=0x7f5b20004360 comp rx=0 tx=0).stop 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 shutdown_connections 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5b140a3270 0x7f5b140a5730 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b2c1037c0 0x7f5b2c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5b2c102e00 0x7f5b2c1983f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 --2- 172.21.15.99:0/3255913351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b2c101c00 0x7f5b2c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 >> 172.21.15.99:0/3255913351 conn(0x7f5b2c0fd390 msgr2=0x7f5b2c106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 shutdown_connections 2024-09-19T09:12:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:12:28.622+0000 7f5b326c2640 1 -- 172.21.15.99:0/3255913351 wait complete. 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:28.950 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.184 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:29.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:29.276 DEBUG:teuthology.orchestra.run.smithi099:osd.4> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T09:12:29.278 INFO:tasks.cephadm:Deploying osd.5 on smithi115 with /dev/vg_nvme/lv_3... 2024-09-19T09:12:29.278 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:12:29.528 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:12:30.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:30 smithi115 ceph-mon[35055]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:30 smithi099 ceph-mon[35256]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:31.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:30 smithi046 ceph-mon[31203]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:31.513 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:12:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:12:31.249+0000 7f3ad6056640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:12:31.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:31 smithi115 ceph-mon[35055]: from='osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:12:31.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:31 smithi115 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:12:32.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:31 smithi099 ceph-mon[35256]: from='osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:12:32.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:31 smithi099 ceph-mon[35256]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:12:32.131 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:12:32.160 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_3 2024-09-19T09:12:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:31 smithi046 ceph-mon[31203]: from='osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:12:32.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:31 smithi046 ceph-mon[31203]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:12:32.413 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:12:32.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 -- 172.21.15.115:0/1779578829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 msgr2=0x7fecf4107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/1779578829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf4107380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fece8009900 tx=0x7fece802a410 comp rx=0 tx=0).stop 2024-09-19T09:12:32.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 -- 172.21.15.115:0/1779578829 shutdown_connections 2024-09-19T09:12:32.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/1779578829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf41078c0 0x7fecf4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/1779578829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf4107380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/1779578829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecf4102660 0x7fecf4104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 -- 172.21.15.115:0/1779578829 >> 172.21.15.115:0/1779578829 conn(0x7fecf40fc280 msgr2=0x7fecf40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 -- 172.21.15.115:0/1779578829 shutdown_connections 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 -- 172.21.15.115:0/1779578829 wait complete. 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 Processor -- start 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.926+0000 7fecfa7ba640 1 -- start start 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4102660 0x7fecf4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecf41078c0 0x7fecf419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fecf410d8e0 con 0x7fecf41078c0 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fecf410d760 con 0x7fecf4102660 2024-09-19T09:12:32.962 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fecf410da60 con 0x7fecf4104f90 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:32982/0 (socket says 172.21.15.115:32982) 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 -- 172.21.15.115:0/2461760142 learned_addr learned my addr 172.21.15.115:0/2461760142 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf3fff640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4102660 0x7fecf4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf8d57640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecf41078c0 0x7fecf419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 -- 172.21.15.115:0/2461760142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4102660 msgr2=0x7fecf4197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4102660 0x7fecf4197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 -- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecf41078c0 msgr2=0x7fecf419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecf41078c0 0x7fecf419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 -- 172.21.15.115:0/2461760142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf419fbc0 con 0x7fecf4104f90 2024-09-19T09:12:32.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf37fe640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf41984d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fece8031610 tx=0x7fece80043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece803f030 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fece8003ce0 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf419fe50 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8035070 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.927+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41a0320 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.929+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf40fdd70 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.930+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fece8042030 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.930+0000 7fecf17fa640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fecdc0a3270 0x7fecdc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.930+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fece80eec00 con 0x7fecf4104f90 2024-09-19T09:12:32.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.930+0000 7fecf3fff640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fecdc0a3270 0x7fecdc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.931+0000 7fecf3fff640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fecdc0a3270 0x7fecdc0a5730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fece4009990 tx=0x7fece4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:32.935+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fece80f5080 con 0x7fecf4104f90 2024-09-19T09:12:33.111 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:33.110+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fecf4062630 con 0x7fecdc0a3270 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:33.112 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:33.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:33.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:33.232 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:33.233 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:33.512 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:12:33.230+0000 7f3ad1fd9640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:12:33.512 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:12:33.235+0000 7f3ac9df9640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:12:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi099 2024-09-19T09:12:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi099 to 8544M 2024-09-19T09:12:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:33 smithi115 ceph-mon[35055]: from='osd.4 ' entity='osd.4' 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi099 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi099 to 8544M 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:33 smithi046 ceph-mon[31203]: from='osd.4 ' entity='osd.4' 2024-09-19T09:12:34.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi099 2024-09-19T09:12:34.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi099 to 8544M 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:33 smithi099 ceph-mon[35256]: from='osd.4 ' entity='osd.4' 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] boot 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T09:12:35.192 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:34 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:35.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] boot 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T09:12:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:34 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:12:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:12:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-19T09:12:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:12:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: osd.4 [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] boot 2024-09-19T09:12:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T09:12:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:34 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:12:36.090 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:35 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/607026762' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]: dispatch 2024-09-19T09:12:36.090 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:35 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]: dispatch 2024-09-19T09:12:36.090 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:35 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]': finished 2024-09-19T09:12:36.091 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:35 smithi115 ceph-mon[35055]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:12:36.091 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:35 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/607026762' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]: dispatch 2024-09-19T09:12:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:35 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]: dispatch 2024-09-19T09:12:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:35 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]': finished 2024-09-19T09:12:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:35 smithi046 ceph-mon[31203]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:12:36.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:35 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/607026762' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]: dispatch 2024-09-19T09:12:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:35 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]: dispatch 2024-09-19T09:12:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:35 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "384f0d2b-a76a-423c-8e2e-f53d330e1a6a"}]': finished 2024-09-19T09:12:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:35 smithi099 ceph-mon[35256]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T09:12:36.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:37.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:36 smithi099 ceph-mon[35256]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:37.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:36 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/621131062' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:12:37.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:36 smithi115 ceph-mon[35055]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:37.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:36 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/621131062' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:12:37.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:36 smithi046 ceph-mon[31203]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:37.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:36 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/621131062' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:12:39.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:38 smithi115 ceph-mon[35055]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:38 smithi046 ceph-mon[31203]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:39.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:38 smithi099 ceph-mon[35256]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:40.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:40 smithi115 ceph-mon[35055]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:41.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:40 smithi046 ceph-mon[31203]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:41.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:40 smithi099 ceph-mon[35256]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:43.171 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:42 smithi115 ceph-mon[35055]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:43.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:42 smithi046 ceph-mon[31203]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:43.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:42 smithi099 ceph-mon[35256]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:44 smithi115 ceph-mon[35055]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:12:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:45.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:44 smithi046 ceph-mon[31203]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:45.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:12:45.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:44 smithi099 ceph-mon[35256]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:12:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:45.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:45 smithi115 ceph-mon[35055]: Deploying daemon osd.5 on smithi115 2024-09-19T09:12:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:45 smithi046 ceph-mon[31203]: Deploying daemon osd.5 on smithi115 2024-09-19T09:12:46.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:45 smithi099 ceph-mon[35256]: Deploying daemon osd.5 on smithi115 2024-09-19T09:12:47.173 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:46 smithi115 ceph-mon[35055]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:47.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:46 smithi046 ceph-mon[31203]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:47.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:46 smithi099 ceph-mon[35256]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:49.180 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:48 smithi115 ceph-mon[35055]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:49.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:48 smithi046 ceph-mon[31203]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:49.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:48 smithi099 ceph-mon[35256]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:50.180 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:49 smithi115 ceph-mon[35055]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:49 smithi046 ceph-mon[31203]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:50.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:49 smithi099 ceph-mon[35256]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:51.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:51.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:51.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:51.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:51.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:51.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:52.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:51 smithi115 ceph-mon[35055]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:52.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:51 smithi046 ceph-mon[31203]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:52.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:51 smithi099 ceph-mon[35256]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:54.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:53 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:53 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:53 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:53 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:53 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:53 smithi115 ceph-mon[35055]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:53 smithi046 ceph-mon[31203]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:54.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:53 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:53 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:53 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:53 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:53 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:53 smithi099 ceph-mon[35256]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:54.560 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.558+0000 7fecf17fa640 1 -- 172.21.15.115:0/2461760142 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fecf4062630 con 0x7fecdc0a3270 2024-09-19T09:12:54.561 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 5 on host 'smithi115' 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fecdc0a3270 msgr2=0x7fecdc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fecdc0a3270 0x7fecdc0a5730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fece4009990 tx=0x7fece4009110 comp rx=0 tx=0).stop 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 msgr2=0x7fecf41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf41984d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fece8031610 tx=0x7fece80043b0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 shutdown_connections 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fecdc0a3270 0x7fecdc0a5730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fecf41078c0 0x7fecf419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecf4104f90 0x7fecf41984d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 --2- 172.21.15.115:0/2461760142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4102660 0x7fecf4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:54.563 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 >> 172.21.15.115:0/2461760142 conn(0x7fecf40fc280 msgr2=0x7fecf4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:54.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 shutdown_connections 2024-09-19T09:12:54.564 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:12:54.561+0000 7fecfa7ba640 1 -- 172.21.15.115:0/2461760142 wait complete. 2024-09-19T09:12:55.189 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:55.189 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:55.189 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:55.217 DEBUG:teuthology.orchestra.run.smithi115:osd.5> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T09:12:55.222 INFO:tasks.cephadm:Deploying osd.6 on smithi046 with /dev/vg_nvme/lv_2... 2024-09-19T09:12:55.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:12:55.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:55.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:12:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:55.488 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:56.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:55 smithi115 ceph-mon[35055]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:55 smithi046 ceph-mon[31203]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:56.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:55 smithi099 ceph-mon[35256]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:56.709 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:12:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:12:56.500+0000 7fccbe0c5640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:12:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:56 smithi115 ceph-mon[35055]: from='osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:12:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:56 smithi115 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:12:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:56 smithi046 ceph-mon[31203]: from='osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:12:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:56 smithi046 ceph-mon[31203]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:12:57.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:56 smithi099 ceph-mon[35256]: from='osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:12:57.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:56 smithi099 ceph-mon[35256]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:12:58.070 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:57 smithi046 ceph-mon[31203]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:58.071 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:57 smithi046 ceph-mon[31203]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:12:58.071 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:57 smithi046 ceph-mon[31203]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:12:58.071 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:58.071 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:57 smithi046 ceph-mon[31203]: from='osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:12:58.071 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:57 smithi046 ceph-mon[31203]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:12:58.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:12:58.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-09-19T09:12:58.137 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:57 smithi115 ceph-mon[35055]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:58.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:57 smithi115 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:12:58.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:57 smithi115 ceph-mon[35055]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:12:58.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:57 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:58.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:57 smithi115 ceph-mon[35055]: from='osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:12:58.138 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:57 smithi115 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:12:58.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:57 smithi099 ceph-mon[35256]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:12:58.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:57 smithi099 ceph-mon[35256]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:12:58.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:57 smithi099 ceph-mon[35256]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:12:58.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:57 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:58.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:57 smithi099 ceph-mon[35256]: from='osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:12:58.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:57 smithi099 ceph-mon[35256]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:12:58.403 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:12:58.459 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:12:58.324+0000 7fccba048640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:12:58.459 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:12:58.331+0000 7fccb1e68640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 -- 172.21.15.46:0/4191425016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 msgr2=0x7f1d24102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 --2- 172.21.15.46:0/4191425016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24102000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009900 tx=0x7f1d1402a410 comp rx=0 tx=0).stop 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 -- 172.21.15.46:0/4191425016 shutdown_connections 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 --2- 172.21.15.46:0/4191425016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d241037c0 0x7f1d2410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 --2- 172.21.15.46:0/4191425016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d24102e00 0x7f1d24103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 --2- 172.21.15.46:0/4191425016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24102000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:58.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 -- 172.21.15.46:0/4191425016 >> 172.21.15.46:0/4191425016 conn(0x7f1d240fd390 msgr2=0x7f1d240ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 -- 172.21.15.46:0/4191425016 shutdown_connections 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.901+0000 7f1d29513640 1 -- 172.21.15.46:0/4191425016 wait complete. 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 Processor -- start 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 -- start start 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d24102e00 0x7f1d241984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d241037c0 0x7f1d2419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2410d8e0 con 0x7f1d24101c00 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2410d760 con 0x7f1d24102e00 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d29513640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2410da60 con 0x7f1d241037c0 2024-09-19T09:12:58.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d22ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d22ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44040/0 (socket says 172.21.15.46:44040) 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d22ffd640 1 -- 172.21.15.46:0/3444002067 learned_addr learned my addr 172.21.15.46:0/3444002067 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d227fc640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d24102e00 0x7f1d241984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.902+0000 7f1d237fe640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d241037c0 0x7f1d2419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d22ffd640 1 -- 172.21.15.46:0/3444002067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d241037c0 msgr2=0x7f1d2419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d22ffd640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d241037c0 0x7f1d2419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d22ffd640 1 -- 172.21.15.46:0/3444002067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d24102e00 msgr2=0x7f1d241984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d22ffd640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d24102e00 0x7f1d241984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d22ffd640 1 -- 172.21.15.46:0/3444002067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2419fb90 con 0x7f1d24101c00 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d22ffd640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24197f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031610 tx=0x7f1d140043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1403f030 con 0x7f1d24101c00 2024-09-19T09:12:58.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2419fe20 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d14003ce0 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14035070 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.903+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d241a02f0 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.904+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d24109020 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.905+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d14042030 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.906+0000 7f1d0bfff640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d0c0a3270 0x7f1d0c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.906+0000 7f1d227fc640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d0c0a3270 0x7f1d0c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.906+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4286+0+0 (secure 0 0 0) 0x7f1d140ef290 con 0x7f1d24101c00 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.906+0000 7f1d227fc640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d0c0a3270 0x7f1d0c0a5730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d24199480 tx=0x7f1d1800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:12:58.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:58.910+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d140bced0 con 0x7f1d24101c00 2024-09-19T09:12:59.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:12:59.097+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1d24062630 con 0x7f1d0c0a3270 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi115 2024-09-19T09:12:59.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.100 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:58 smithi046 ceph-mon[31203]: from='osd.5 ' entity='osd.5' 2024-09-19T09:12:59.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi115 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-19T09:12:59.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:59.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:59.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:58 smithi115 ceph-mon[35055]: from='osd.5 ' entity='osd.5' 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi115 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:12:59.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:58 smithi099 ceph-mon[35256]: from='osd.5 ' entity='osd.5' 2024-09-19T09:13:00.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] boot 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:00.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:00.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:12:59 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] boot 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:13:00.215 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:00.216 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:00.216 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:00.216 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:12:59 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: osd.5 [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] boot 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:00.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:00.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:12:59 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:01.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:01 smithi046 ceph-mon[31203]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:13:01.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:01 smithi115 ceph-mon[35055]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:13:01.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:01 smithi099 ceph-mon[35256]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:13:02.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:02 smithi046 ceph-mon[31203]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:02.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:02 smithi046 ceph-mon[31203]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:13:02.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:02 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2291798459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8122b9b-6ca9-4d55-aa49-303e5b409314"}]: dispatch 2024-09-19T09:13:02.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:02 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2291798459' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8122b9b-6ca9-4d55-aa49-303e5b409314"}]': finished 2024-09-19T09:13:02.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:02 smithi046 ceph-mon[31203]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:13:02.170 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:02.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:02 smithi115 ceph-mon[35055]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:02.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:02 smithi115 ceph-mon[35055]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:13:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2291798459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8122b9b-6ca9-4d55-aa49-303e5b409314"}]: dispatch 2024-09-19T09:13:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2291798459' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8122b9b-6ca9-4d55-aa49-303e5b409314"}]': finished 2024-09-19T09:13:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:02 smithi115 ceph-mon[35055]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:13:02.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:02.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:02 smithi099 ceph-mon[35256]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:02.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:02 smithi099 ceph-mon[35256]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T09:13:02.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:02 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2291798459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8122b9b-6ca9-4d55-aa49-303e5b409314"}]: dispatch 2024-09-19T09:13:02.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:02 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2291798459' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8122b9b-6ca9-4d55-aa49-303e5b409314"}]': finished 2024-09-19T09:13:02.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:02 smithi099 ceph-mon[35256]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:13:02.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:03.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:03 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/970693138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:03.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:03 smithi115 ceph-mon[35055]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:13:03.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:03.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:03 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/970693138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:03.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:03 smithi046 ceph-mon[31203]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:13:03.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:03.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:03 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/970693138' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:03.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:03 smithi099 ceph-mon[35256]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:13:03.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:04.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:04 smithi115 ceph-mon[35055]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:04.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:04 smithi046 ceph-mon[31203]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:05.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:04 smithi099 ceph-mon[35256]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:06.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:06 smithi046 ceph-mon[31203]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:06.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:06 smithi115 ceph-mon[35055]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:07.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:06 smithi099 ceph-mon[35256]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:08.804 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:08 smithi046 ceph-mon[31203]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:13:08.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:08 smithi115 ceph-mon[35055]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:13:09.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:08 smithi099 ceph-mon[35256]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:13:10.898 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:10 smithi046 ceph-mon[31203]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T09:13:10.898 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:13:10.898 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:10.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:10 smithi115 ceph-mon[35055]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T09:13:10.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:13:10.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:11.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:10 smithi099 ceph-mon[35256]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T09:13:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:13:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:11.857 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:11 smithi046 ceph-mon[31203]: Deploying daemon osd.6 on smithi046 2024-09-19T09:13:11.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:11 smithi115 ceph-mon[35055]: Deploying daemon osd.6 on smithi046 2024-09-19T09:13:12.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:11 smithi099 ceph-mon[35256]: Deploying daemon osd.6 on smithi046 2024-09-19T09:13:12.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:12 smithi115 ceph-mon[35055]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T09:13:12.966 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:12 smithi046 ceph-mon[31203]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T09:13:13.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:12 smithi099 ceph-mon[35256]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T09:13:14.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:14 smithi115 ceph-mon[35055]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T09:13:14.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:14 smithi046 ceph-mon[31203]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T09:13:15.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:14 smithi099 ceph-mon[35256]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T09:13:16.916 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:16 smithi046 ceph-mon[31203]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:13:16.917 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:16.917 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:16.917 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:16.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:16 smithi115 ceph-mon[35055]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:13:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:17.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:16 smithi099 ceph-mon[35256]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:13:17.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:17.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:18.867 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:18 smithi046 ceph-mon[31203]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:13:18.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:18 smithi115 ceph-mon[35055]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:13:19.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:18 smithi099 ceph-mon[35256]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:13:19.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.589+0000 7f1d0bfff640 1 -- 172.21.15.46:0/3444002067 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1d24062630 con 0x7f1d0c0a3270 2024-09-19T09:13:19.590 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 6 on host 'smithi046' 2024-09-19T09:13:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d0c0a3270 msgr2=0x7f1d0c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d0c0a3270 0x7f1d0c0a5730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1d24199480 tx=0x7f1d1800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 msgr2=0x7f1d24197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24197f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031610 tx=0x7f1d140043b0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 shutdown_connections 2024-09-19T09:13:19.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d0c0a3270 0x7f1d0c0a5730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d241037c0 0x7f1d2419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d24102e00 0x7f1d241984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 --2- 172.21.15.46:0/3444002067 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d24101c00 0x7f1d24197f60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 >> 172.21.15.46:0/3444002067 conn(0x7f1d240fd390 msgr2=0x7f1d241061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 shutdown_connections 2024-09-19T09:13:19.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:13:19.591+0000 7f1d29513640 1 -- 172.21.15.46:0/3444002067 wait complete. 2024-09-19T09:13:20.275 DEBUG:teuthology.orchestra.run.smithi046:osd.6> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T09:13:20.277 INFO:tasks.cephadm:Deploying osd.7 on smithi099 with /dev/vg_nvme/lv_2... 2024-09-19T09:13:20.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:13:20.523 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:13:20.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:20 smithi046 ceph-mon[31203]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:20.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.801 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.864 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:20 smithi099 ceph-mon[35256]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:20.864 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.864 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.864 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.864 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:20 smithi115 ceph-mon[35055]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:22.596 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:13:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:13:22.301+0000 7f375dcce640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:13:22.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:22 smithi115 ceph-mon[35055]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:22.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:22 smithi115 ceph-mon[35055]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:13:22.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:22 smithi046 ceph-mon[31203]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:22.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:22 smithi046 ceph-mon[31203]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:13:23.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:22 smithi099 ceph-mon[35256]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:23.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:22 smithi099 ceph-mon[35256]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:13:23.046 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:13:23.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-09-19T09:13:23.324 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:13:23.722 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.723 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:13:23.724 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:23.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 -- 172.21.15.99:0/176274702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92201026a0 msgr2=0x7f9220104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:23.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 --2- 172.21.15.99:0/176274702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92201026a0 0x7f9220104a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9210009900 tx=0x7f921002a410 comp rx=0 tx=0).stop 2024-09-19T09:13:23.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 -- 172.21.15.99:0/176274702 shutdown_connections 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 --2- 172.21.15.99:0/176274702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 0x7f92201073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 --2- 172.21.15.99:0/176274702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9220107900 0x7f9220109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 --2- 172.21.15.99:0/176274702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92201026a0 0x7f9220104a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 -- 172.21.15.99:0/176274702 >> 172.21.15.99:0/176274702 conn(0x7f92200fc2a0 msgr2=0x7f92200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 -- 172.21.15.99:0/176274702 shutdown_connections 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.804+0000 7f9225449640 1 -- 172.21.15.99:0/176274702 wait complete. 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 Processor -- start 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 -- start start 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92201026a0 0x7f9220197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 0x7f9220198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 0x7f922019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f922010d8d0 con 0x7f9220104fd0 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f922010d750 con 0x7f9220107900 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f9225449640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f922010da50 con 0x7f92201026a0 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 0x7f922019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 0x7f922019f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49514/0 (socket says 172.21.15.99:49514) 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 -- 172.21.15.99:0/2671336836 learned_addr learned my addr 172.21.15.99:0/2671336836 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921effd640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92201026a0 0x7f9220197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921e7fc640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 0x7f9220198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 -- 172.21.15.99:0/2671336836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92201026a0 msgr2=0x7f9220197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92201026a0 0x7f9220197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 -- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 msgr2=0x7f9220198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 0x7f9220198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.805+0000 7f921f7fe640 1 -- 172.21.15.99:0/2671336836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922019fb80 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f921e7fc640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 0x7f9220198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f921f7fe640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 0x7f922019f510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f921800eaa0 tx=0x7f921800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921800cdb0 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9218005020 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922019fe70 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92180116b0 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.806+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92201a0320 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.807+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92200fdd90 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.808+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9218005560 con 0x7f9220107900 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.809+0000 7f9207fff640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92080a3270 0x7f92080a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.809+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f92180ceff0 con 0x7f9220107900 2024-09-19T09:13:23.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.809+0000 7f921effd640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92080a3270 0x7f92080a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:23.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.810+0000 7f921effd640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92080a3270 0x7f92080a5730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92100314e0 tx=0x7f9210000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:23.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.812+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9218016030 con 0x7f9220107900 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:13:23.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:13:23.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:23.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:13:23.594+0000 7f3759c51640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:13:23.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:13:23.603+0000 7f3755a79640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:23.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:13:23.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:13:23.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:23.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:13:23.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:23.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:23.987+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9220062630 con 0x7f92080a3270 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi046 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:24.718 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:24 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:24.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:24.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi046 2024-09-19T09:13:24.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-19T09:13:24.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:24.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:24.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:24.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:24.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:24 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi046 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi046 to 5697M 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:24 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:25.658 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:25 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:13:25.659 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:25 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:13:25.659 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:25 smithi099 ceph-mon[35256]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:25.659 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:25 smithi099 ceph-mon[35256]: osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] boot 2024-09-19T09:13:25.659 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:25 smithi099 ceph-mon[35256]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T09:13:25.659 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:25 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:25.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:25 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:13:25.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:25 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:13:25.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:25 smithi115 ceph-mon[35055]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:25.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:25 smithi115 ceph-mon[35055]: osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] boot 2024-09-19T09:13:25.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:25 smithi115 ceph-mon[35055]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T09:13:25.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:25 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:25 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:13:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:25 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:13:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:25 smithi046 ceph-mon[31203]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:25 smithi046 ceph-mon[31203]: osd.6 [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] boot 2024-09-19T09:13:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:25 smithi046 ceph-mon[31203]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T09:13:25.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:25 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/3325407030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]: dispatch 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]: dispatch 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]': finished 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:13:26.915 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:26 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:26.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:26.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T09:13:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/3325407030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]: dispatch 2024-09-19T09:13:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]: dispatch 2024-09-19T09:13:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]': finished 2024-09-19T09:13:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:13:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:26 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/3325407030' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]: dispatch 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]: dispatch 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37c74014-9375-4c7f-acff-71d0156c2d27"}]': finished 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:13:26.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:26 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:27.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:27 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/1325238085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:27.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:27 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/1325238085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:28.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:27 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/1325238085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:28.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:28 smithi115 ceph-mon[35055]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:28 smithi046 ceph-mon[31203]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:29.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:28 smithi099 ceph-mon[35256]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:30.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:30 smithi115 ceph-mon[35055]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:30 smithi046 ceph-mon[31203]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:31.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:30 smithi099 ceph-mon[35256]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:32.851 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:32 smithi099 ceph-mon[35256]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:32.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:32 smithi115 ceph-mon[35055]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:32.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:32 smithi046 ceph-mon[31203]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:34.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:34 smithi099 ceph-mon[35256]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:34.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:34 smithi115 ceph-mon[35055]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:34.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:34 smithi046 ceph-mon[31203]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:35.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:13:35.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:35.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:13:35.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:35.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:13:35.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:36.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:36 smithi099 ceph-mon[35256]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:36.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:36 smithi099 ceph-mon[35256]: Deploying daemon osd.7 on smithi099 2024-09-19T09:13:36.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:36 smithi115 ceph-mon[35055]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:36.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:36 smithi115 ceph-mon[35055]: Deploying daemon osd.7 on smithi099 2024-09-19T09:13:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:36 smithi046 ceph-mon[31203]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:36 smithi046 ceph-mon[31203]: Deploying daemon osd.7 on smithi099 2024-09-19T09:13:38.672 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:38 smithi099 ceph-mon[35256]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:38.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:38 smithi115 ceph-mon[35055]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:38 smithi046 ceph-mon[31203]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:40.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:40 smithi099 ceph-mon[35256]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:40.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:40 smithi115 ceph-mon[35055]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:40 smithi046 ceph-mon[31203]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:41.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:41.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:41.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:41.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:41.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:41.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:42.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:42 smithi115 ceph-mon[35055]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:42.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:42 smithi046 ceph-mon[31203]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:43.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:42 smithi099 ceph-mon[35256]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.621+0000 7f9207fff640 1 -- 172.21.15.99:0/2671336836 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9220062630 con 0x7f92080a3270 2024-09-19T09:13:44.622 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 7 on host 'smithi099' 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92080a3270 msgr2=0x7f92080a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92080a3270 0x7f92080a5730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f92100314e0 tx=0x7f9210000bc0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 msgr2=0x7f922019f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 0x7f922019f510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f921800eaa0 tx=0x7f921800ef60 comp rx=0 tx=0).stop 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 shutdown_connections 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92080a3270 0x7f92080a5730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9220104fd0 0x7f9220198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9220107900 0x7f922019f510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 --2- 172.21.15.99:0/2671336836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f92201026a0 0x7f9220197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 >> 172.21.15.99:0/2671336836 conn(0x7f92200fc2a0 msgr2=0x7f9220103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 shutdown_connections 2024-09-19T09:13:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:13:44.623+0000 7f9225449640 1 -- 172.21.15.99:0/2671336836 wait complete. 2024-09-19T09:13:44.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:44.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:44.983 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:45.362 DEBUG:teuthology.orchestra.run.smithi099:osd.7> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T09:13:45.364 INFO:tasks.cephadm:Deploying osd.8 on smithi115 with /dev/vg_nvme/lv_2... 2024-09-19T09:13:45.365 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:13:45.617 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:46 smithi115 ceph-mon[35055]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:46.825 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:46 smithi099 ceph-mon[35256]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:46.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:46 smithi046 ceph-mon[31203]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:47.263 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:13:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:13:47.055+0000 7fe485910640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:13:47.745 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:47 smithi115 ceph-mon[35055]: from='osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:13:47.745 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:47 smithi115 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:13:47.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:47 smithi099 ceph-mon[35256]: from='osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:13:47.842 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:47 smithi099 ceph-mon[35256]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:13:47.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:47 smithi046 ceph-mon[31203]: from='osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:13:47.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:47 smithi046 ceph-mon[31203]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:13:48.407 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:13:48.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_2 2024-09-19T09:13:48.678 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:48.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:48.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:48.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:48.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:49.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:13:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:49.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:49.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:13:49.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 -- 172.21.15.115:0/1985087514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0101490 msgr2=0x7f86f0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 --2- 172.21.15.115:0/1985087514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0101490 0x7f86f0101910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f86e400aa10 tx=0x7f86e402b720 comp rx=0 tx=0).stop 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 -- 172.21.15.115:0/1985087514 shutdown_connections 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 --2- 172.21.15.115:0/1985087514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 0x7f86f01086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 --2- 172.21.15.115:0/1985087514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0101490 0x7f86f0101910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 --2- 172.21.15.115:0/1985087514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f0100290 0x7f86f0100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 -- 172.21.15.115:0/1985087514 >> 172.21.15.115:0/1985087514 conn(0x7f86f00fba40 msgr2=0x7f86f00fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 -- 172.21.15.115:0/1985087514 shutdown_connections 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.214+0000 7f86f6407640 1 -- 172.21.15.115:0/1985087514 wait complete. 2024-09-19T09:13:49.242 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 Processor -- start 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 -- start start 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 0x7f86f019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f0101490 0x7f86f019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 0x7f86f01a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f86f010b6b0 con 0x7f86f0101490 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f86f010b530 con 0x7f86f0101e50 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86f6407640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f86f010b830 con 0x7f86f0100290 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86effff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 0x7f86f019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86effff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 0x7f86f019a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:33816/0 (socket says 172.21.15.115:33816) 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.215+0000 7f86effff640 1 -- 172.21.15.115:0/2292815904 learned_addr learned my addr 172.21.15.115:0/2292815904 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86ef7fe640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f0101490 0x7f86f019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:49.243 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86f49a4640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 0x7f86f01a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86effff640 1 -- 172.21.15.115:0/2292815904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 msgr2=0x7f86f01a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86effff640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 0x7f86f01a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86effff640 1 -- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f0101490 msgr2=0x7f86f019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86effff640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f0101490 0x7f86f019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86effff640 1 -- 172.21.15.115:0/2292815904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f01a1d70 con 0x7f86f0100290 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86f49a4640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 0x7f86f01a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86effff640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 0x7f86f019a140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86e000d770 tx=0x7f86e000dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0017070 con 0x7f86f0100290 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e0009c30 con 0x7f86f0100290 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f01a2060 con 0x7f86f0100290 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0003dd0 con 0x7f86f0100290 2024-09-19T09:13:49.244 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.216+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f01a2570 con 0x7f86f0100290 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.217+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f0107690 con 0x7f86f0100290 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.218+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f86e0003f70 con 0x7f86f0100290 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.219+0000 7f86ed7fa640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f86d80a3270 0x7f86d80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.219+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f86e00ce5f0 con 0x7f86f0100290 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.219+0000 7f86ef7fe640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f86d80a3270 0x7f86d80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.220+0000 7f86ef7fe640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f86d80a3270 0x7f86d80a5730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f86e4000c00 tx=0x7f86e40306c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:49.245 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.223+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86e009bf90 con 0x7f86f0100290 2024-09-19T09:13:49.401 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:13:49.400+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f86f0062630 con 0x7f86d80a3270 2024-09-19T09:13:49.512 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:13:49.058+0000 7fe481893640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:13:49.512 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:13:49.068+0000 7fe4796b3640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:49.957 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi099 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi099 to 5696M 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='osd.7 ' entity='osd.7' 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:49.958 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi099 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi099 to 5696M 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='osd.7 ' entity='osd.7' 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:49.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi099 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi099 to 5696M 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='osd.7 ' entity='osd.7' 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:13:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:13:50.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:13:50.848 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:13:50.848 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:13:50.848 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:50.849 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:50.849 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:50.849 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] boot 2024-09-19T09:13:50.849 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T09:13:50.849 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:50 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] boot 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T09:13:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:50 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:51.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:13:51.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:13:51.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:13:51.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:13:51.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:51.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: osd.7 [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] boot 2024-09-19T09:13:51.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T09:13:51.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:50 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:13:51.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:51 smithi115 ceph-mon[35055]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T09:13:51.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:51 smithi046 ceph-mon[31203]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T09:13:52.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:51 smithi099 ceph-mon[35256]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T09:13:52.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:52.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:13:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/2385877113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]: dispatch 2024-09-19T09:13:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]: dispatch 2024-09-19T09:13:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]': finished 2024-09-19T09:13:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:13:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:13:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:52 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/2304053427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/2385877113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]: dispatch 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]: dispatch 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]': finished 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:13:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:52 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/2304053427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:53.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: pgmap v170: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:53.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:13:53.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/2385877113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]: dispatch 2024-09-19T09:13:53.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]: dispatch 2024-09-19T09:13:53.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e366800-9368-47ba-be88-2eb812acc566"}]': finished 2024-09-19T09:13:53.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:13:53.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:13:53.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:52 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/2304053427' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:13:54.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:53 smithi115 ceph-mon[35055]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:13:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:53 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:13:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:53 smithi115 ceph-mon[35055]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:53 smithi046 ceph-mon[31203]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:13:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:53 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:13:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:53 smithi046 ceph-mon[31203]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:54.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:53 smithi099 ceph-mon[35256]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:13:54.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:53 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:13:54.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:53 smithi099 ceph-mon[35256]: pgmap v174: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:55 smithi046 ceph-mon[31203]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:56.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:55 smithi099 ceph-mon[35256]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:56.419 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:55 smithi115 ceph-mon[35055]: pgmap v175: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:58.199 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:57 smithi115 ceph-mon[35055]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:58.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:57 smithi046 ceph-mon[31203]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:13:58.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:57 smithi099 ceph-mon[35256]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:00.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:13:59 smithi046 ceph-mon[31203]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:00.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:13:59 smithi099 ceph-mon[35256]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:00.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:13:59 smithi115 ceph-mon[35055]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:01.149 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:14:01.149 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:01.149 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:00 smithi115 ceph-mon[35055]: Deploying daemon osd.8 on smithi115 2024-09-19T09:14:01.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:14:01.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:01.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:00 smithi099 ceph-mon[35256]: Deploying daemon osd.8 on smithi115 2024-09-19T09:14:01.313 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:14:01.313 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:01.313 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:00 smithi046 ceph-mon[31203]: Deploying daemon osd.8 on smithi115 2024-09-19T09:14:02.172 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:01 smithi115 ceph-mon[35055]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:02.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:01 smithi099 ceph-mon[35256]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:02.313 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:01 smithi046 ceph-mon[31203]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:04.157 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:03 smithi115 ceph-mon[35055]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:04.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:03 smithi099 ceph-mon[35256]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:04.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:03 smithi046 ceph-mon[31203]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:06.256 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:05 smithi115 ceph-mon[35055]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:06.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:05 smithi099 ceph-mon[35256]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:06.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:05 smithi046 ceph-mon[31203]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:07.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:06 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:07.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:06 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:07.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:06 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:07.278 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:06 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:07.278 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:06 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:07.278 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:06 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:07.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:06 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:07.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:06 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:07.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:06 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:08.930 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:08 smithi115 ceph-mon[35055]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:08 smithi046 ceph-mon[31203]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:09.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:08 smithi099 ceph-mon[35256]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:10.525 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.525+0000 7f86ed7fa640 1 -- 172.21.15.115:0/2292815904 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f86f0062630 con 0x7f86d80a3270 2024-09-19T09:14:10.526 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 8 on host 'smithi115' 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f86d80a3270 msgr2=0x7f86d80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f86d80a3270 0x7f86d80a5730 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f86e4000c00 tx=0x7f86e40306c0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 msgr2=0x7f86f019a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 0x7f86f019a140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f86e000d770 tx=0x7f86e000dc30 comp rx=0 tx=0).stop 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 shutdown_connections 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f86d80a3270 0x7f86d80a5730 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f86f0101490 0x7f86f019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86f0101e50 0x7f86f01a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 --2- 172.21.15.115:0/2292815904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f86f0100290 0x7f86f019a140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 >> 172.21.15.115:0/2292815904 conn(0x7f86f00fba40 msgr2=0x7f86f0104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 shutdown_connections 2024-09-19T09:14:10.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:14:10.527+0000 7f86f6407640 1 -- 172.21.15.115:0/2292815904 wait complete. 2024-09-19T09:14:10.828 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:10.828 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.829 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:10.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:11.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:11.156 DEBUG:teuthology.orchestra.run.smithi115:osd.8> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T09:14:11.159 INFO:tasks.cephadm:Deploying osd.9 on smithi046 with /dev/vg_nvme/lv_1... 2024-09-19T09:14:11.159 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:14:11.427 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:14:12.646 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:12 smithi046 ceph-mon[31203]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:12.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:12 smithi115 ceph-mon[35055]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:12.984 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:14:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:14:12.712+0000 7f5df6b0d640 -1 osd.8 0 log_to_monitors true 2024-09-19T09:14:13.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:12 smithi099 ceph-mon[35256]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:13.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:13 smithi115 ceph-mon[35055]: from='osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:14:13.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:13 smithi115 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:14:13.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:13 smithi046 ceph-mon[31203]: from='osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:14:13.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:13 smithi046 ceph-mon[31203]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:14:14.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:13 smithi099 ceph-mon[35256]: from='osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:14:14.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:13 smithi099 ceph-mon[35256]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:14:14.067 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:14:14.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi046:vg_nvme/lv_1 2024-09-19T09:14:14.360 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:14:14.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:14.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:14:14.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:14:14.812 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:14.813 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 -- 172.21.15.46:0/4287012457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 msgr2=0x7fb0741073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 --2- 172.21.15.46:0/4287012457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741073e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb064009900 tx=0x7fb06402a410 comp rx=0 tx=0).stop 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 -- 172.21.15.46:0/4287012457 shutdown_connections 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 --2- 172.21.15.46:0/4287012457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741073e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 --2- 172.21.15.46:0/4287012457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb074107920 0x7fb074109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 --2- 172.21.15.46:0/4287012457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0741026c0 0x7fb074104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 -- 172.21.15.46:0/4287012457 >> 172.21.15.46:0/4287012457 conn(0x7fb0740fc280 msgr2=0x7fb0740fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 -- 172.21.15.46:0/4287012457 shutdown_connections 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.811+0000 7fb07c29a640 1 -- 172.21.15.46:0/4287012457 wait complete. 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 Processor -- start 2024-09-19T09:14:14.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 -- start start 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0741026c0 0x7fb074197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb074107920 0x7fb07419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb07410d850 con 0x7fb074104ff0 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb07410d6d0 con 0x7fb0741026c0 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07c29a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb07410d9d0 con 0x7fb074107920 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47492/0 (socket says 172.21.15.46:47492) 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 -- 172.21.15.46:0/3872309745 learned_addr learned my addr 172.21.15.46:0/3872309745 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07a837640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb074107920 0x7fb07419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb07a036640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0741026c0 0x7fb074197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 -- 172.21.15.46:0/3872309745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb074107920 msgr2=0x7fb07419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:14.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb074107920 0x7fb07419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 -- 172.21.15.46:0/3872309745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0741026c0 msgr2=0x7fb074197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.812+0000 7fb079835640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0741026c0 0x7fb074197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb079835640 1 -- 172.21.15.46:0/3872309745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07419fbb0 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb07a837640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb074107920 0x7fb07419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb079835640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741984c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb064031610 tx=0x7fb064004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06403f030 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb064003ad0 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07419fe40 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb064035070 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.813+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0741a0290 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.814+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0740fdd70 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.815+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb064042030 con 0x7fb074104ff0 2024-09-19T09:14:14.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.816+0000 7fb06b7fe640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0600a3270 0x7fb0600a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:14.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.816+0000 7fb07a036640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0600a3270 0x7fb0600a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:14.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.816+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7fb0640ef680 con 0x7fb074104ff0 2024-09-19T09:14:14.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.816+0000 7fb07a036640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0600a3270 0x7fb0600a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb070009bd0 tx=0x7fb070005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:14.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:14.821+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0640bc820 con 0x7fb074104ff0 2024-09-19T09:14:14.959 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:14:14.567+0000 7f5df2a90640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T09:14:14.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:14:14.575+0000 7f5dee8b8640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:14.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:15.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:15.008+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb074062630 con 0x7fb0600a3270 2024-09-19T09:14:15.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:15.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:15.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:15.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:15.678 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi115 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:15.679 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi115 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:16.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi115 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:16.882 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] boot 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:14:16.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:16.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] boot 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:14:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: osd.8 [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] boot 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:14:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:14:17.904 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:17 smithi046 ceph-mon[31203]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T09:14:17.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:17 smithi115 ceph-mon[35055]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T09:14:18.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:17 smithi099 ceph-mon[35256]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T09:14:18.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:14:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2174871936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6698a57-d371-439e-9f43-56e1bce6d146"}]: dispatch 2024-09-19T09:14:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2174871936' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6698a57-d371-439e-9f43-56e1bce6d146"}]': finished 2024-09-19T09:14:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:14:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1174490066' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2174871936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6698a57-d371-439e-9f43-56e1bce6d146"}]: dispatch 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2174871936' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6698a57-d371-439e-9f43-56e1bce6d146"}]': finished 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1174490066' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:19.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:14:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2174871936' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6698a57-d371-439e-9f43-56e1bce6d146"}]: dispatch 2024-09-19T09:14:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2174871936' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6698a57-d371-439e-9f43-56e1bce6d146"}]': finished 2024-09-19T09:14:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:14:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1174490066' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:19.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:19 smithi115 ceph-mon[35055]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:14:19.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:19 smithi046 ceph-mon[31203]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:14:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:20.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:19 smithi099 ceph-mon[35256]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:14:20.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:20 smithi115 ceph-mon[35055]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:20 smithi115 ceph-mon[35055]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:14:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:20.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:20 smithi046 ceph-mon[31203]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:20 smithi046 ceph-mon[31203]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:14:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:21.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:20 smithi099 ceph-mon[35256]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:21.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:20 smithi099 ceph-mon[35256]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:14:21.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:22.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:22 smithi046 ceph-mon[31203]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:14:22.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:22 smithi115 ceph-mon[35055]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:14:23.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:22 smithi099 ceph-mon[35256]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:14:24.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:24 smithi046 ceph-mon[31203]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-19T09:14:24.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:24 smithi115 ceph-mon[35055]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-19T09:14:25.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:24 smithi099 ceph-mon[35256]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-19T09:14:26.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:26 smithi046 ceph-mon[31203]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T09:14:26.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:26 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:14:26.906 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:26 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:26.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:26 smithi115 ceph-mon[35055]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T09:14:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:26 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:14:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:26 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:27.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:26 smithi099 ceph-mon[35256]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T09:14:27.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:26 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:14:27.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:26 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:27.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:27 smithi115 ceph-mon[35055]: Deploying daemon osd.9 on smithi046 2024-09-19T09:14:27.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:27 smithi046 ceph-mon[31203]: Deploying daemon osd.9 on smithi046 2024-09-19T09:14:28.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:27 smithi099 ceph-mon[35256]: Deploying daemon osd.9 on smithi046 2024-09-19T09:14:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:28 smithi115 ceph-mon[35055]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T09:14:28.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:28 smithi046 ceph-mon[31203]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T09:14:29.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:28 smithi099 ceph-mon[35256]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-19T09:14:30.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:30 smithi115 ceph-mon[35055]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:14:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:30 smithi046 ceph-mon[31203]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:14:31.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:30 smithi099 ceph-mon[35256]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:14:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:32 smithi046 ceph-mon[31203]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T09:14:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:32.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:32 smithi115 ceph-mon[35055]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T09:14:32.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:32.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:32.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:33.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:32 smithi099 ceph-mon[35256]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T09:14:33.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:33.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:33.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:34.888 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:34 smithi046 ceph-mon[31203]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:34.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:34 smithi115 ceph-mon[35055]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:35.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:34 smithi099 ceph-mon[35256]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:36.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.314+0000 7fb06b7fe640 1 -- 172.21.15.46:0/3872309745 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb074062630 con 0x7fb0600a3270 2024-09-19T09:14:36.316 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 9 on host 'smithi046' 2024-09-19T09:14:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0600a3270 msgr2=0x7fb0600a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0600a3270 0x7fb0600a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb070009bd0 tx=0x7fb070005f90 comp rx=0 tx=0).stop 2024-09-19T09:14:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 msgr2=0x7fb0741984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:36.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741984c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb064031610 tx=0x7fb064004270 comp rx=0 tx=0).stop 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 shutdown_connections 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0600a3270 0x7fb0600a5730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb074104ff0 0x7fb0741984c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb074107920 0x7fb07419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 --2- 172.21.15.46:0/3872309745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0741026c0 0x7fb074197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.316+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 >> 172.21.15.46:0/3872309745 conn(0x7fb0740fc280 msgr2=0x7fb074103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.317+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 shutdown_connections 2024-09-19T09:14:36.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:14:36.317+0000 7fb07c29a640 1 -- 172.21.15.46:0/3872309745 wait complete. 2024-09-19T09:14:36.633 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:36.633 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.633 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:36.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:36.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:36.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.634 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:36.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:36.939 DEBUG:teuthology.orchestra.run.smithi046:osd.9> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T09:14:36.942 INFO:tasks.cephadm:Deploying osd.10 on smithi099 with /dev/vg_nvme/lv_1... 2024-09-19T09:14:36.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:14:37.200 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:14:38.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:38 smithi046 ceph-mon[31203]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:38.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:38 smithi046 ceph-mon[31203]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:14:38.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:14:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:14:38.325+0000 7fd0310e9640 -1 osd.9 0 log_to_monitors true 2024-09-19T09:14:38.655 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:38 smithi099 ceph-mon[35256]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:38.656 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:38 smithi099 ceph-mon[35256]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:14:38.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:38 smithi115 ceph-mon[35055]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:38.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:38 smithi115 ceph-mon[35055]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:14:39.709 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-mon[31203]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:14:39.709 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-mon[31203]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:14:39.710 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-mon[31203]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:14:39.710 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:39.710 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-mon[31203]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:14:39.710 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:14:39.394+0000 7fd02d06c640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T09:14:39.710 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:14:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:14:39.407+0000 7fd028e94640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:14:39.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:39 smithi115 ceph-mon[35055]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:14:39.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:39 smithi115 ceph-mon[35055]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:14:39.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:39 smithi115 ceph-mon[35055]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:14:39.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:39.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:39 smithi115 ceph-mon[35055]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:14:39.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:39 smithi099 ceph-mon[35256]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:14:39.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:39 smithi099 ceph-mon[35256]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:14:39.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:39 smithi099 ceph-mon[35256]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-19T09:14:39.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:39.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:39 smithi099 ceph-mon[35256]: from='osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-19T09:14:39.851 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T09:14:39.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_1 2024-09-19T09:14:40.127 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:40 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 -- 172.21.15.99:0/2166041818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 msgr2=0x7fb100102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:40.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 --2- 172.21.15.99:0/2166041818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100102150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009900 tx=0x7fb0f002a410 comp rx=0 tx=0).stop 2024-09-19T09:14:40.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 -- 172.21.15.99:0/2166041818 shutdown_connections 2024-09-19T09:14:40.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 --2- 172.21.15.99:0/2166041818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 0x7fb100108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 --2- 172.21.15.99:0/2166041818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100102150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 --2- 172.21.15.99:0/2166041818 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb100100ad0 0x7fb100100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 -- 172.21.15.99:0/2166041818 >> 172.21.15.99:0/2166041818 conn(0x7fb1000fc280 msgr2=0x7fb1000fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 -- 172.21.15.99:0/2166041818 shutdown_connections 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.600+0000 7fb10814d640 1 -- 172.21.15.99:0/2166041818 wait complete. 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 Processor -- start 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 -- start start 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb100100ad0 0x7fb10010b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 0x7fb100109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb10010d880 con 0x7fb100100ad0 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb10010d700 con 0x7fb100101cd0 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb10814d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb10010da00 con 0x7fb100102690 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb1056e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:40.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb1056e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44326/0 (socket says 172.21.15.99:44326) 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb1056e8640 1 -- 172.21.15.99:0/524358790 learned_addr learned my addr 172.21.15.99:0/524358790 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb105ee9640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb100100ad0 0x7fb10010b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.601+0000 7fb1066ea640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 0x7fb100109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1056e8640 1 -- 172.21.15.99:0/524358790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 msgr2=0x7fb100109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1056e8640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 0x7fb100109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1056e8640 1 -- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb100100ad0 msgr2=0x7fb10010b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1056e8640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb100100ad0 0x7fb10010b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1056e8640 1 -- 172.21.15.99:0/524358790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10010a8a0 con 0x7fb100101cd0 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1066ea640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 0x7fb100109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:40.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb1056e8640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100109aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009230 tx=0x7fb0f0031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f003f030 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1001a1fe0 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f0003ad0 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0035070 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.602+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1001a2430 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.603+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb100107ed0 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.604+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb0f0042030 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.605+0000 7fb0f6ffd640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0ec0a32c0 0x7fb0ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.605+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6261+0+0 (secure 0 0 0) 0x7fb0f00efa10 con 0x7fb100101cd0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.605+0000 7fb105ee9640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0ec0a32c0 0x7fb0ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.606+0000 7fb105ee9640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0ec0a32c0 0x7fb0ec0a5780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb100101b30 tx=0x7fb0fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:40.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.608+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0f00bcf30 con 0x7fb100101cd0 2024-09-19T09:14:40.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.712 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:40 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:40.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:40 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:40.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:14:40.784+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb100062630 con 0x7fb0ec0a32c0 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi046 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] boot 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:41.456 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:41.457 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:41.457 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:41.457 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi046 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] boot 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:41.713 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:41.714 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:41.714 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi046 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi046 to 4273M 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: osd.9 [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] boot 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:14:41.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:14:41.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:42.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:42 smithi099 ceph-mon[35256]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:42.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:42 smithi099 ceph-mon[35256]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T09:14:42.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:42 smithi115 ceph-mon[35055]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:42.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:42 smithi115 ceph-mon[35055]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T09:14:42.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:42 smithi046 ceph-mon[31203]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:14:42.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:42 smithi046 ceph-mon[31203]: osdmap e64: 10 total, 10 up, 10 in 2024-09-19T09:14:43.701 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:43 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/3846039221' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]: dispatch 2024-09-19T09:14:43.701 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:43 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]: dispatch 2024-09-19T09:14:43.701 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:43 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]': finished 2024-09-19T09:14:43.701 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:43 smithi099 ceph-mon[35256]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:14:43.701 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:43 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:14:43.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:43 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/3846039221' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]: dispatch 2024-09-19T09:14:43.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:43 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]: dispatch 2024-09-19T09:14:43.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:43 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]': finished 2024-09-19T09:14:43.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:43 smithi115 ceph-mon[35055]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:14:43.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:43 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:14:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:43 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/3846039221' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]: dispatch 2024-09-19T09:14:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:43 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]: dispatch 2024-09-19T09:14:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:43 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1b83e9f-8b11-4023-a6e3-476b8c9a2651"}]': finished 2024-09-19T09:14:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:43 smithi046 ceph-mon[31203]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:14:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:43 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:14:44.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:44 smithi115 ceph-mon[35055]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:44.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:44 smithi115 ceph-mon[35055]: from='client.? 172.21.15.99:0/1252954039' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:44.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:44 smithi046 ceph-mon[31203]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:44.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:44 smithi046 ceph-mon[31203]: from='client.? 172.21.15.99:0/1252954039' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:44.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:44 smithi099 ceph-mon[35256]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:44.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:44 smithi099 ceph-mon[35256]: from='client.? 172.21.15.99:0/1252954039' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:14:46.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:46 smithi115 ceph-mon[35055]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:46.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:46 smithi046 ceph-mon[31203]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:46.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:46 smithi099 ceph-mon[35256]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:48.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:48 smithi115 ceph-mon[35055]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:48.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:48 smithi046 ceph-mon[31203]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:48.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:48 smithi099 ceph-mon[35256]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:50.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:50 smithi115 ceph-mon[35055]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:50.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:50 smithi046 ceph-mon[31203]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:50.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:50 smithi099 ceph-mon[35256]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:52.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:52 smithi115 ceph-mon[35055]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:52.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:14:52.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:52.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:52 smithi115 ceph-mon[35055]: Deploying daemon osd.10 on smithi099 2024-09-19T09:14:52.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:52 smithi046 ceph-mon[31203]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:52.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:14:52.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:52.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:52 smithi046 ceph-mon[31203]: Deploying daemon osd.10 on smithi099 2024-09-19T09:14:52.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:52 smithi099 ceph-mon[35256]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:52.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:14:52.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:14:52.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:52 smithi099 ceph-mon[35256]: Deploying daemon osd.10 on smithi099 2024-09-19T09:14:54.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:54 smithi115 ceph-mon[35055]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:54.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:54 smithi046 ceph-mon[31203]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:54.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:54 smithi099 ceph-mon[35256]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:56.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:56 smithi115 ceph-mon[35055]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:56.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:56 smithi046 ceph-mon[31203]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:56.741 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:56 smithi099 ceph-mon[35256]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:57.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:57 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:57.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:57 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:57.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:57 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:57.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:57.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:57.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:57 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:57.739 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:57 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:14:57.739 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:57 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:57.739 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:57 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:14:58.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:14:58 smithi115 ceph-mon[35055]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:58.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:14:58 smithi046 ceph-mon[31203]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:14:58.746 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:14:58 smithi099 ceph-mon[35256]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:00.702 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:00 smithi099 ceph-mon[35256]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:00.702 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.702 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.702 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:00.702 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:00.703 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:00 smithi115 ceph-mon[35055]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:00.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:00.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:00.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:00 smithi046 ceph-mon[31203]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:00.740 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 10 on host 'smithi099' 2024-09-19T09:15:00.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.739+0000 7fb0f6ffd640 1 -- 172.21.15.99:0/524358790 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb100062630 con 0x7fb0ec0a32c0 2024-09-19T09:15:00.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.741+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0ec0a32c0 msgr2=0x7fb0ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:00.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.741+0000 7fb10814d640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0ec0a32c0 0x7fb0ec0a5780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb100101b30 tx=0x7fb0fc005f90 comp rx=0 tx=0).stop 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.741+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 msgr2=0x7fb100109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.741+0000 7fb10814d640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100109aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0009230 tx=0x7fb0f0031b60 comp rx=0 tx=0).stop 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.741+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 shutdown_connections 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb0ec0a32c0 0x7fb0ec0a5780 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb100102690 0x7fb100109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb100101cd0 0x7fb100109aa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 --2- 172.21.15.99:0/524358790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb100100ad0 0x7fb10010b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:00.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 >> 172.21.15.99:0/524358790 conn(0x7fb1000fc280 msgr2=0x7fb1001050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:00.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 shutdown_connections 2024-09-19T09:15:00.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T09:15:00.742+0000 7fb10814d640 1 -- 172.21.15.99:0/524358790 wait complete. 2024-09-19T09:15:01.375 DEBUG:teuthology.orchestra.run.smithi099:osd.10> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T09:15:01.378 INFO:tasks.cephadm:Deploying osd.11 on smithi115 with /dev/vg_nvme/lv_1... 2024-09-19T09:15:01.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:15:01.634 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:15:01.687 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:01 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:01.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:01 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:01.688 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:01 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:01.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:01 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:01.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:01 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:01.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:01 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:01.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:01 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:01 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:01.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:01 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:02.834 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:02 smithi099 ceph-mon[35256]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:03.011 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:02 smithi115 ceph-mon[35055]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:03.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:02 smithi046 ceph-mon[31203]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:03.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:03 smithi115 ceph-mon[35055]: from='osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:15:03.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:03 smithi115 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:15:03.963 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:03 smithi099 ceph-mon[35256]: from='osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:15:03.963 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:03 smithi099 ceph-mon[35256]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:15:03.964 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:15:03 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:15:03.611+0000 7f83fa93a640 -1 osd.10 0 log_to_monitors true 2024-09-19T09:15:04.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:03 smithi046 ceph-mon[31203]: from='osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:15:04.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:03 smithi046 ceph-mon[31203]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:15:04.391 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-19T09:15:04.417 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_1 2024-09-19T09:15:04.678 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:15:05.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:15:04.760+0000 7f83f68bd640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T09:15:05.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:15:04.771+0000 7f83f26e5640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:15:05.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:05.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:15:05.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:15:05.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.015 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.015 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:05.015 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:05.015 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:04 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.085 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:05.085 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:15:05.085 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:15:05.085 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:05.086 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:04 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 -- 172.21.15.115:0/571362149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 msgr2=0x7fce5010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 --2- 172.21.15.115:0/571362149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce5010a050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce48009ca0 tx=0x7fce4802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 -- 172.21.15.115:0/571362149 shutdown_connections 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 --2- 172.21.15.115:0/571362149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce501037c0 0x7fce5010a050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 --2- 172.21.15.115:0/571362149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50102e00 0x7fce50103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 --2- 172.21.15.115:0/571362149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce50101c00 0x7fce50102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 -- 172.21.15.115:0/571362149 >> 172.21.15.115:0/571362149 conn(0x7fce500fd390 msgr2=0x7fce500ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 -- 172.21.15.115:0/571362149 shutdown_connections 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.168+0000 7fce54fe3640 1 -- 172.21.15.115:0/571362149 wait complete. 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 Processor -- start 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 -- start start 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50101c00 0x7fce50075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 0x7fce500745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce501037c0 0x7fce50074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce5010d860 con 0x7fce501037c0 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fce5010d6e0 con 0x7fce50101c00 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce54fe3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fce5010d9e0 con 0x7fce50102e00 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 0x7fce500745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 0x7fce500745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:55934/0 (socket says 172.21.15.115:55934) 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 -- 172.21.15.115:0/1996271301 learned_addr learned my addr 172.21.15.115:0/1996271301 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4ed9d640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce501037c0 0x7fce50074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4e59c640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50101c00 0x7fce50075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 -- 172.21.15.115:0/1996271301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50101c00 msgr2=0x7fce50075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50101c00 0x7fce50075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 -- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce501037c0 msgr2=0x7fce50074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce501037c0 0x7fce50074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4dd9b640 1 -- 172.21.15.115:0/1996271301 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce500753e0 con 0x7fce50102e00 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.169+0000 7fce4e59c640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50101c00 0x7fce50075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.170+0000 7fce4dd9b640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 0x7fce500745e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c920 tx=0x7fce4000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.170+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40007c70 con 0x7fce50102e00 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.170+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce40007e10 con 0x7fce50102e00 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.170+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce501a1f60 con 0x7fce50102e00 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.170+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40018890 con 0x7fce50102e00 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.170+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce501a23c0 con 0x7fce50102e00 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.171+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce50108f30 con 0x7fce50102e00 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.172+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fce40018a70 con 0x7fce50102e00 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.173+0000 7fce3f7fe640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fce380a3240 0x7fce380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.173+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7fce400cf3c0 con 0x7fce50102e00 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.173+0000 7fce4e59c640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fce380a3240 0x7fce380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.173+0000 7fce4e59c640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fce380a3240 0x7fce380a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce50102c60 tx=0x7fce44005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.177+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce40014030 con 0x7fce50102e00 2024-09-19T09:15:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:15:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:15:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:15:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:05.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:04 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:05.356 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:05.356+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fce50062630 con 0x7fce380a3240 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi099 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi099 to 4272M 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:06.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:06.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:06.046 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi099 2024-09-19T09:15:06.046 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi099 to 4272M 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:06.047 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:06.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi099 2024-09-19T09:15:06.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi099 to 4272M 2024-09-19T09:15:06.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T09:15:06.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:15:06.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:06.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:06.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:15:06.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:15:06.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] boot 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T09:15:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:06 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] boot 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T09:15:07.126 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:06 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:07.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:15:07.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:15:07.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:15:07.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:07.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:07.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: osd.10 [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] boot 2024-09-19T09:15:07.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T09:15:07.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:06 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:15:08.129 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:07 smithi115 ceph-mon[35055]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:15:08.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:07 smithi046 ceph-mon[31203]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:15:08.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:07 smithi099 ceph-mon[35256]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:15:09.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:09.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T09:15:09.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/3422066667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]: dispatch 2024-09-19T09:15:09.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]: dispatch 2024-09-19T09:15:09.164 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]': finished 2024-09-19T09:15:09.165 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:15:09.165 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:09.165 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:08 smithi099 ceph-mon[35256]: from='client.? 172.21.15.115:0/809993321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:09.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/3422066667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]: dispatch 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]: dispatch 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]': finished 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:09.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:08 smithi115 ceph-mon[35055]: from='client.? 172.21.15.115:0/809993321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:09.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: pgmap v228: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: osdmap e70: 11 total, 11 up, 11 in 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/3422066667' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]: dispatch 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]: dispatch 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a61643cd-2ec2-494a-8e81-68fd46d421e9"}]': finished 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:09.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:08 smithi046 ceph-mon[31203]: from='client.? 172.21.15.115:0/809993321' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:15:10.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:09 smithi115 ceph-mon[35055]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:15:10.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:10.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:09 smithi115 ceph-mon[35055]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:10.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:09 smithi046 ceph-mon[31203]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:15:10.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:10.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:09 smithi046 ceph-mon[31203]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:10.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:09 smithi099 ceph-mon[35256]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:15:10.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:10.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:09 smithi099 ceph-mon[35256]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 310 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:10 smithi115 ceph-mon[35055]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:15:11.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:10 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:10 smithi046 ceph-mon[31203]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:15:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:10 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:11.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:10 smithi099 ceph-mon[35256]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:15:11.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:10 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:12.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:11 smithi115 ceph-mon[35055]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:15:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:11 smithi046 ceph-mon[31203]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:15:12.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:11 smithi099 ceph-mon[35256]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:15:14.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:13 smithi115 ceph-mon[35055]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T09:15:14.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:13 smithi099 ceph-mon[35256]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T09:15:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:13 smithi046 ceph-mon[31203]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T09:15:16.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:15 smithi099 ceph-mon[35256]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T09:15:16.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:15 smithi115 ceph-mon[35055]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T09:15:16.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:15 smithi046 ceph-mon[31203]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T09:15:17.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:15:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:16 smithi099 ceph-mon[35256]: Deploying daemon osd.11 on smithi115 2024-09-19T09:15:17.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:15:17.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:17.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:16 smithi115 ceph-mon[35055]: Deploying daemon osd.11 on smithi115 2024-09-19T09:15:17.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:15:17.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:17.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:16 smithi046 ceph-mon[31203]: Deploying daemon osd.11 on smithi115 2024-09-19T09:15:18.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:18 smithi115 ceph-mon[35055]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:15:18.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:18 smithi099 ceph-mon[35256]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:15:18.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:17 smithi046 ceph-mon[31203]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:15:20.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:20 smithi115 ceph-mon[35055]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:15:20.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:20 smithi099 ceph-mon[35256]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:15:20.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:20 smithi046 ceph-mon[31203]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:15:22.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:22 smithi115 ceph-mon[35055]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:15:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:22 smithi099 ceph-mon[35256]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:15:22.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:22 smithi046 ceph-mon[31203]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:15:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:23 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:23.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:23.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:23.350 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:23 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:23.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:23 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:24.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:24 smithi099 ceph-mon[35256]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:24.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:24 smithi115 ceph-mon[35055]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:24.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:24 smithi046 ceph-mon[31203]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:26.124 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.123+0000 7fce3f7fe640 1 -- 172.21.15.115:0/1996271301 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fce50062630 con 0x7fce380a3240 2024-09-19T09:15:26.124 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 11 on host 'smithi115' 2024-09-19T09:15:26.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fce380a3240 msgr2=0x7fce380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fce380a3240 0x7fce380a5700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fce50102c60 tx=0x7fce44005e70 comp rx=0 tx=0).stop 2024-09-19T09:15:26.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 msgr2=0x7fce500745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 0x7fce500745e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c920 tx=0x7fce4000cde0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.126 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 shutdown_connections 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fce380a3240 0x7fce380a5700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce501037c0 0x7fce50074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fce50102e00 0x7fce500745e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.125+0000 7fce54fe3640 1 --2- 172.21.15.115:0/1996271301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce50101c00 0x7fce50075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.126+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 >> 172.21.15.115:0/1996271301 conn(0x7fce500fd390 msgr2=0x7fce50106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.126+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 shutdown_connections 2024-09-19T09:15:26.127 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:26.126+0000 7fce54fe3640 1 -- 172.21.15.115:0/1996271301 wait complete. 2024-09-19T09:15:26.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:26 smithi099 ceph-mon[35256]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:26.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:26 smithi115 ceph-mon[35055]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:26.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:26 smithi046 ceph-mon[31203]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:27.043 DEBUG:teuthology.orchestra.run.smithi115:osd.11> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T09:15:27.045 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T09:15:27.046 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:15:27.315 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:27.437 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:27 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:27.437 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:27 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:27.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:27 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:27.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:27 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:27.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:27 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:27.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:27 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:27.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.839+0000 7f656e132640 1 -- 172.21.15.46:0/350084901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568107960 msgr2=0x7f6568109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 --2- 172.21.15.46:0/350084901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568107960 0x7f6568109d50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6560009ca0 tx=0x7f656002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 -- 172.21.15.46:0/350084901 shutdown_connections 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 --2- 172.21.15.46:0/350084901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568107960 0x7f6568109d50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 --2- 172.21.15.46:0/350084901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6568105030 0x7f6568107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 --2- 172.21.15.46:0/350084901 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568102700 0x7f6568104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 -- 172.21.15.46:0/350084901 >> 172.21.15.46:0/350084901 conn(0x7f65680fc280 msgr2=0x7f65680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 -- 172.21.15.46:0/350084901 shutdown_connections 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 -- 172.21.15.46:0/350084901 wait complete. 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.840+0000 7f656e132640 1 Processor -- start 2024-09-19T09:15:27.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 -- start start 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 0x7f6568102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568105030 0x7f65681006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6568107960 0x7f6568100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f656810d880 con 0x7f6568102700 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f656810d700 con 0x7f6568107960 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f656e132640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f656810da00 con 0x7f6568105030 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 0x7f6568102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 0x7f6568102060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32928/0 (socket says 172.21.15.46:32928) 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f6566ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568105030 0x7f65681006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 -- 172.21.15.46:0/4041756174 learned_addr learned my addr 172.21.15.46:0/4041756174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:27.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f6567fff640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6568107960 0x7f6568100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 -- 172.21.15.46:0/4041756174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568105030 msgr2=0x7f65681006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568105030 0x7f65681006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 -- 172.21.15.46:0/4041756174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6568107960 msgr2=0x7f6568100bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6568107960 0x7f6568100bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f65677fe640 1 -- 172.21.15.46:0/4041756174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65681014b0 con 0x7f6568102700 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.841+0000 7f6566ffd640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568105030 0x7f65681006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.842+0000 7f65677fe640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 0x7f6568102060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f655800d770 tx=0x7f655800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.842+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558017070 con 0x7f6568102700 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.842+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65681a2060 con 0x7f6568102700 2024-09-19T09:15:27.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.842+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6558005500 con 0x7f6568102700 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.842+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558004e00 con 0x7f6568102700 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.842+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65681a2520 con 0x7f6568102700 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.843+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65680fdd70 con 0x7f6568102700 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.845+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6558004fa0 con 0x7f6568102700 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.846+0000 7f6564ff9640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65500a3240 0x7f65500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.846+0000 7f6566ffd640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65500a3240 0x7f65500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.846+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6809+0+0 (secure 0 0 0) 0x7f65580cf100 con 0x7f6568102700 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.846+0000 7f6566ffd640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65500a3240 0x7f65500a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6568101de0 tx=0x7f655c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:27.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:27.849+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f655809bd10 con 0x7f6568102700 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.026+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6568062df0 con 0x7f6568102700 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.027+0000 7f6564ff9640 1 -- 172.21.15.46:0/4041756174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f65580a0010 con 0x7f6568102700 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:28.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65500a3240 msgr2=0x7f65500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65500a3240 0x7f65500a5700 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6568101de0 tx=0x7f655c00b390 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 msgr2=0x7f6568102060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 0x7f6568102060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f655800d770 tx=0x7f655800dc30 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 shutdown_connections 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65500a3240 0x7f65500a5700 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6568107960 0x7f6568100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6568105030 0x7f65681006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 --2- 172.21.15.46:0/4041756174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6568102700 0x7f6568102060 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 >> 172.21.15.46:0/4041756174 conn(0x7f65680fc280 msgr2=0x7f6568102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 shutdown_connections 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:28.029+0000 7f656e132640 1 -- 172.21.15.46:0/4041756174 wait complete. 2024-09-19T09:15:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:28 smithi046 ceph-mon[31203]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:28.480 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:28 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4041756174' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:28.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:28 smithi099 ceph-mon[35256]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:28.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:28.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:28.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:28 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4041756174' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:28.660 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:28 smithi115 ceph-mon[35055]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:28.661 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:28.661 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:28.661 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:28 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4041756174' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:28.831 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726737305,"num_in_osds":12,"osd_in_since":1726737307,"num_remapped_pgs":0} 2024-09-19T09:15:29.209 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:15:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:15:28.939+0000 7f369ca6d640 -1 osd.11 0 log_to_monitors true 2024-09-19T09:15:29.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:29 smithi046 ceph-mon[31203]: from='osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:15:29.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:29 smithi046 ceph-mon[31203]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:15:29.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:29 smithi099 ceph-mon[35256]: from='osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:15:29.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:29 smithi099 ceph-mon[35256]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:15:29.693 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:29 smithi115 ceph-mon[35055]: from='osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:15:29.693 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:29 smithi115 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:15:29.833 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:15:30.104 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:30.389 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-mon[35055]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:30.389 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:15:30.389 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-mon[35055]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:15:30.389 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:30.390 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-mon[35055]: from='osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:15:30.390 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:15:30.390 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:15:30.236+0000 7f36989f0640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T09:15:30.390 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:15:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:15:30.247+0000 7f3694818640 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:15:30.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:30 smithi046 ceph-mon[31203]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:30.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:30 smithi046 ceph-mon[31203]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:15:30.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:30 smithi046 ceph-mon[31203]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:15:30.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:30.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:30 smithi046 ceph-mon[31203]: from='osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:15:30.477 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:30 smithi046 ceph-mon[31203]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:15:30.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:30 smithi099 ceph-mon[35256]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:30.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:30 smithi099 ceph-mon[35256]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:15:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:30 smithi099 ceph-mon[35256]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:15:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:30 smithi099 ceph-mon[35256]: from='osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:15:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:30 smithi099 ceph-mon[35256]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 -- 172.21.15.46:0/2561514455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c102700 msgr2=0x7f4b6c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2561514455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c102700 0x7f4b6c104af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009900 tx=0x7f4b5c02a410 comp rx=0 tx=0).stop 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 -- 172.21.15.46:0/2561514455 shutdown_connections 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2561514455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c107960 0x7f4b6c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2561514455 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c105030 0x7f4b6c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2561514455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c102700 0x7f4b6c104af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 -- 172.21.15.46:0/2561514455 >> 172.21.15.46:0/2561514455 conn(0x7f4b6c0fc2a0 msgr2=0x7f4b6c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 -- 172.21.15.46:0/2561514455 shutdown_connections 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.691+0000 7f4b726f8640 1 -- 172.21.15.46:0/2561514455 wait complete. 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 Processor -- start 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 -- start start 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c102700 0x7f4b6c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 0x7f4b6c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c107960 0x7f4b6c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c10d920 con 0x7f4b6c105030 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c10d7a0 con 0x7f4b6c107960 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b726f8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c10daa0 con 0x7f4b6c102700 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 0x7f4b6c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 0x7f4b6c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37398/0 (socket says 172.21.15.46:37398) 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 -- 172.21.15.46:0/2169486934 learned_addr learned my addr 172.21.15.46:0/2169486934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c102700 0x7f4b6c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b70c95640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c107960 0x7f4b6c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 -- 172.21.15.46:0/2169486934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c102700 msgr2=0x7f4b6c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c102700 0x7f4b6c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 -- 172.21.15.46:0/2169486934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c107960 msgr2=0x7f4b6c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c107960 0x7f4b6c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6b7fe640 1 -- 172.21.15.46:0/2169486934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c19fbd0 con 0x7f4b6c105030 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.692+0000 7f4b6bfff640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c102700 0x7f4b6c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.693+0000 7f4b6b7fe640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 0x7f4b6c1984e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000d770 tx=0x7f4b6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.693+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60017070 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.693+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b60009c30 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.693+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c19fec0 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.693+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000f620 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.693+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c1a03f0 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.694+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c0fdd90 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.695+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4b6001a070 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.696+0000 7f4b697fa640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b540a3270 0x7f4b540a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.696+0000 7f4b6bfff640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b540a3270 0x7f4b540a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.696+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6847+0+0 (secure 0 0 0) 0x7f4b600cee30 con 0x7f4b6c105030 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.696+0000 7f4b6bfff640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b540a3270 0x7f4b540a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0314e0 tx=0x7f4b5c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.700+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b6009ba20 con 0x7f4b6c105030 2024-09-19T09:15:30.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.878+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4b6c062e90 con 0x7f4b6c105030 2024-09-19T09:15:30.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.878+0000 7f4b697fa640 1 -- 172.21.15.46:0/2169486934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f4b6009fd20 con 0x7f4b6c105030 2024-09-19T09:15:30.879 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b540a3270 msgr2=0x7f4b540a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b540a3270 0x7f4b540a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0314e0 tx=0x7f4b5c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 msgr2=0x7f4b6c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 0x7f4b6c1984e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000d770 tx=0x7f4b6000dc30 comp rx=0 tx=0).stop 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 shutdown_connections 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b540a3270 0x7f4b540a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b6c105030 0x7f4b6c1984e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b6c107960 0x7f4b6c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 --2- 172.21.15.46:0/2169486934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b6c102700 0x7f4b6c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 >> 172.21.15.46:0/2169486934 conn(0x7f4b6c0fc2a0 msgr2=0x7f4b6c102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 shutdown_connections 2024-09-19T09:15:30.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:30.882+0000 7f4b726f8640 1 -- 172.21.15.46:0/2169486934 wait complete. 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: Detected new or changed devices on smithi115 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:31 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2169486934' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: Detected new or changed devices on smithi115 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:31 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2169486934' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-19T09:15:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T09:15:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:31.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: Detected new or changed devices on smithi115 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-19T09:15:31.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:31.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:31 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2169486934' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:31.807 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726737305,"num_in_osds":12,"osd_in_since":1726737307,"num_remapped_pgs":0} 2024-09-19T09:15:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:32 smithi099 ceph-mon[35256]: purged_snaps scrub starts 2024-09-19T09:15:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:32 smithi099 ceph-mon[35256]: purged_snaps scrub ok 2024-09-19T09:15:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:32 smithi099 ceph-mon[35256]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:32 smithi099 ceph-mon[35256]: osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] boot 2024-09-19T09:15:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:32 smithi099 ceph-mon[35256]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:15:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:32.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:32 smithi115 ceph-mon[35055]: purged_snaps scrub starts 2024-09-19T09:15:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:32 smithi115 ceph-mon[35055]: purged_snaps scrub ok 2024-09-19T09:15:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:32 smithi115 ceph-mon[35055]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:32 smithi115 ceph-mon[35055]: osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] boot 2024-09-19T09:15:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:32 smithi115 ceph-mon[35055]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:15:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:32 smithi046 ceph-mon[31203]: purged_snaps scrub starts 2024-09-19T09:15:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:32 smithi046 ceph-mon[31203]: purged_snaps scrub ok 2024-09-19T09:15:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:32 smithi046 ceph-mon[31203]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:15:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:32 smithi046 ceph-mon[31203]: osd.11 [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] boot 2024-09-19T09:15:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:32 smithi046 ceph-mon[31203]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:15:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:15:32.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:15:33.076 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:33.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 -- 172.21.15.46:0/3628774826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001078c0 msgr2=0x7f5000109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 --2- 172.21.15.46:0/3628774826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001078c0 0x7f5000109d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009ca0 tx=0x7f4ff802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 -- 172.21.15.46:0/3628774826 shutdown_connections 2024-09-19T09:15:33.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 --2- 172.21.15.46:0/3628774826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001078c0 0x7f5000109d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 --2- 172.21.15.46:0/3628774826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000104f90 0x7f5000107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 --2- 172.21.15.46:0/3628774826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 0x7f5000104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 -- 172.21.15.46:0/3628774826 >> 172.21.15.46:0/3628774826 conn(0x7f50000fc280 msgr2=0x7f50000fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:33.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 -- 172.21.15.46:0/3628774826 shutdown_connections 2024-09-19T09:15:33.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.587+0000 7f5004f3c640 1 -- 172.21.15.46:0/3628774826 wait complete. 2024-09-19T09:15:33.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 Processor -- start 2024-09-19T09:15:33.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 -- start start 2024-09-19T09:15:33.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 0x7f5000197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 0x7f50001983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50001078c0 0x7f500019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f500010d860 con 0x7f5000104f90 2024-09-19T09:15:33.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f500010d6e0 con 0x7f50001078c0 2024-09-19T09:15:33.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f5004f3c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f500010d9e0 con 0x7f5000102660 2024-09-19T09:15:33.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f4ffdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 0x7f50001983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f4ffdd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 0x7f50001983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37428/0 (socket says 172.21.15.46:37428) 2024-09-19T09:15:33.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f4ffdd9b640 1 -- 172.21.15.46:0/2804913594 learned_addr learned my addr 172.21.15.46:0/2804913594 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:33.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f4ffe59c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 0x7f5000197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.588+0000 7f4ffed9d640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50001078c0 0x7f500019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffdd9b640 1 -- 172.21.15.46:0/2804913594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 msgr2=0x7f5000197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffdd9b640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 0x7f5000197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffdd9b640 1 -- 172.21.15.46:0/2804913594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50001078c0 msgr2=0x7f500019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffdd9b640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50001078c0 0x7f500019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffdd9b640 1 -- 172.21.15.46:0/2804913594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500019fae0 con 0x7f5000104f90 2024-09-19T09:15:33.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffe59c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 0x7f5000197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:33.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffed9d640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50001078c0 0x7f500019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:33.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4ffdd9b640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 0x7f50001983f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400d770 tx=0x7f4ff400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:33.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4017070 con 0x7f5000104f90 2024-09-19T09:15:33.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff4009c30 con 0x7f5000104f90 2024-09-19T09:15:33.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400f620 con 0x7f5000104f90 2024-09-19T09:15:33.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500019fdd0 con 0x7f5000104f90 2024-09-19T09:15:33.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.589+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50001a0280 con 0x7f5000104f90 2024-09-19T09:15:33.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.590+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50000fdd70 con 0x7f5000104f90 2024-09-19T09:15:33.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.591+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4ff401a070 con 0x7f5000104f90 2024-09-19T09:15:33.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.592+0000 7f4fef7fe640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fe80a3270 0x7f4fe80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.592+0000 7f4ffe59c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fe80a3270 0x7f4fe80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.592+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f4ff40cf010 con 0x7f5000104f90 2024-09-19T09:15:33.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.592+0000 7f4ffe59c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fe80a3270 0x7f4fe80a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00058c0 tx=0x7f4ff0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:33.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.596+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ff409c1d0 con 0x7f5000104f90 2024-09-19T09:15:33.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:33 smithi046 ceph-mon[31203]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:15:33.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.775+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f500002da10 con 0x7f5000104f90 2024-09-19T09:15:33.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.775+0000 7f4fef7fe640 1 -- 172.21.15.46:0/2804913594 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f4ff4084e20 con 0x7f5000104f90 2024-09-19T09:15:33.776 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fe80a3270 msgr2=0x7f4fe80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fe80a3270 0x7f4fe80a5730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00058c0 tx=0x7f4ff0005850 comp rx=0 tx=0).stop 2024-09-19T09:15:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 msgr2=0x7f50001983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 0x7f50001983f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400d770 tx=0x7f4ff400dc30 comp rx=0 tx=0).stop 2024-09-19T09:15:33.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 shutdown_connections 2024-09-19T09:15:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fe80a3270 0x7f4fe80a5730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5000104f90 0x7f50001983f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50001078c0 0x7f500019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 --2- 172.21.15.46:0/2804913594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5000102660 0x7f5000197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 >> 172.21.15.46:0/2804913594 conn(0x7f50000fc280 msgr2=0x7f5000102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 shutdown_connections 2024-09-19T09:15:33.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:33.777+0000 7f5004f3c640 1 -- 172.21.15.46:0/2804913594 wait complete. 2024-09-19T09:15:33.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:33 smithi115 ceph-mon[35055]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:15:34.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:33 smithi099 ceph-mon[35256]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1726737331,"num_in_osds":12,"osd_in_since":1726737307,"num_remapped_pgs":0} 2024-09-19T09:15:34.451 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:15:34.707 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:34.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:34 smithi046 ceph-mon[31203]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:34.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:34 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2804913594' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:34.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:34 smithi115 ceph-mon[35055]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:34.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:34 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2804913594' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:35.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:34 smithi099 ceph-mon[35256]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:35.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:34 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2804913594' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:15:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 -- 172.21.15.46:0/2778437353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51410c170 msgr2=0x7fc51410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 --2- 172.21.15.46:0/2778437353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51410c170 0x7fc51410e610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009ca0 tx=0x7fc50c02a950 comp rx=0 tx=0).stop 2024-09-19T09:15:35.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 -- 172.21.15.46:0/2778437353 shutdown_connections 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 --2- 172.21.15.46:0/2778437353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc51410c170 0x7fc51410e610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 --2- 172.21.15.46:0/2778437353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 0x7fc51410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 --2- 172.21.15.46:0/2778437353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc514102d40 0x7fc514103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 -- 172.21.15.46:0/2778437353 >> 172.21.15.46:0/2778437353 conn(0x7fc5140fc7a0 msgr2=0x7fc5140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 -- 172.21.15.46:0/2778437353 shutdown_connections 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.181+0000 7fc51a843640 1 -- 172.21.15.46:0/2778437353 wait complete. 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 Processor -- start 2024-09-19T09:15:35.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 -- start start 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 0x7fc514198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 0x7fc514198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc51410c170 0x7fc51419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc514111f70 con 0x7fc514102d40 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc514111df0 con 0x7fc514103660 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.182+0000 7fc51a843640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc5141120f0 con 0x7fc51410c170 2024-09-19T09:15:35.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 0x7fc514198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 0x7fc514198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37448/0 (socket says 172.21.15.46:37448) 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 -- 172.21.15.46:0/4056771551 learned_addr learned my addr 172.21.15.46:0/4056771551 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc518de0640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc51410c170 0x7fc51419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc5137fe640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 0x7fc514198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 -- 172.21.15.46:0/4056771551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc51410c170 msgr2=0x7fc51419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc51410c170 0x7fc51419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 -- 172.21.15.46:0/4056771551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 msgr2=0x7fc514198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 0x7fc514198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 -- 172.21.15.46:0/4056771551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51419d3c0 con 0x7fc514102d40 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc5137fe640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 0x7fc514198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc513fff640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 0x7fc514198410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c970 tx=0x7fc50400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504007bb0 con 0x7fc514102d40 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc504007d50 con 0x7fc514102d40 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51419d6b0 con 0x7fc514102d40 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.183+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50400f450 con 0x7fc514102d40 2024-09-19T09:15:35.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.184+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5141a4f90 con 0x7fc514102d40 2024-09-19T09:15:35.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.185+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc514103120 con 0x7fc514102d40 2024-09-19T09:15:35.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.186+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc504005020 con 0x7fc514102d40 2024-09-19T09:15:35.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.187+0000 7fc5117fa640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc4fc0a32c0 0x7fc4fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.187+0000 7fc5137fe640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc4fc0a32c0 0x7fc4fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.187+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fc5040cf280 con 0x7fc514102d40 2024-09-19T09:15:35.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.187+0000 7fc5137fe640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc4fc0a32c0 0x7fc4fc0a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc508005fd0 tx=0x7fc508005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.191+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc504014030 con 0x7fc514102d40 2024-09-19T09:15:35.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.367+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5141a5230 con 0x7fc514102d40 2024-09-19T09:15:35.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.368+0000 7fc5117fa640 1 -- 172.21.15.46:0/4056771551 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+18434 (secure 0 0 0) 0x7fc50409c440 con 0x7fc514102d40 2024-09-19T09:15:35.369 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:35.369 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":77,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:15:32.575291+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.370+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc4fc0a32c0 msgr2=0x7fc4fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.370+0000 7fc51a843640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc4fc0a32c0 0x7fc4fc0a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc508005fd0 tx=0x7fc508005f00 comp rx=0 tx=0).stop 2024-09-19T09:15:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.370+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 msgr2=0x7fc514198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.370+0000 7fc51a843640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 0x7fc514198410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc50400c970 tx=0x7fc50400ce30 comp rx=0 tx=0).stop 2024-09-19T09:15:35.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 shutdown_connections 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc4fc0a32c0 0x7fc4fc0a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc51410c170 0x7fc51419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc514103660 0x7fc514198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 --2- 172.21.15.46:0/4056771551 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc514102d40 0x7fc514198410 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 >> 172.21.15.46:0/4056771551 conn(0x7fc5140fc7a0 msgr2=0x7fc5140fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 shutdown_connections 2024-09-19T09:15:35.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:35.371+0000 7fc51a843640 1 -- 172.21.15.46:0/4056771551 wait complete. 2024-09-19T09:15:35.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:35 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4056771551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:15:35.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:35 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4056771551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:15:36.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:35 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4056771551' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:15:36.080 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:11:45.380119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:15:36.081 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:15:36.337 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:36.709 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:36 smithi046 ceph-mon[31203]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 -- 172.21.15.46:0/3359848898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001082a0 msgr2=0x7f500010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 --2- 172.21.15.46:0/3359848898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001082a0 0x7f500010ec40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009cd0 tx=0x7f4ff802a910 comp rx=0 tx=0).stop 2024-09-19T09:15:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 -- 172.21.15.46:0/3359848898 shutdown_connections 2024-09-19T09:15:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 --2- 172.21.15.46:0/3359848898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001082a0 0x7f500010ec40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 --2- 172.21.15.46:0/3359848898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50001036e0 0x7f5000107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 --2- 172.21.15.46:0/3359848898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000102d30 0x7f5000103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 -- 172.21.15.46:0/3359848898 >> 172.21.15.46:0/3359848898 conn(0x7f50000fc7d0 msgr2=0x7f50000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 -- 172.21.15.46:0/3359848898 shutdown_connections 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 -- 172.21.15.46:0/3359848898 wait complete. 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.793+0000 7f5007a71640 1 Processor -- start 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 -- start start 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000102d30 0x7f50001a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 0x7f50001a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50001082a0 0x7f500019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5000112160 con 0x7f50001036e0 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5000111fe0 con 0x7f5000102d30 2024-09-19T09:15:36.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f5007a71640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f50001122e0 con 0x7f50001082a0 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 0x7f50001a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 0x7f50001a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37466/0 (socket says 172.21.15.46:37466) 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 -- 172.21.15.46:0/166421490 learned_addr learned my addr 172.21.15.46:0/166421490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500580d640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000102d30 0x7f50001a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500600e640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50001082a0 0x7f500019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 -- 172.21.15.46:0/166421490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50001082a0 msgr2=0x7f500019a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50001082a0 0x7f500019a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 -- 172.21.15.46:0/166421490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000102d30 msgr2=0x7f50001a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000102d30 0x7f50001a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 -- 172.21.15.46:0/166421490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500019af70 con 0x7f50001036e0 2024-09-19T09:15:36.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.794+0000 7f500500c640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 0x7f50001a0b70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006fd0 tx=0x7f4ff000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:36.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.795+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0011830 con 0x7f50001036e0 2024-09-19T09:15:36.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.795+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ff0016070 con 0x7f50001036e0 2024-09-19T09:15:36.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.795+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500019b260 con 0x7f50001036e0 2024-09-19T09:15:36.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.795+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000f2e0 con 0x7f50001036e0 2024-09-19T09:15:36.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.795+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50001a75b0 con 0x7f50001036e0 2024-09-19T09:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.796+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500006a850 con 0x7f50001036e0 2024-09-19T09:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.797+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4ff001b460 con 0x7f50001036e0 2024-09-19T09:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.798+0000 7f4ff6ffd640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fec0a32c0 0x7f4fec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.798+0000 7f500580d640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fec0a32c0 0x7f4fec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.798+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f4ff00cf2b0 con 0x7f50001036e0 2024-09-19T09:15:36.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.798+0000 7f500580d640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fec0a32c0 0x7f4fec0a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009890 tx=0x7f4ffc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:36.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.801+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ff009c3d0 con 0x7f50001036e0 2024-09-19T09:15:36.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:36 smithi115 ceph-mon[35055]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:36.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.976+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f500019bc30 con 0x7f50001036e0 2024-09-19T09:15:36.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.976+0000 7f4ff6ffd640 1 -- 172.21.15.46:0/166421490 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f4ff009bcd0 con 0x7f50001036e0 2024-09-19T09:15:36.977 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-19T09:15:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fec0a32c0 msgr2=0x7f4fec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fec0a32c0 0x7f4fec0a5780 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009890 tx=0x7f4ffc008040 comp rx=0 tx=0).stop 2024-09-19T09:15:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 msgr2=0x7f50001a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 0x7f50001a0b70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006fd0 tx=0x7f4ff000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 shutdown_connections 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4fec0a32c0 0x7f4fec0a5780 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f50001036e0 0x7f50001a0b70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f50001082a0 0x7f500019a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 --2- 172.21.15.46:0/166421490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5000102d30 0x7f50001a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 >> 172.21.15.46:0/166421490 conn(0x7f50000fc7d0 msgr2=0x7f50001014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 shutdown_connections 2024-09-19T09:15:36.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:36.979+0000 7f5007a71640 1 -- 172.21.15.46:0/166421490 wait complete. 2024-09-19T09:15:37.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:36 smithi099 ceph-mon[35256]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.a on smithi046 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.d on smithi046 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.g on smithi046 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.j on smithi046 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.b on smithi099 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.e on smithi099 2024-09-19T09:15:37.801 INFO:tasks.cephadm:Adding mds.h on smithi099 2024-09-19T09:15:37.802 INFO:tasks.cephadm:Adding mds.k on smithi099 2024-09-19T09:15:37.802 INFO:tasks.cephadm:Adding mds.c on smithi115 2024-09-19T09:15:37.802 INFO:tasks.cephadm:Adding mds.f on smithi115 2024-09-19T09:15:37.802 INFO:tasks.cephadm:Adding mds.i on smithi115 2024-09-19T09:15:37.802 INFO:tasks.cephadm:Adding mds.l on smithi115 2024-09-19T09:15:37.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l' 2024-09-19T09:15:37.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:37 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/166421490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:15:37.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:37 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/166421490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:15:38.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:37 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/166421490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:15:38.057 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 -- 172.21.15.115:0/627700659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc101c00 msgr2=0x7f78bc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 --2- 172.21.15.115:0/627700659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc101c00 0x7f78bc102000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009900 tx=0x7f78a402a410 comp rx=0 tx=0).stop 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 -- 172.21.15.115:0/627700659 shutdown_connections 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 --2- 172.21.15.115:0/627700659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78bc1037c0 0x7f78bc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 --2- 172.21.15.115:0/627700659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78bc102e00 0x7f78bc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 --2- 172.21.15.115:0/627700659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc101c00 0x7f78bc102000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 -- 172.21.15.115:0/627700659 >> 172.21.15.115:0/627700659 conn(0x7f78bc0fd390 msgr2=0x7f78bc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 -- 172.21.15.115:0/627700659 shutdown_connections 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 -- 172.21.15.115:0/627700659 wait complete. 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.524+0000 7f78c2e66640 1 Processor -- start 2024-09-19T09:15:38.543 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 -- start start 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78bc101c00 0x7f78bc197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78bc102e00 0x7f78bc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 0x7f78bc19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc10d860 con 0x7f78bc101c00 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc10d6e0 con 0x7f78bc102e00 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc10d9e0 con 0x7f78bc1037c0 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 0x7f78bc19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78bc102e00 0x7f78bc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 0x7f78bc19f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51488/0 (socket says 172.21.15.115:51488) 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 -- 172.21.15.115:0/1040371738 learned_addr learned my addr 172.21.15.115:0/1040371738 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c0c02640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78bc101c00 0x7f78bc197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:38.544 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 -- 172.21.15.115:0/1040371738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78bc102e00 msgr2=0x7f78bc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78bc102e00 0x7f78bc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 -- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78bc101c00 msgr2=0x7f78bc197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78bc101c00 0x7f78bc197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 -- 172.21.15.115:0/1040371738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc19fb40 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c1403640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 0x7f78bc19f4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78b400d750 tx=0x7f78b400dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4017070 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78b4005500 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc19fe30 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.525+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4004d90 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.526+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc1a0290 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.527+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78bc109050 con 0x7f78bc1037c0 2024-09-19T09:15:38.545 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.528+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f78b4004f30 con 0x7f78bc1037c0 2024-09-19T09:15:38.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.528+0000 7f78b9ffb640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f78a80a3270 0x7f78a80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:38.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.529+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f78b40ced70 con 0x7f78bc1037c0 2024-09-19T09:15:38.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.529+0000 7f78c0c02640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f78a80a3270 0x7f78a80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:38.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.529+0000 7f78c0c02640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f78a80a3270 0x7f78a80a5730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78a4005ab0 tx=0x7f78a4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:38.546 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.533+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78b409b8e0 con 0x7f78bc1037c0 2024-09-19T09:15:38.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:38 smithi115 ceph-mon[35055]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:38.711 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.709+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l", "target": ["mon-mgr", ""]}) -- 0x7f78bc0627f0 con 0x7f78a80a3270 2024-09-19T09:15:38.718 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.717+0000 7f78b9ffb640 1 -- 172.21.15.115:0/1040371738 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f78bc0627f0 con 0x7f78a80a3270 2024-09-19T09:15:38.719 INFO:teuthology.orchestra.run.smithi115.stdout:Scheduled mds.all update... 2024-09-19T09:15:38.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f78a80a3270 msgr2=0x7f78a80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:38.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f78a80a3270 0x7f78a80a5730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78a4005ab0 tx=0x7f78a4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 msgr2=0x7f78bc19f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:38.721 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 0x7f78bc19f4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78b400d750 tx=0x7f78b400dc10 comp rx=0 tx=0).stop 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 shutdown_connections 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f78a80a3270 0x7f78a80a5730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f78bc1037c0 0x7f78bc19f4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f78bc102e00 0x7f78bc198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 --2- 172.21.15.115:0/1040371738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78bc101c00 0x7f78bc197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 >> 172.21.15.115:0/1040371738 conn(0x7f78bc0fd390 msgr2=0x7f78bc106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 shutdown_connections 2024-09-19T09:15:38.722 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-19T09:15:38.719+0000 7f78c2e66640 1 -- 172.21.15.115:0/1040371738 wait complete. 2024-09-19T09:15:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:38 smithi046 ceph-mon[31203]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:39.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:38 smithi099 ceph-mon[35256]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:39.471 DEBUG:teuthology.orchestra.run.smithi046:mds.a> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T09:15:40.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:40.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l;count:12 2024-09-19T09:15:40.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:40.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:40.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:40.130 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:39 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l;count:12 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:40.131 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:39 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: Saving service mds.all spec with placement smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l;count:12 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:15:40.132 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:40.133 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:15:40.133 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:40.133 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:40.133 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:40.133 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:39 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:40.174 DEBUG:teuthology.orchestra.run.smithi046:mds.d> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T09:15:40.218 DEBUG:teuthology.orchestra.run.smithi046:mds.g> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T09:15:40.262 DEBUG:teuthology.orchestra.run.smithi046:mds.j> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T09:15:40.305 DEBUG:teuthology.orchestra.run.smithi099:mds.b> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T09:15:40.308 DEBUG:teuthology.orchestra.run.smithi099:mds.e> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T09:15:40.351 DEBUG:teuthology.orchestra.run.smithi099:mds.h> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T09:15:40.396 DEBUG:teuthology.orchestra.run.smithi099:mds.k> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T09:15:40.440 DEBUG:teuthology.orchestra.run.smithi115:mds.c> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T09:15:40.445 DEBUG:teuthology.orchestra.run.smithi115:mds.f> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T09:15:40.489 DEBUG:teuthology.orchestra.run.smithi115:mds.i> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T09:15:40.533 DEBUG:teuthology.orchestra.run.smithi115:mds.l> sudo journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T09:15:40.576 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T09:15:40.577 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:15:40.834 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:40.929 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:40 smithi115 ceph-mon[35055]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:40.930 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:40 smithi115 ceph-mon[35055]: Deploying daemon mds.l on smithi115 2024-09-19T09:15:40.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:40 smithi046 ceph-mon[31203]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:40.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:40 smithi046 ceph-mon[31203]: Deploying daemon mds.l on smithi115 2024-09-19T09:15:41.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:40 smithi099 ceph-mon[35256]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:41.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:40 smithi099 ceph-mon[35256]: Deploying daemon mds.l on smithi115 2024-09-19T09:15:41.209 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 systemd[1]: Starting Ceph mds.l for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:41.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 -- 172.21.15.46:0/1384359598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102ef0 msgr2=0x7f919c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 --2- 172.21.15.46:0/1384359598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102ef0 0x7f919c10da40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9194009ca0 tx=0x7f919402a950 comp rx=0 tx=0).stop 2024-09-19T09:15:41.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 -- 172.21.15.46:0/1384359598 shutdown_connections 2024-09-19T09:15:41.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 --2- 172.21.15.46:0/1384359598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102ef0 0x7f919c10da40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 --2- 172.21.15.46:0/1384359598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f919c102570 0x7f919c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 --2- 172.21.15.46:0/1384359598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f919c100e20 0x7f919c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 -- 172.21.15.46:0/1384359598 >> 172.21.15.46:0/1384359598 conn(0x7f919c0fc7d0 msgr2=0x7f919c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 -- 172.21.15.46:0/1384359598 shutdown_connections 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 -- 172.21.15.46:0/1384359598 wait complete. 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 Processor -- start 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.284+0000 7f91a2481640 1 -- start start 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a2481640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f919c100e20 0x7f919c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a2481640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 0x7f919c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a2481640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f919c102ef0 0x7f919c1a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a2481640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f919c110f80 con 0x7f919c102570 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a2481640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f919c110e00 con 0x7f919c100e20 2024-09-19T09:15:41.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a2481640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f919c111100 con 0x7f919c102ef0 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 0x7f919c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 0x7f919c1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54660/0 (socket says 172.21.15.46:54660) 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 -- 172.21.15.46:0/2797204966 learned_addr learned my addr 172.21.15.46:0/2797204966 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919bfff640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f919c100e20 0x7f919c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f91a0a1e640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f919c102ef0 0x7f919c1a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 -- 172.21.15.46:0/2797204966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f919c102ef0 msgr2=0x7f919c1a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f919c102ef0 0x7f919c1a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 -- 172.21.15.46:0/2797204966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f919c100e20 msgr2=0x7f919c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f919c100e20 0x7f919c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.285+0000 7f919b7fe640 1 -- 172.21.15.46:0/2797204966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c1a4760 con 0x7f919c102570 2024-09-19T09:15:41.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.286+0000 7f919b7fe640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 0x7f919c1996e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f919000c920 tx=0x7f919000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.286+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190007bb0 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.286+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c1a4930 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.286+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9190007d50 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.286+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900187d0 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.286+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c1a4e40 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.287+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c101200 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.288+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f919000f450 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.289+0000 7f91997fa640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91840a3240 0x7f91840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.289+0000 7f919bfff640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91840a3240 0x7f91840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.289+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f91900cf480 con 0x7f919c102570 2024-09-19T09:15:41.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.289+0000 7f919bfff640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91840a3240 0x7f91840a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f918c00abe0 tx=0x7f918c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:41.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.293+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9190014030 con 0x7f919c102570 2024-09-19T09:15:41.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.505+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f919c1a50a0 con 0x7f919c102570 2024-09-19T09:15:41.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.505+0000 7f91997fa640 1 -- 172.21.15.46:0/2797204966 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f919009c640 con 0x7f919c102570 2024-09-19T09:15:41.506 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:41.506 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":1,"btime":"2024-09-19T09:08:41:072677+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T09:15:41.506 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 1 2024-09-19T09:15:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.507+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91840a3240 msgr2=0x7f91840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.507+0000 7f91a2481640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91840a3240 0x7f91840a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f918c00abe0 tx=0x7f918c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.507+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 msgr2=0x7f919c1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.507+0000 7f91a2481640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 0x7f919c1996e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f919000c920 tx=0x7f919000cd20 comp rx=0 tx=0).stop 2024-09-19T09:15:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 shutdown_connections 2024-09-19T09:15:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91840a3240 0x7f91840a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f919c102570 0x7f919c1996e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f919c102ef0 0x7f919c1a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 --2- 172.21.15.46:0/2797204966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f919c100e20 0x7f919c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 >> 172.21.15.46:0/2797204966 conn(0x7f919c0fc7d0 msgr2=0x7f919c105780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 shutdown_connections 2024-09-19T09:15:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:41.508+0000 7f91a2481640 1 -- 172.21.15.46:0/2797204966 wait complete. 2024-09-19T09:15:41.577 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 podman[64158]: 2024-09-19 09:15:41.225325288 +0000 UTC m=+0.015945910 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:41.577 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 podman[64158]: 2024-09-19 09:15:41.341607944 +0000 UTC m=+0.132228561 container create ddd13913a268c5c7cfc69128f44cf8f8ae94ff672cbe020ddc74e352d19c120e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:15:41.577 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 podman[64158]: 2024-09-19 09:15:41.577440592 +0000 UTC m=+0.368061212 container init ddd13913a268c5c7cfc69128f44cf8f8ae94ff672cbe020ddc74e352d19c120e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:15:41.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:41 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2797204966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:41 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6832/2187922257,v1:172.21.15.115:6833/2187922257] up:boot 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:41 smithi115 ceph-mon[35055]: fsmap 1 up:standby 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:41 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 podman[64158]: 2024-09-19 09:15:41.580445329 +0000 UTC m=+0.371065947 container start ddd13913a268c5c7cfc69128f44cf8f8ae94ff672cbe020ddc74e352d19c120e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 ceph-mds[64178]: -- 172.21.15.115:0/2530799710 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cfcd4d5860 con 0x55cfcd4b3400 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l[64174]: starting mds.l at 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 bash[64158]: ddd13913a268c5c7cfc69128f44cf8f8ae94ff672cbe020ddc74e352d19c120e 2024-09-19T09:15:41.960 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:15:41 smithi115 systemd[1]: Started Ceph mds.l for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:15:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:41 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2797204966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:41 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6832/2187922257,v1:172.21.15.115:6833/2187922257] up:boot 2024-09-19T09:15:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:41 smithi046 ceph-mon[31203]: fsmap 1 up:standby 2024-09-19T09:15:41.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:41 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:15:42.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:41 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2797204966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:42.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:41 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6832/2187922257,v1:172.21.15.115:6833/2187922257] up:boot 2024-09-19T09:15:42.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:41 smithi099 ceph-mon[35256]: fsmap 1 up:standby 2024-09-19T09:15:42.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:41 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:42.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:42 smithi099 ceph-mon[35256]: Deploying daemon mds.k on smithi099 2024-09-19T09:15:43.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:42 smithi115 ceph-mon[35055]: Deploying daemon mds.k on smithi099 2024-09-19T09:15:43.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:43.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:43.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:43.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:43.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:43.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:43.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:43.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:42 smithi046 ceph-mon[31203]: Deploying daemon mds.k on smithi099 2024-09-19T09:15:43.949 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:43 smithi099 systemd[1]: Starting Ceph mds.k for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:44.201 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:43 smithi099 podman[64093]: 2024-09-19 09:15:43.851260079 +0000 UTC m=+0.015697899 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:44.201 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:43 smithi099 podman[64093]: 2024-09-19 09:15:43.956660348 +0000 UTC m=+0.121098227 container create 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:15:44.201 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:44 smithi099 podman[64093]: 2024-09-19 09:15:44.201121046 +0000 UTC m=+0.365558856 container init 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:15:44.304 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:15:44.513 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:44 smithi099 podman[64093]: 2024-09-19 09:15:44.204173581 +0000 UTC m=+0.368611394 container start 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:15:44.513 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mds[64112]: -- 172.21.15.99:0/2779526898 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55859693f860 con 0x55859691c800 2024-09-19T09:15:44.513 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k[64108]: starting mds.k at 2024-09-19T09:15:44.513 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:44 smithi099 bash[64093]: 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee 2024-09-19T09:15:44.513 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:15:44 smithi099 systemd[1]: Started Ceph mds.k for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:15:44.587 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:44.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:44.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:44 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:45.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:45.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:45.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:45.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:45.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:45.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:45.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:44 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:45.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 -- 172.21.15.46:0/3329236356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 msgr2=0x7f65f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 --2- 172.21.15.46:0/3329236356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f01021c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009900 tx=0x7f65e002a410 comp rx=0 tx=0).stop 2024-09-19T09:15:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 -- 172.21.15.46:0/3329236356 shutdown_connections 2024-09-19T09:15:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 --2- 172.21.15.46:0/3329236356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0106f10 0x7f65f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 --2- 172.21.15.46:0/3329236356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0102790 0x7f65f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 --2- 172.21.15.46:0/3329236356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f01021c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 -- 172.21.15.46:0/3329236356 >> 172.21.15.46:0/3329236356 conn(0x7f65f00fd8c0 msgr2=0x7f65f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 -- 172.21.15.46:0/3329236356 shutdown_connections 2024-09-19T09:15:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.068+0000 7f65f4f01640 1 -- 172.21.15.46:0/3329236356 wait complete. 2024-09-19T09:15:45.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 Processor -- start 2024-09-19T09:15:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 -- start start 2024-09-19T09:15:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0102790 0x7f65f019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:45.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0106f10 0x7f65f019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0111f90 con 0x7f65f0101de0 2024-09-19T09:15:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0111e10 con 0x7f65f0102790 2024-09-19T09:15:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65f4f01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0112110 con 0x7f65f0106f10 2024-09-19T09:15:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:45.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54674/0 (socket says 172.21.15.46:54674) 2024-09-19T09:15:45.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 -- 172.21.15.46:0/2468663644 learned_addr learned my addr 172.21.15.46:0/2468663644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:45.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65e7fff640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0102790 0x7f65f019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:45.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65eed9d640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0106f10 0x7f65f019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:45.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 -- 172.21.15.46:0/2468663644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0106f10 msgr2=0x7f65f019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:45.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0106f10 0x7f65f019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 -- 172.21.15.46:0/2468663644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0102790 msgr2=0x7f65f019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:45.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0102790 0x7f65f019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65ee59c640 1 -- 172.21.15.46:0/2468663644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f019f6a0 con 0x7f65f0101de0 2024-09-19T09:15:45.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65e7fff640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0102790 0x7f65f019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:45.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.069+0000 7f65eed9d640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0106f10 0x7f65f019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:45.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.070+0000 7f65ee59c640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f019a6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65e0006010 tx=0x7f65e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:45.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.070+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e003f030 con 0x7f65f0101de0 2024-09-19T09:15:45.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.070+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65e0003ce0 con 0x7f65f0101de0 2024-09-19T09:15:45.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.070+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f019f930 con 0x7f65f0101de0 2024-09-19T09:15:45.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.070+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0035070 con 0x7f65f0101de0 2024-09-19T09:15:45.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.070+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f01a7270 con 0x7f65f0101de0 2024-09-19T09:15:45.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.071+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f01032c0 con 0x7f65f0101de0 2024-09-19T09:15:45.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.072+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f65e0042030 con 0x7f65f0101de0 2024-09-19T09:15:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.073+0000 7f65e77fe640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65dc0a3240 0x7f65dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.073+0000 7f65e7fff640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65dc0a3240 0x7f65dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.073+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f65e00efbe0 con 0x7f65f0101de0 2024-09-19T09:15:45.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.073+0000 7f65e7fff640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65dc0a3240 0x7f65dc0a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f65f00ff790 tx=0x7f65d8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:45.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.077+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65e00bce60 con 0x7f65f0101de0 2024-09-19T09:15:45.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:45.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:45.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:45.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:45.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:45.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:45.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:44 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:45.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.296+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65f01a7440 con 0x7f65f0101de0 2024-09-19T09:15:45.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.297+0000 7f65e77fe640 1 -- 172.21.15.46:0/2468663644 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2257 (secure 0 0 0) 0x7f65e00bc760 con 0x7f65f0101de0 2024-09-19T09:15:45.297 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:45.297 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":3,"btime":"2024-09-19T09:15:44:746977+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:15:45.298 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 3 2024-09-19T09:15:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65dc0a3240 msgr2=0x7f65dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65dc0a3240 0x7f65dc0a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f65f00ff790 tx=0x7f65d8008040 comp rx=0 tx=0).stop 2024-09-19T09:15:45.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 msgr2=0x7f65f019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f019a6f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f65e0006010 tx=0x7f65e00042f0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 shutdown_connections 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65dc0a3240 0x7f65dc0a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65f0106f10 0x7f65f019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65f0102790 0x7f65f019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 --2- 172.21.15.46:0/2468663644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f0101de0 0x7f65f019a6f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 >> 172.21.15.46:0/2468663644 conn(0x7f65f00fd8c0 msgr2=0x7f65f00febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 shutdown_connections 2024-09-19T09:15:45.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:45.299+0000 7f65f4f01640 1 -- 172.21.15.46:0/2468663644 wait complete. 2024-09-19T09:15:46.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:45 smithi099 ceph-mon[35256]: Deploying daemon mds.j on smithi046 2024-09-19T09:15:46.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:45 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6832/51140188,v1:172.21.15.99:6833/51140188] up:boot 2024-09-19T09:15:46.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:45 smithi099 ceph-mon[35256]: fsmap 2 up:standby 2024-09-19T09:15:46.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:45 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:15:46.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:45 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2468663644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:46.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:45 smithi046 ceph-mon[31203]: Deploying daemon mds.j on smithi046 2024-09-19T09:15:46.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:45 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6832/51140188,v1:172.21.15.99:6833/51140188] up:boot 2024-09-19T09:15:46.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:45 smithi046 ceph-mon[31203]: fsmap 2 up:standby 2024-09-19T09:15:46.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:45 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:15:46.145 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:45 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2468663644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:46.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:45 smithi115 ceph-mon[35055]: Deploying daemon mds.j on smithi046 2024-09-19T09:15:46.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:45 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6832/51140188,v1:172.21.15.99:6833/51140188] up:boot 2024-09-19T09:15:46.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:45 smithi115 ceph-mon[35055]: fsmap 2 up:standby 2024-09-19T09:15:46.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:45 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:15:46.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:45 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2468663644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:47.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:46 smithi099 ceph-mon[35256]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:47.041 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:46 smithi046 ceph-mon[31203]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:47.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:46 smithi115 ceph-mon[35055]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:47.731 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:47 smithi046 systemd[1]: Starting Ceph mds.j for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:48.016 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:47 smithi046 podman[70783]: 2024-09-19 09:15:47.644824233 +0000 UTC m=+0.016638013 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:48.016 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:47 smithi046 podman[70783]: 2024-09-19 09:15:47.744351513 +0000 UTC m=+0.116165299 container create acd14ab5840e9b9a93dd7393e2ff94d751e6605825879923f3439bfc40be47aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:15:48.016 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:47 smithi046 podman[70783]: 2024-09-19 09:15:47.988878081 +0000 UTC m=+0.360691870 container init acd14ab5840e9b9a93dd7393e2ff94d751e6605825879923f3439bfc40be47aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:15:48.016 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:47 smithi046 podman[70783]: 2024-09-19 09:15:47.991793404 +0000 UTC m=+0.363607190 container start acd14ab5840e9b9a93dd7393e2ff94d751e6605825879923f3439bfc40be47aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:15:48.180 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:15:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:48.481 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mds[70802]: -- 172.21.15.46:0/604511866 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564dd99fd860 con 0x564dd99db400 2024-09-19T09:15:48.481 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j[70798]: starting mds.j at 2024-09-19T09:15:48.481 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:48 smithi046 bash[70783]: acd14ab5840e9b9a93dd7393e2ff94d751e6605825879923f3439bfc40be47aa 2024-09-19T09:15:48.481 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:15:48 smithi046 systemd[1]: Started Ceph mds.j for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:48.833 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:48 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 -- 172.21.15.46:0/3694604423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68106f10 msgr2=0x7f5c6810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 --2- 172.21.15.46:0/3694604423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68106f10 0x7f5c6810ea90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009ca0 tx=0x7f5c6002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 -- 172.21.15.46:0/3694604423 shutdown_connections 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 --2- 172.21.15.46:0/3694604423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68106f10 0x7f5c6810ea90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 --2- 172.21.15.46:0/3694604423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c68102790 0x7f5c681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 --2- 172.21.15.46:0/3694604423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c68101de0 0x7f5c681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 -- 172.21.15.46:0/3694604423 >> 172.21.15.46:0/3694604423 conn(0x7f5c680fd8c0 msgr2=0x7f5c680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:48.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.925+0000 7f5c6d215640 1 -- 172.21.15.46:0/3694604423 shutdown_connections 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.926+0000 7f5c6d215640 1 -- 172.21.15.46:0/3694604423 wait complete. 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.926+0000 7f5c6d215640 1 Processor -- start 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.926+0000 7f5c6d215640 1 -- start start 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6d215640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c68101de0 0x7f5c681983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6d215640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 0x7f5c68198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6d215640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c68106f10 0x7f5c6819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6d215640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5c68111f70 con 0x7f5c68102790 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6d215640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5c68111df0 con 0x7f5c68106f10 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6d215640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5c681120f0 con 0x7f5c68101de0 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 0x7f5c68198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 0x7f5c68198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44876/0 (socket says 172.21.15.46:44876) 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 -- 172.21.15.46:0/1518178614 learned_addr learned my addr 172.21.15.46:0/1518178614 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:48.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c66d9d640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c68101de0 0x7f5c681983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6759e640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c68106f10 0x7f5c6819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 -- 172.21.15.46:0/1518178614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c68101de0 msgr2=0x7f5c681983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c68101de0 0x7f5c681983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 -- 172.21.15.46:0/1518178614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c68106f10 msgr2=0x7f5c6819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c68106f10 0x7f5c6819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 -- 172.21.15.46:0/1518178614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6819d3a0 con 0x7f5c68102790 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.927+0000 7f5c6659c640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 0x7f5c68198930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00d950 tx=0x7f5c5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.928+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c017070 con 0x7f5c68102790 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.928+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6819d690 con 0x7f5c68102790 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.928+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c5c009c30 con 0x7f5c68102790 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.928+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00f6b0 con 0x7f5c68102790 2024-09-19T09:15:48.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.928+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c681a4f70 con 0x7f5c68102790 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.929+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c681021c0 con 0x7f5c68102790 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.930+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5c5c0109d0 con 0x7f5c68102790 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.931+0000 7f5c4ffff640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5c500a3240 0x7f5c500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.931+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f5c5c0cef80 con 0x7f5c68102790 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.931+0000 7f5c66d9d640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5c500a3240 0x7f5c500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.931+0000 7f5c66d9d640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5c500a3240 0x7f5c500a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800bbe0 tx=0x7f5c5800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:48.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:48.934+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c5c009de0 con 0x7f5c68102790 2024-09-19T09:15:49.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.150+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c6810a180 con 0x7f5c68102790 2024-09-19T09:15:49.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.150+0000 7f5c4ffff640 1 -- 172.21.15.46:0/1518178614 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f5c5c09baf0 con 0x7f5c68102790 2024-09-19T09:15:49.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:49.151 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":4,"btime":"2024-09-19T09:15:48:758794+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:15:49.151 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 4 2024-09-19T09:15:49.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5c500a3240 msgr2=0x7f5c500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:49.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5c500a3240 0x7f5c500a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800bbe0 tx=0x7f5c5800b390 comp rx=0 tx=0).stop 2024-09-19T09:15:49.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 msgr2=0x7f5c68198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:49.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 0x7f5c68198930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00d950 tx=0x7f5c5c00de10 comp rx=0 tx=0).stop 2024-09-19T09:15:49.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 shutdown_connections 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5c500a3240 0x7f5c500a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68102790 0x7f5c68198930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c68106f10 0x7f5c6819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 --2- 172.21.15.46:0/1518178614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5c68101de0 0x7f5c681983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 >> 172.21.15.46:0/1518178614 conn(0x7f5c680fd8c0 msgr2=0x7f5c680feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 shutdown_connections 2024-09-19T09:15:49.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:49.153+0000 7f5c6d215640 1 -- 172.21.15.46:0/1518178614 wait complete. 2024-09-19T09:15:49.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:48 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:49.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:49.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:49.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:49.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:49.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:49.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:49.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:48 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:50.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:49 smithi115 ceph-mon[35055]: Deploying daemon mds.d on smithi046 2024-09-19T09:15:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:49 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.46:6834/1645318124,v1:172.21.15.46:6835/1645318124] up:boot 2024-09-19T09:15:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:49 smithi115 ceph-mon[35055]: fsmap 3 up:standby 2024-09-19T09:15:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:49 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:15:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:49 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1518178614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:49 smithi046 ceph-mon[31203]: Deploying daemon mds.d on smithi046 2024-09-19T09:15:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:49 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.46:6834/1645318124,v1:172.21.15.46:6835/1645318124] up:boot 2024-09-19T09:15:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:49 smithi046 ceph-mon[31203]: fsmap 3 up:standby 2024-09-19T09:15:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:49 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:15:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:49 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1518178614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:50.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:49 smithi099 ceph-mon[35256]: Deploying daemon mds.d on smithi046 2024-09-19T09:15:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:49 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.46:6834/1645318124,v1:172.21.15.46:6835/1645318124] up:boot 2024-09-19T09:15:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:49 smithi099 ceph-mon[35256]: fsmap 3 up:standby 2024-09-19T09:15:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:49 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:15:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:49 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1518178614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:50 smithi046 ceph-mon[31203]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:50.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:50 smithi046 systemd[1]: Starting Ceph mds.d for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:51.131 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:50 smithi115 ceph-mon[35055]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:50 smithi099 ceph-mon[35256]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:51.426 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 podman[71201]: 2024-09-19 09:15:51.301121268 +0000 UTC m=+0.016633889 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:51.700 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 podman[71201]: 2024-09-19 09:15:51.426789827 +0000 UTC m=+0.142302433 container create 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:15:51.701 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 podman[71201]: 2024-09-19 09:15:51.673377494 +0000 UTC m=+0.388890125 container init 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:15:51.701 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 podman[71201]: 2024-09-19 09:15:51.676254524 +0000 UTC m=+0.391767129 container start 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:15:51.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 ceph-mds[71220]: -- 172.21.15.46:0/3078978225 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb0aded860 con 0x55fb0adca800 2024-09-19T09:15:51.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d[71216]: starting mds.d at 2024-09-19T09:15:51.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 bash[71201]: 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 2024-09-19T09:15:51.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:15:51 smithi046 systemd[1]: Started Ceph mds.d for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:15:53.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:15:53.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:53.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.46:6836/4123039561,v1:172.21.15.46:6837/4123039561] up:boot 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: fsmap 4 up:standby 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:53.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:52 smithi115 ceph-mon[35055]: Deploying daemon mds.e on smithi099 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.46:6836/4123039561,v1:172.21.15.46:6837/4123039561] up:boot 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: fsmap 4 up:standby 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:53.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:52 smithi046 ceph-mon[31203]: Deploying daemon mds.e on smithi099 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.46:6836/4123039561,v1:172.21.15.46:6837/4123039561] up:boot 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: fsmap 4 up:standby 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:53.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:52 smithi099 ceph-mon[35256]: Deploying daemon mds.e on smithi099 2024-09-19T09:15:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:53.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 -- 172.21.15.46:0/3038703299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604106a80 msgr2=0x7f1604106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:54.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 --2- 172.21.15.46:0/3038703299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604106a80 0x7f1604106e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1600009930 tx=0x7f160002a420 comp rx=0 tx=0).stop 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 -- 172.21.15.46:0/3038703299 shutdown_connections 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 --2- 172.21.15.46:0/3038703299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1604101420 0x7f160410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 --2- 172.21.15.46:0/3038703299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1604100a80 0x7f1604100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 --2- 172.21.15.46:0/3038703299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604106a80 0x7f1604106e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 -- 172.21.15.46:0/3038703299 >> 172.21.15.46:0/3038703299 conn(0x7f16040fc7a0 msgr2=0x7f16040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 -- 172.21.15.46:0/3038703299 shutdown_connections 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 -- 172.21.15.46:0/3038703299 wait complete. 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 Processor -- start 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.944+0000 7f160b8c1640 1 -- start start 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160b8c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 0x7f1604198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:54.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160b8c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1604101420 0x7f16041989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160b8c1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1604106a80 0x7f160419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160b8c1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1604110e40 con 0x7f1604100a80 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160b8c1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1604110cc0 con 0x7f1604106a80 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160b8c1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1604110fc0 con 0x7f1604101420 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 0x7f1604198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 0x7f1604198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44908/0 (socket says 172.21.15.46:44908) 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 -- 172.21.15.46:0/2113868758 learned_addr learned my addr 172.21.15.46:0/2113868758 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f1609e5e640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1604106a80 0x7f160419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f1608e5c640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1604101420 0x7f16041989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 -- 172.21.15.46:0/2113868758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1604101420 msgr2=0x7f16041989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:54.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1604101420 0x7f16041989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 -- 172.21.15.46:0/2113868758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1604106a80 msgr2=0x7f160419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1604106a80 0x7f160419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 -- 172.21.15.46:0/2113868758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160419d420 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f160965d640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 0x7f1604198470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1600009230 tx=0x7f1600004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.945+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160003f030 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.946+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1600003ad0 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.946+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160419d6b0 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.946+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600035070 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.946+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16041a4ff0 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.947+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16041021c0 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.948+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1600042030 con 0x7f1604100a80 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.949+0000 7f15fa7fc640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15f00a3240 0x7f15f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:54.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.949+0000 7f1608e5c640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15f00a3240 0x7f15f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.949+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f16000efed0 con 0x7f1604100a80 2024-09-19T09:15:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.949+0000 7f1608e5c640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15f00a3240 0x7f15f00a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f160406b7e0 tx=0x7f15f400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:54.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:53.952+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16000bd090 con 0x7f1604100a80 2024-09-19T09:15:54.227 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:53 smithi099 systemd[1]: Starting Ceph mds.e for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:54.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.163+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1604100ee0 con 0x7f1604100a80 2024-09-19T09:15:54.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.164+0000 7f15fa7fc640 1 -- 172.21.15.46:0/2113868758 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f1604100ee0 con 0x7f1604100a80 2024-09-19T09:15:54.228 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:54.228 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":5,"btime":"2024-09-19T09:15:51:769980+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:15:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 5 2024-09-19T09:15:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.165+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15f00a3240 msgr2=0x7f15f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.165+0000 7f160b8c1640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15f00a3240 0x7f15f00a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f160406b7e0 tx=0x7f15f400b590 comp rx=0 tx=0).stop 2024-09-19T09:15:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.165+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 msgr2=0x7f1604198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.165+0000 7f160b8c1640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 0x7f1604198470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1600009230 tx=0x7f1600004270 comp rx=0 tx=0).stop 2024-09-19T09:15:54.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 shutdown_connections 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15f00a3240 0x7f15f00a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1604106a80 0x7f160419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1604101420 0x7f16041989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 --2- 172.21.15.46:0/2113868758 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1604100a80 0x7f1604198470 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 >> 172.21.15.46:0/2113868758 conn(0x7f16040fc7a0 msgr2=0x7f16041048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 shutdown_connections 2024-09-19T09:15:54.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:54.166+0000 7f160b8c1640 1 -- 172.21.15.46:0/2113868758 wait complete. 2024-09-19T09:15:54.307 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 podman[64405]: 2024-09-19 09:15:53.957996323 +0000 UTC m=+0.015820946 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:54.308 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 podman[64405]: 2024-09-19 09:15:54.087601311 +0000 UTC m=+0.145425921 container create b2da851b1298e8d53466893e109e2660aea941e1cc543e0d9688893718293e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:15:54.308 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 podman[64405]: 2024-09-19 09:15:54.30762984 +0000 UTC m=+0.365454450 container init b2da851b1298e8d53466893e109e2660aea941e1cc543e0d9688893718293e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:15:54.763 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 podman[64405]: 2024-09-19 09:15:54.310696882 +0000 UTC m=+0.368521499 container start b2da851b1298e8d53466893e109e2660aea941e1cc543e0d9688893718293e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:15:54.763 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mds[64424]: -- 172.21.15.99:0/457201665 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a22de3f860 con 0x55a22de1c800 2024-09-19T09:15:54.763 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: starting mds.e at 2024-09-19T09:15:54.763 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 bash[64405]: b2da851b1298e8d53466893e109e2660aea941e1cc543e0d9688893718293e8b 2024-09-19T09:15:54.763 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:15:54 smithi099 systemd[1]: Started Ceph mds.e for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2113868758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:54.934 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:54 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2113868758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:55.113 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:54 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2113868758' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:54 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:56.054 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:55 smithi099 ceph-mon[35256]: Deploying daemon mds.f on smithi115 2024-09-19T09:15:56.054 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:55 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6834/1791811881,v1:172.21.15.99:6835/1791811881] up:boot 2024-09-19T09:15:56.054 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:55 smithi099 ceph-mon[35256]: fsmap 5 up:standby 2024-09-19T09:15:56.055 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:55 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:15:56.184 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:55 smithi115 ceph-mon[35055]: Deploying daemon mds.f on smithi115 2024-09-19T09:15:56.184 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:55 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6834/1791811881,v1:172.21.15.99:6835/1791811881] up:boot 2024-09-19T09:15:56.184 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:55 smithi115 ceph-mon[35055]: fsmap 5 up:standby 2024-09-19T09:15:56.184 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:55 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:15:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:55 smithi046 ceph-mon[31203]: Deploying daemon mds.f on smithi115 2024-09-19T09:15:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:55 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6834/1791811881,v1:172.21.15.99:6835/1791811881] up:boot 2024-09-19T09:15:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:55 smithi046 ceph-mon[31203]: fsmap 5 up:standby 2024-09-19T09:15:56.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:55 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:15:56.459 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 systemd[1]: Starting Ceph mds.f for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:56.864 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:56 smithi115 ceph-mon[35055]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:56.864 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 podman[64460]: 2024-09-19 09:15:56.474051552 +0000 UTC m=+0.016462429 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:56.864 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 podman[64460]: 2024-09-19 09:15:56.594982064 +0000 UTC m=+0.137392929 container create 35e80748627eab84d0b8ad191087e1d4af44db5a54b884f8b79968a36d9f0d97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:15:56.864 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 podman[64460]: 2024-09-19 09:15:56.864246833 +0000 UTC m=+0.406657697 container init 35e80748627eab84d0b8ad191087e1d4af44db5a54b884f8b79968a36d9f0d97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:15:56.963 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:15:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:56 smithi099 ceph-mon[35256]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:57.209 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 podman[64460]: 2024-09-19 09:15:56.867391503 +0000 UTC m=+0.409802380 container start 35e80748627eab84d0b8ad191087e1d4af44db5a54b884f8b79968a36d9f0d97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:15:57.210 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 ceph-mds[64479]: -- 172.21.15.115:0/479799621 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ab41e0b860 con 0x55ab41de9000 2024-09-19T09:15:57.210 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f[64475]: starting mds.f at 2024-09-19T09:15:57.210 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 bash[64460]: 35e80748627eab84d0b8ad191087e1d4af44db5a54b884f8b79968a36d9f0d97 2024-09-19T09:15:57.210 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:15:56 smithi115 systemd[1]: Started Ceph mds.f for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:15:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:56 smithi046 ceph-mon[31203]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:57.250 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 -- 172.21.15.46:0/3273181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 msgr2=0x7f878810df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 --2- 172.21.15.46:0/3273181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878810df30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8778009900 tx=0x7f877802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 -- 172.21.15.46:0/3273181 shutdown_connections 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 --2- 172.21.15.46:0/3273181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878810df30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 --2- 172.21.15.46:0/3273181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f878810e500 0x7f8788110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 --2- 172.21.15.46:0/3273181 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8788100b20 0x7f8788100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 -- 172.21.15.46:0/3273181 >> 172.21.15.46:0/3273181 conn(0x7f87880fc7d0 msgr2=0x7f87880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:57.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 -- 172.21.15.46:0/3273181 shutdown_connections 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.761+0000 7f878f6eb640 1 -- 172.21.15.46:0/3273181 wait complete. 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 Processor -- start 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 -- start start 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8788100b20 0x7f878819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f878810e500 0x7f878819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8788114250 con 0x7f8788101440 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f87881140d0 con 0x7f878810e500 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878f6eb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87881143d0 con 0x7f8788100b20 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878cc86640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878d487640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8788100b20 0x7f878819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878cc86640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44936/0 (socket says 172.21.15.46:44936) 2024-09-19T09:15:57.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878cc86640 1 -- 172.21.15.46:0/2493740637 learned_addr learned my addr 172.21.15.46:0/2493740637 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.762+0000 7f878dc88640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f878810e500 0x7f878819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878cc86640 1 -- 172.21.15.46:0/2493740637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8788100b20 msgr2=0x7f878819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878cc86640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8788100b20 0x7f878819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878cc86640 1 -- 172.21.15.46:0/2493740637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f878810e500 msgr2=0x7f878819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878cc86640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f878810e500 0x7f878819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878cc86640 1 -- 172.21.15.46:0/2493740637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878819f6a0 con 0x7f8788101440 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878d487640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8788100b20 0x7f878819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878cc86640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878819ac30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8778005940 tx=0x7f87780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877803f030 con 0x7f8788101440 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878819f930 con 0x7f8788101440 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8778003ce0 con 0x7f8788101440 2024-09-19T09:15:57.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778035070 con 0x7f8788101440 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.763+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87881a7270 con 0x7f8788101440 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.764+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8788100f00 con 0x7f8788101440 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.767+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8778042030 con 0x7f8788101440 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.767+0000 7f877e7fc640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87740a3240 0x7f87740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.767+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f87780efc20 con 0x7f8788101440 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.767+0000 7f878d487640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87740a3240 0x7f87740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.768+0000 7f878d487640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87740a3240 0x7f87740a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f878400afb0 tx=0x7f878400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:57.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.770+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87780bcd40 con 0x7f8788101440 2024-09-19T09:15:57.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.986+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87881a7440 con 0x7f8788101440 2024-09-19T09:15:57.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.987+0000 7f877e7fc640 1 -- 172.21.15.46:0/2493740637 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5560 (secure 0 0 0) 0x7f87780b8070 con 0x7f8788101440 2024-09-19T09:15:57.989 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:15:57.989 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":7,"btime":"2024-09-19T09:15:57:789281+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T09:15:57.989 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 7 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87740a3240 msgr2=0x7f87740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87740a3240 0x7f87740a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f878400afb0 tx=0x7f878400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 msgr2=0x7f878819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878819ac30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8778005940 tx=0x7f87780042f0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 shutdown_connections 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87740a3240 0x7f87740a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8788101440 0x7f878819ac30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f878810e500 0x7f878819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 --2- 172.21.15.46:0/2493740637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8788100b20 0x7f878819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:57.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 >> 172.21.15.46:0/2493740637 conn(0x7f87880fc7d0 msgr2=0x7f87880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:57.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 shutdown_connections 2024-09-19T09:15:57.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:15:57.990+0000 7f878f6eb640 1 -- 172.21.15.46:0/2493740637 wait complete. 2024-09-19T09:15:58.463 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: Deploying daemon mds.c on smithi115 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] up:boot 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: fsmap 6 up:standby 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:15:58.464 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:15:58 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2493740637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:58.465 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: Deploying daemon mds.c on smithi115 2024-09-19T09:15:58.466 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] up:boot 2024-09-19T09:15:58.466 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: fsmap 6 up:standby 2024-09-19T09:15:58.466 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:15:58.466 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:15:58 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2493740637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:58.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: Deploying daemon mds.c on smithi115 2024-09-19T09:15:58.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] up:boot 2024-09-19T09:15:58.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: fsmap 6 up:standby 2024-09-19T09:15:58.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:15:58.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:15:58 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2493740637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:15:59.184 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:58 smithi115 systemd[1]: Starting Ceph mds.c for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:15:59.460 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 podman[64765]: 2024-09-19 09:15:59.086517311 +0000 UTC m=+0.015731313 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:15:59.460 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 podman[64765]: 2024-09-19 09:15:59.216410149 +0000 UTC m=+0.145624135 container create 045bf3231bd945312534f4344dc929fe8298a9da754b7813c4fa3142f16037de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:15:59.960 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 podman[64765]: 2024-09-19 09:15:59.49423797 +0000 UTC m=+0.423451973 container init 045bf3231bd945312534f4344dc929fe8298a9da754b7813c4fa3142f16037de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:15:59.960 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 podman[64765]: 2024-09-19 09:15:59.497136336 +0000 UTC m=+0.426350326 container start 045bf3231bd945312534f4344dc929fe8298a9da754b7813c4fa3142f16037de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:15:59.960 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 ceph-mds[64784]: -- 172.21.15.115:0/930753701 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f20bd87860 con 0x55f20bd65000 2024-09-19T09:15:59.960 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: starting mds.c at 2024-09-19T09:15:59.960 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 bash[64765]: 045bf3231bd945312534f4344dc929fe8298a9da754b7813c4fa3142f16037de 2024-09-19T09:15:59.960 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:15:59 smithi115 systemd[1]: Started Ceph mds.c for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:16:00.639 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:16:00.913 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: Deploying daemon mds.h on smithi099 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:boot 2024-09-19T09:16:00.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: fsmap 7 up:standby 2024-09-19T09:16:00.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:00 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:16:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:00.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:00.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: Deploying daemon mds.h on smithi099 2024-09-19T09:16:00.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:boot 2024-09-19T09:16:00.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: fsmap 7 up:standby 2024-09-19T09:16:00.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:00 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: Deploying daemon mds.h on smithi099 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:boot 2024-09-19T09:16:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: fsmap 7 up:standby 2024-09-19T09:16:01.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:00 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:16:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 -- 172.21.15.46:0/4274233164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc1008d0 msgr2=0x7f89dc100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 --2- 172.21.15.46:0/4274233164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc1008d0 0x7f89dc100cb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009900 tx=0x7f89d802a410 comp rx=0 tx=0).stop 2024-09-19T09:16:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 -- 172.21.15.46:0/4274233164 shutdown_connections 2024-09-19T09:16:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 --2- 172.21.15.46:0/4274233164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc10e480 0x7f89dc110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 --2- 172.21.15.46:0/4274233164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 --2- 172.21.15.46:0/4274233164 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc1008d0 0x7f89dc100cb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 -- 172.21.15.46:0/4274233164 >> 172.21.15.46:0/4274233164 conn(0x7f89dc0fc7a0 msgr2=0x7f89dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 -- 172.21.15.46:0/4274233164 shutdown_connections 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 -- 172.21.15.46:0/4274233164 wait complete. 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 Processor -- start 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.379+0000 7f89e3934640 1 -- start start 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e3934640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc1008d0 0x7f89dc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e3934640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e3934640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc10e480 0x7f89dc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:01.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e3934640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc1141f0 con 0x7f89dc10e480 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e3934640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc114070 con 0x7f89dc101280 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e3934640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f89dc114370 con 0x7f89dc1008d0 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e1ed1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc10e480 0x7f89dc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc19ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:60688/0 (socket says 172.21.15.46:60688) 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 -- 172.21.15.46:0/2824970548 learned_addr learned my addr 172.21.15.46:0/2824970548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e16d0640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc1008d0 0x7f89dc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 -- 172.21.15.46:0/2824970548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc1008d0 msgr2=0x7f89dc19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc1008d0 0x7f89dc19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 -- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc10e480 msgr2=0x7f89dc19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc10e480 0x7f89dc19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 -- 172.21.15.46:0/2824970548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89dc19f680 con 0x7f89dc101280 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e1ed1640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc10e480 0x7f89dc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.380+0000 7f89e0ecf640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc19ac10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00e9f0 tx=0x7f89cc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.381+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00cd80 con 0x7f89dc101280 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.381+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89dc19f970 con 0x7f89dc101280 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.381+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89cc010910 con 0x7f89dc101280 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.381+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0188f0 con 0x7f89dc101280 2024-09-19T09:16:01.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.381+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89dc1a7250 con 0x7f89dc101280 2024-09-19T09:16:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.382+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89dc100cb0 con 0x7f89dc101280 2024-09-19T09:16:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.383+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f89cc010ac0 con 0x7f89dc101280 2024-09-19T09:16:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.383+0000 7f89d27fc640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c80a3240 0x7f89c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.384+0000 7f89e16d0640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c80a3240 0x7f89c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.384+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f89cc0cfca0 con 0x7f89dc101280 2024-09-19T09:16:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.384+0000 7f89e16d0640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c80a3240 0x7f89c80a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89d8005940 tx=0x7f89d80058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:01.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.386+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f89cc09cdc0 con 0x7f89dc101280 2024-09-19T09:16:01.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.600+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89dc19ba30 con 0x7f89dc101280 2024-09-19T09:16:01.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.600+0000 7f89d27fc640 1 -- 172.21.15.46:0/2824970548 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f89dc19ba30 con 0x7f89dc101280 2024-09-19T09:16:01.602 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:01.602 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":8,"btime":"2024-09-19T09:16:00:032420+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T09:16:01.603 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 8 2024-09-19T09:16:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.603+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c80a3240 msgr2=0x7f89c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.603+0000 7f89e3934640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c80a3240 0x7f89c80a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f89d8005940 tx=0x7f89d80058b0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.603+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 msgr2=0x7f89dc19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.603+0000 7f89e3934640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc19ac10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00e9f0 tx=0x7f89cc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 shutdown_connections 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c80a3240 0x7f89c80a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89dc10e480 0x7f89dc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89dc101280 0x7f89dc19ac10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 --2- 172.21.15.46:0/2824970548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89dc1008d0 0x7f89dc19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 >> 172.21.15.46:0/2824970548 conn(0x7f89dc0fc7a0 msgr2=0x7f89dc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 shutdown_connections 2024-09-19T09:16:01.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:01.604+0000 7f89e3934640 1 -- 172.21.15.46:0/2824970548 wait complete. 2024-09-19T09:16:01.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:01 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2824970548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:01.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:01 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2824970548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:01.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:01 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2824970548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:02.512 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:16:02 smithi099 systemd[1]: Started Ceph mds.h for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:16:02.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:02 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:02 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:02 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:03.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:03 smithi115 ceph-mon[35055]: Deploying daemon mds.i on smithi115 2024-09-19T09:16:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:03 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:boot 2024-09-19T09:16:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:03 smithi115 ceph-mon[35055]: fsmap 8 up:standby 2024-09-19T09:16:03.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:03 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:16:03.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:03 smithi046 ceph-mon[31203]: Deploying daemon mds.i on smithi115 2024-09-19T09:16:03.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:03 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:boot 2024-09-19T09:16:03.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:03 smithi046 ceph-mon[31203]: fsmap 8 up:standby 2024-09-19T09:16:03.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:03 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:16:04.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:03 smithi099 ceph-mon[35256]: Deploying daemon mds.i on smithi115 2024-09-19T09:16:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:03 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:boot 2024-09-19T09:16:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:03 smithi099 ceph-mon[35256]: fsmap 8 up:standby 2024-09-19T09:16:04.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:03 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:16:04.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:16:04.453 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 systemd[1]: Starting Ceph mds.i for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:16:04.537 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:04.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:04 smithi115 ceph-mon[35055]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:04.710 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 podman[65070]: 2024-09-19 09:16:04.354987074 +0000 UTC m=+0.015900448 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:16:04.710 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 podman[65070]: 2024-09-19 09:16:04.49727562 +0000 UTC m=+0.158189039 container create 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:16:04.939 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:04 smithi046 ceph-mon[31203]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:05.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:04 smithi099 ceph-mon[35256]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3126370558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc41008d0 msgr2=0x7fdfc4100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3126370558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc41008d0 0x7fdfc4100d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009930 tx=0x7fdfc002a420 comp rx=0 tx=0).stop 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3126370558 shutdown_connections 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3126370558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc41008d0 0x7fdfc4100d30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3126370558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc4101270 0x7fdfc410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3126370558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfc41068d0 0x7fdfc4106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3126370558 >> 172.21.15.46:0/3126370558 conn(0x7fdfc40fc610 msgr2=0x7fdfc40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3126370558 shutdown_connections 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.030+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3126370558 wait complete. 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 Processor -- start 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 -- start start 2024-09-19T09:16:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfc41008d0 0x7fdfc41024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 0x7fdfc41029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc41068d0 0x7fdfc4102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110cd0 con 0x7fdfc4101270 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110b50 con 0x7fdfc41008d0 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfca3a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110e50 con 0x7fdfc41068d0 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 0x7fdfc41029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc93a0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfc41008d0 0x7fdfc41024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 0x7fdfc41029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39928/0 (socket says 172.21.15.46:39928) 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 -- 172.21.15.46:0/3102203306 learned_addr learned my addr 172.21.15.46:0/3102203306 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc9ba1640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc41068d0 0x7fdfc4102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 -- 172.21.15.46:0/3102203306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc41068d0 msgr2=0x7fdfc4102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:05.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc41068d0 0x7fdfc4102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 -- 172.21.15.46:0/3102203306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfc41008d0 msgr2=0x7fdfc41024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfc41008d0 0x7fdfc41024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.031+0000 7fdfc8b9f640 1 -- 172.21.15.46:0/3102203306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc41a6760 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.032+0000 7fdfc8b9f640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 0x7fdfc41029e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009230 tx=0x7fdfc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.032+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc003f030 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.032+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfc0003ad0 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.032+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc41a69f0 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.032+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0035070 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.032+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a6ed0 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.033+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4100d30 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.034+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdfc0042030 con 0x7fdfc4101270 2024-09-19T09:16:05.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.035+0000 7fdfb67fc640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdfb00a3240 0x7fdfb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.035+0000 7fdfc93a0640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdfb00a3240 0x7fdfb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.035+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fdfc00efe50 con 0x7fdfc4101270 2024-09-19T09:16:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.036+0000 7fdfc93a0640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdfb00a3240 0x7fdfb00a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005d00 tx=0x7fdfb800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:05.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.039+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfc00bc9c0 con 0x7fdfc4101270 2024-09-19T09:16:05.209 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 podman[65070]: 2024-09-19 09:16:04.775129299 +0000 UTC m=+0.436042673 container init 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T09:16:05.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 podman[65070]: 2024-09-19 09:16:04.778390038 +0000 UTC m=+0.439303422 container start 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:16:05.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 ceph-mds[65090]: -- 172.21.15.115:0/3462189630 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c52f937860 con 0x55c52f914800 2024-09-19T09:16:05.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: starting mds.i at 2024-09-19T09:16:05.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 bash[65070]: 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a 2024-09-19T09:16:05.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:16:04 smithi115 systemd[1]: Started Ceph mds.i for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:16:05.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.257+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc41a7170 con 0x7fdfc4101270 2024-09-19T09:16:05.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.257+0000 7fdfb67fc640 1 -- 172.21.15.46:0/3102203306 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fdfc00c0cc0 con 0x7fdfc4101270 2024-09-19T09:16:05.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:05.259 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":9,"btime":"2024-09-19T09:16:02:649442+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T09:16:05.259 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 9 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdfb00a3240 msgr2=0x7fdfb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdfb00a3240 0x7fdfb00a5700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8005d00 tx=0x7fdfb800b410 comp rx=0 tx=0).stop 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 msgr2=0x7fdfc41029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 0x7fdfc41029e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009230 tx=0x7fdfc0004270 comp rx=0 tx=0).stop 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 shutdown_connections 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdfb00a3240 0x7fdfb00a5700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfc4101270 0x7fdfc41029e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdfc41068d0 0x7fdfc4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 --2- 172.21.15.46:0/3102203306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfc41008d0 0x7fdfc41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:05.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.259+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 >> 172.21.15.46:0/3102203306 conn(0x7fdfc40fc610 msgr2=0x7fdfc41046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.260+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 shutdown_connections 2024-09-19T09:16:05.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:05.260+0000 7fdfca3a2640 1 -- 172.21.15.46:0/3102203306 wait complete. 2024-09-19T09:16:05.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:05.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: Deploying daemon mds.g on smithi046 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3102203306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:boot 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: fsmap 9 up:standby 2024-09-19T09:16:05.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:05 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:16:06.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: Deploying daemon mds.g on smithi046 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3102203306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:boot 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: fsmap 9 up:standby 2024-09-19T09:16:06.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:05 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:16:06.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: Deploying daemon mds.g on smithi046 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3102203306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:boot 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: fsmap 9 up:standby 2024-09-19T09:16:06.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:05 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:16:07.731 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:07 smithi046 systemd[1]: Starting Ceph mds.g for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:16:07.958 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:16:08.050 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:08 smithi046 ceph-mon[31203]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:08.051 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:07 smithi046 podman[71970]: 2024-09-19 09:16:07.780801179 +0000 UTC m=+0.108343012 container create b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:16:08.051 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:07 smithi046 podman[71970]: 2024-09-19 09:16:07.689074359 +0000 UTC m=+0.016616209 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:16:08.051 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:08 smithi046 podman[71970]: 2024-09-19 09:16:08.050643982 +0000 UTC m=+0.378185825 container init b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:16:08.229 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:08.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:08 smithi099 ceph-mon[35256]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:08.352 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:08 smithi046 podman[71970]: 2024-09-19 09:16:08.054161187 +0000 UTC m=+0.381703024 container start b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:16:08.352 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:08 smithi046 ceph-mds[72007]: -- 172.21.15.46:0/3989026362 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602ad061860 con 0x5602ad03f000 2024-09-19T09:16:08.353 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g[71985]: starting mds.g at 2024-09-19T09:16:08.353 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:08 smithi046 bash[71970]: b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 2024-09-19T09:16:08.353 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:16:08 smithi046 systemd[1]: Started Ceph mds.g for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:16:08.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:08 smithi115 ceph-mon[35055]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 -- 172.21.15.46:0/1405913498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 msgr2=0x7f842c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 --2- 172.21.15.46:0/1405913498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1067e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8414009900 tx=0x7f841402a410 comp rx=0 tx=0).stop 2024-09-19T09:16:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 -- 172.21.15.46:0/1405913498 shutdown_connections 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 --2- 172.21.15.46:0/1405913498 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1067e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 --2- 172.21.15.46:0/1405913498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c106f10 0x7f842c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 --2- 172.21.15.46:0/1405913498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c101de0 0x7f842c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 -- 172.21.15.46:0/1405913498 >> 172.21.15.46:0/1405913498 conn(0x7f842c0fd8c0 msgr2=0x7f842c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 -- 172.21.15.46:0/1405913498 shutdown_connections 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.711+0000 7f84314bd640 1 -- 172.21.15.46:0/1405913498 wait complete. 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.712+0000 7f84314bd640 1 Processor -- start 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 -- start start 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c101de0 0x7f842c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c106f10 0x7f842c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f842c111f70 con 0x7f842c102790 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f842c111df0 con 0x7f842c106f10 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f84314bd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1120f0 con 0x7f842c101de0 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57136/0 (socket says 172.21.15.46:57136) 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 -- 172.21.15.46:0/2364388671 learned_addr learned my addr 172.21.15.46:0/2364388671 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842affd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c101de0 0x7f842c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842b7fe640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c106f10 0x7f842c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 -- 172.21.15.46:0/2364388671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c101de0 msgr2=0x7f842c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c101de0 0x7f842c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 -- 172.21.15.46:0/2364388671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c106f10 msgr2=0x7f842c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c106f10 0x7f842c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842a7fc640 1 -- 172.21.15.46:0/2364388671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c19d360 con 0x7f842c102790 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.713+0000 7f842b7fe640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c106f10 0x7f842c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.714+0000 7f842a7fc640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1988f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8414006010 tx=0x7f84140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.714+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403f030 con 0x7f842c102790 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.714+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c19d5f0 con 0x7f842c102790 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.714+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8414003ce0 con 0x7f842c102790 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.714+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035070 con 0x7f842c102790 2024-09-19T09:16:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.714+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c074420 con 0x7f842c102790 2024-09-19T09:16:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.715+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c1032c0 con 0x7f842c102790 2024-09-19T09:16:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.716+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8414042030 con 0x7f842c102790 2024-09-19T09:16:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.717+0000 7f8423fff640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84180a3240 0x7f84180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.717+0000 7f842affd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84180a3240 0x7f84180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.717+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f84140efe00 con 0x7f842c102790 2024-09-19T09:16:08.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.717+0000 7f842affd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84180a3240 0x7f84180a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f841c005fd0 tx=0x7f841c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.721+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84140bd080 con 0x7f842c102790 2024-09-19T09:16:08.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.939+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f842c1021c0 con 0x7f842c102790 2024-09-19T09:16:08.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.939+0000 7f8423fff640 1 -- 172.21.15.46:0/2364388671 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8037 (secure 0 0 0) 0x7f842c1021c0 con 0x7f842c102790 2024-09-19T09:16:08.941 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:08.941 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":10,"btime":"2024-09-19T09:16:05:661663+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:16:08.942 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 10 2024-09-19T09:16:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84180a3240 msgr2=0x7f84180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:08.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84180a3240 0x7f84180a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f841c005fd0 tx=0x7f841c00b390 comp rx=0 tx=0).stop 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 msgr2=0x7f842c1988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1988f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8414006010 tx=0x7f84140042f0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 shutdown_connections 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84180a3240 0x7f84180a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f842c102790 0x7f842c1988f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f842c106f10 0x7f842c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 --2- 172.21.15.46:0/2364388671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f842c101de0 0x7f842c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 >> 172.21.15.46:0/2364388671 conn(0x7f842c0fd8c0 msgr2=0x7f842c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 shutdown_connections 2024-09-19T09:16:08.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:08.942+0000 7f84314bd640 1 -- 172.21.15.46:0/2364388671 wait complete. 2024-09-19T09:16:09.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:09.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:09.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:09.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: Deploying daemon mds.a on smithi046 2024-09-19T09:16:09.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2364388671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:09.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.46:6838/1918563776,v1:172.21.15.46:6839/1918563776] up:boot 2024-09-19T09:16:09.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: fsmap 10 up:standby 2024-09-19T09:16:09.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:09 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:16:09.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:09.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:09.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:09.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: Deploying daemon mds.a on smithi046 2024-09-19T09:16:09.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2364388671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:09.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.46:6838/1918563776,v1:172.21.15.46:6839/1918563776] up:boot 2024-09-19T09:16:09.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: fsmap 10 up:standby 2024-09-19T09:16:09.483 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:09 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:16:09.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:09.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:09.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:09.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:09.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: Deploying daemon mds.a on smithi046 2024-09-19T09:16:09.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2364388671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:09.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.46:6838/1918563776,v1:172.21.15.46:6839/1918563776] up:boot 2024-09-19T09:16:09.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: fsmap 10 up:standby 2024-09-19T09:16:09.515 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:09 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:16:10.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:10 smithi046 ceph-mon[31203]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:10.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:10 smithi099 ceph-mon[35256]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:10.634 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:10 smithi115 ceph-mon[35055]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:11.231 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 systemd[1]: Starting Ceph mds.a for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:16:11.500 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 podman[72383]: 2024-09-19 09:16:11.138837594 +0000 UTC m=+0.016644352 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:16:11.500 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 podman[72383]: 2024-09-19 09:16:11.247025527 +0000 UTC m=+0.124832259 container create c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:16:11.500 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 podman[72383]: 2024-09-19 09:16:11.499931358 +0000 UTC m=+0.377738109 container init c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:16:11.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:16:11.922 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:11.981 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 podman[72383]: 2024-09-19 09:16:11.502979348 +0000 UTC m=+0.380786088 container start c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:16:11.981 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 ceph-mds[72402]: -- 172.21.15.46:0/1954531885 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619c7805860 con 0x5619c77e2800 2024-09-19T09:16:11.981 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a[72398]: starting mds.a at 2024-09-19T09:16:11.981 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 bash[72383]: c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 2024-09-19T09:16:11.982 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:16:11 smithi046 systemd[1]: Started Ceph mds.a for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:16:12.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 -- 172.21.15.46:0/3298763720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 msgr2=0x7fde941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:12.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 --2- 172.21.15.46:0/3298763720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde941029b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009900 tx=0x7fde7c02a480 comp rx=0 tx=0).stop 2024-09-19T09:16:12.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 -- 172.21.15.46:0/3298763720 shutdown_connections 2024-09-19T09:16:12.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 --2- 172.21.15.46:0/3298763720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde941029b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 --2- 172.21.15.46:0/3298763720 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde94102ef0 0x7fde9410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 --2- 172.21.15.46:0/3298763720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde94100e20 0x7fde94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 -- 172.21.15.46:0/3298763720 >> 172.21.15.46:0/3298763720 conn(0x7fde940fc7d0 msgr2=0x7fde940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 -- 172.21.15.46:0/3298763720 shutdown_connections 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.394+0000 7fde98d3f640 1 -- 172.21.15.46:0/3298763720 wait complete. 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 Processor -- start 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 -- start start 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde94100e20 0x7fde940fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde940fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde94102ef0 0x7fde940fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde94110fa0 con 0x7fde94102570 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fde94110e20 con 0x7fde94102ef0 2024-09-19T09:16:12.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde98d3f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fde94111120 con 0x7fde94100e20 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde940fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde940fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57174/0 (socket says 172.21.15.46:57174) 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde8bfff640 1 -- 172.21.15.46:0/443775617 learned_addr learned my addr 172.21.15.46:0/443775617 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde9259c640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde94100e20 0x7fde940fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.395+0000 7fde92d9d640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde94102ef0 0x7fde940fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8bfff640 1 -- 172.21.15.46:0/443775617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde94100e20 msgr2=0x7fde940fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8bfff640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde94100e20 0x7fde940fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8bfff640 1 -- 172.21.15.46:0/443775617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde94102ef0 msgr2=0x7fde940fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8bfff640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde94102ef0 0x7fde940fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8bfff640 1 -- 172.21.15.46:0/443775617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde941a6a80 con 0x7fde94102570 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8bfff640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde940fd1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006010 tx=0x7fde7c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c03f070 con 0x7fde94102570 2024-09-19T09:16:12.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde7c031c30 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde941a6d10 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c035030 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.396+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde941a71a0 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.397+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde94101200 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.398+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fde7c042070 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.399+0000 7fde8b7fe640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde800a3240 0x7fde800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.399+0000 7fde9259c640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde800a3240 0x7fde800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.399+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fde7c0efc20 con 0x7fde94102570 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.400+0000 7fde9259c640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde800a3240 0x7fde800a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fde8400bbe0 tx=0x7fde8400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:12.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.403+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde7c031de0 con 0x7fde94102570 2024-09-19T09:16:12.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.615+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde9410a0a0 con 0x7fde94102570 2024-09-19T09:16:12.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.615+0000 7fde8b7fe640 1 -- 172.21.15.46:0/443775617 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7fde7c0bc790 con 0x7fde94102570 2024-09-19T09:16:12.634 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:12.635 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":12,"btime":"2024-09-19T09:16:12:226918+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:16:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 12 2024-09-19T09:16:12.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.617+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde800a3240 msgr2=0x7fde800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.617+0000 7fde98d3f640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde800a3240 0x7fde800a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fde8400bbe0 tx=0x7fde8400b390 comp rx=0 tx=0).stop 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.617+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 msgr2=0x7fde940fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.617+0000 7fde98d3f640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde940fd1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006010 tx=0x7fde7c003c10 comp rx=0 tx=0).stop 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 shutdown_connections 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde800a3240 0x7fde800a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde94102570 0x7fde940fd1c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde94102ef0 0x7fde940fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 --2- 172.21.15.46:0/443775617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde94100e20 0x7fde940fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 >> 172.21.15.46:0/443775617 conn(0x7fde940fc7d0 msgr2=0x7fde9406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 shutdown_connections 2024-09-19T09:16:12.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:12.618+0000 7fde98d3f640 1 -- 172.21.15.46:0/443775617 wait complete. 2024-09-19T09:16:12.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: Deploying daemon mds.b on smithi099 2024-09-19T09:16:12.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.46:6840/321773391,v1:172.21.15.46:6841/321773391] up:boot 2024-09-19T09:16:12.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: fsmap 11 up:standby 2024-09-19T09:16:12.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:16:12.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:12 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/443775617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:12.950 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:12.951 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: Deploying daemon mds.b on smithi099 2024-09-19T09:16:12.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.46:6840/321773391,v1:172.21.15.46:6841/321773391] up:boot 2024-09-19T09:16:12.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: fsmap 11 up:standby 2024-09-19T09:16:12.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:16:12.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:12 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/443775617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: Deploying daemon mds.b on smithi099 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.46:6840/321773391,v1:172.21.15.46:6841/321773391] up:boot 2024-09-19T09:16:12.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: fsmap 11 up:standby 2024-09-19T09:16:12.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:16:12.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:12 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/443775617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:13.762 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:13 smithi099 systemd[1]: Starting Ceph mds.b for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:16:14.162 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:13 smithi099 podman[65023]: 2024-09-19 09:16:13.792479873 +0000 UTC m=+0.015574687 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:16:14.162 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:13 smithi099 podman[65023]: 2024-09-19 09:16:13.892537864 +0000 UTC m=+0.115632671 container create c5a33ce3e8cc070159bf7c05a8e5f7a70f904323d0c9358c84f9059ac13c9b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:16:14.513 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:14 smithi099 podman[65023]: 2024-09-19 09:16:14.162234692 +0000 UTC m=+0.385329496 container init c5a33ce3e8cc070159bf7c05a8e5f7a70f904323d0c9358c84f9059ac13c9b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T09:16:14.513 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:14 smithi099 podman[65023]: 2024-09-19 09:16:14.165377674 +0000 UTC m=+0.388472486 container start c5a33ce3e8cc070159bf7c05a8e5f7a70f904323d0c9358c84f9059ac13c9b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:16:14.513 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mds[65042]: -- 172.21.15.99:0/2185497103 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d90383860 con 0x564d90360800 2024-09-19T09:16:14.513 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: starting mds.b at 2024-09-19T09:16:14.513 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:14 smithi099 bash[65023]: c5a33ce3e8cc070159bf7c05a8e5f7a70f904323d0c9358c84f9059ac13c9b41 2024-09-19T09:16:14.513 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:14 smithi099 systemd[1]: Started Ceph mds.b for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:16:14.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:14.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:14 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:14 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:14.992 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:14.992 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.992 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.992 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.992 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.993 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:14.993 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:14 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:15.274 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:16:15.537 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:15.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:15 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] up:boot 2024-09-19T09:16:15.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:15 smithi046 ceph-mon[31203]: fsmap 12 up:standby 2024-09-19T09:16:15.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:15 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:16:15.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:15 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] up:boot 2024-09-19T09:16:15.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:15 smithi115 ceph-mon[35055]: fsmap 12 up:standby 2024-09-19T09:16:15.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:15 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 -- 172.21.15.46:0/799824550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc101de0 msgr2=0x7f2afc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 --2- 172.21.15.46:0/799824550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc101de0 0x7f2afc1021c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009ca0 tx=0x7f2aec02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 -- 172.21.15.46:0/799824550 shutdown_connections 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 --2- 172.21.15.46:0/799824550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc106f10 0x7f2afc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 --2- 172.21.15.46:0/799824550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2afc102790 0x7f2afc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 --2- 172.21.15.46:0/799824550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc101de0 0x7f2afc1021c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 -- 172.21.15.46:0/799824550 >> 172.21.15.46:0/799824550 conn(0x7f2afc0fd8c0 msgr2=0x7f2afc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 -- 172.21.15.46:0/799824550 shutdown_connections 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 -- 172.21.15.46:0/799824550 wait complete. 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.993+0000 7f2b01258640 1 Processor -- start 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 -- start start 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc101de0 0x7f2afc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 0x7f2afc19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2afc106f10 0x7f2afc19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc111f70 con 0x7f2afc102790 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc111df0 con 0x7f2afc101de0 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2b01258640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2afc1120f0 con 0x7f2afc106f10 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 0x7f2afc19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:16.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 0x7f2afc19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57200/0 (socket says 172.21.15.46:57200) 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc101de0 0x7f2afc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 -- 172.21.15.46:0/624996822 learned_addr learned my addr 172.21.15.46:0/624996822 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afb59e640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2afc106f10 0x7f2afc19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 -- 172.21.15.46:0/624996822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2afc106f10 msgr2=0x7f2afc19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2afc106f10 0x7f2afc19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 -- 172.21.15.46:0/624996822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc101de0 msgr2=0x7f2afc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc101de0 0x7f2afc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afa59c640 1 -- 172.21.15.46:0/624996822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2afc19f5b0 con 0x7f2afc102790 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.994+0000 7f2afad9d640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc101de0 0x7f2afc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.995+0000 7f2afa59c640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 0x7f2afc19ab40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e9f0 tx=0x7f2af000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.995+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af000cd80 con 0x7f2afc102790 2024-09-19T09:16:16.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.995+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2afc19f8a0 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.995+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2af0005500 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.995+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af0010690 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.995+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2afc1a7180 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.996+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2afc1021c0 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.997+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2af00046c0 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.998+0000 7f2ae3fff640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ae40a3240 0x7f2ae40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.998+0000 7f2afad9d640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ae40a3240 0x7f2ae40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.998+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f2af00cf8f0 con 0x7f2afc102790 2024-09-19T09:16:16.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:15.998+0000 7f2afad9d640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ae40a3240 0x7f2ae40a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2aec006010 tx=0x7f2aec005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:16.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.002+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2af009ca10 con 0x7f2afc102790 2024-09-19T09:16:16.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:15 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] up:boot 2024-09-19T09:16:16.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:15 smithi099 ceph-mon[35256]: fsmap 12 up:standby 2024-09-19T09:16:16.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:15 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:16:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.223+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2afc1a7480 con 0x7f2afc102790 2024-09-19T09:16:16.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.224+0000 7f2ae3fff640 1 -- 172.21.15.46:0/624996822 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7f2af009c310 con 0x7f2afc102790 2024-09-19T09:16:16.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:16.226 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":13,"btime":"2024-09-19T09:16:14:642614+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24446,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:16:16.226 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2024-09-19T09:16:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ae40a3240 msgr2=0x7f2ae40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ae40a3240 0x7f2ae40a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2aec006010 tx=0x7f2aec005f30 comp rx=0 tx=0).stop 2024-09-19T09:16:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 msgr2=0x7f2afc19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 0x7f2afc19ab40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e9f0 tx=0x7f2af000edf0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 shutdown_connections 2024-09-19T09:16:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ae40a3240 0x7f2ae40a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2afc102790 0x7f2afc19ab40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2afc106f10 0x7f2afc19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 --2- 172.21.15.46:0/624996822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2afc101de0 0x7f2afc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 >> 172.21.15.46:0/624996822 conn(0x7f2afc0fd8c0 msgr2=0x7f2afc0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.227+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 shutdown_connections 2024-09-19T09:16:16.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:16.228+0000 7f2b01258640 1 -- 172.21.15.46:0/624996822 wait complete. 2024-09-19T09:16:16.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:16:17.156 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:17.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:16 smithi115 ceph-mon[35055]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:17.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:16 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:16 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/624996822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:16 smithi046 ceph-mon[31203]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:16 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:16 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/624996822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:17.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:16 smithi099 ceph-mon[35256]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:17.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:16 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:16 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/624996822' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:17.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 -- 172.21.15.46:0/3485437240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 msgr2=0x7fb520106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 --2- 172.21.15.46:0/3485437240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520106860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb510009930 tx=0x7fb51002a420 comp rx=0 tx=0).stop 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 -- 172.21.15.46:0/3485437240 shutdown_connections 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 --2- 172.21.15.46:0/3485437240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520106860 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 --2- 172.21.15.46:0/3485437240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520106fc0 0x7fb52010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 --2- 172.21.15.46:0/3485437240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb520100370 0x7fb520100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 -- 172.21.15.46:0/3485437240 >> 172.21.15.46:0/3485437240 conn(0x7fb520077210 msgr2=0x7fb5200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 -- 172.21.15.46:0/3485437240 shutdown_connections 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.625+0000 7fb52826f640 1 -- 172.21.15.46:0/3485437240 wait complete. 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.626+0000 7fb52826f640 1 Processor -- start 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.626+0000 7fb52826f640 1 -- start start 2024-09-19T09:16:17.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520100370 0x7fb5201012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520101830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb520106fc0 0x7fb520101d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb520111f60 con 0x7fb520100d20 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb520111de0 con 0x7fb520100370 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201120e0 con 0x7fb520106fc0 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520101830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520101830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57224/0 (socket says 172.21.15.46:57224) 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52600b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520100370 0x7fb5201012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 -- 172.21.15.46:0/1355238714 learned_addr learned my addr 172.21.15.46:0/1355238714 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52680c640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb520106fc0 0x7fb520101d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 -- 172.21.15.46:0/1355238714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb520106fc0 msgr2=0x7fb520101d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:17.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb520106fc0 0x7fb520101d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 -- 172.21.15.46:0/1355238714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520100370 msgr2=0x7fb5201012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520100370 0x7fb5201012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 -- 172.21.15.46:0/1355238714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5201a68f0 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52580a640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520101830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb510005940 tx=0x7fb5100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51003f030 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5201a6b80 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb510003ce0 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb510035070 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.627+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5201a70b0 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.628+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb520100750 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.630+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb510042030 con 0x7fb520100d20 2024-09-19T09:16:17.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.630+0000 7fb5177fe640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb50c0a3240 0x7fb50c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.630+0000 7fb52600b640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb50c0a3240 0x7fb50c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.630+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7fb5100efb70 con 0x7fb520100d20 2024-09-19T09:16:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.631+0000 7fb52600b640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb50c0a3240 0x7fb50c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00bbe0 tx=0x7fb51c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:17.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.633+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5100bc6e0 con 0x7fb520100d20 2024-09-19T09:16:17.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.833+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb52010a100 con 0x7fb520100d20 2024-09-19T09:16:17.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.833+0000 7fb5177fe640 1 -- 172.21.15.46:0/1355238714 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) ==== 84+0+65 (secure 0 0 0) 0x7fb5100c09e0 con 0x7fb520100d20 2024-09-19T09:16:17.835 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:17.835 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-09-19T09:16:17.835 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:16:17.835 INFO:teuthology.orchestra.run.smithi046.stdout: "poolnum": 1, 2024-09-19T09:16:17.835 INFO:teuthology.orchestra.run.smithi046.stdout: "poolname": ".mgr" 2024-09-19T09:16:17.836 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:16:17.836 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-09-19T09:16:17.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb50c0a3240 msgr2=0x7fb50c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:17.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb50c0a3240 0x7fb50c0a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00bbe0 tx=0x7fb51c00b390 comp rx=0 tx=0).stop 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 msgr2=0x7fb520101830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520101830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb510005940 tx=0x7fb5100042f0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 shutdown_connections 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb50c0a3240 0x7fb50c0a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb520100d20 0x7fb520101830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb520106fc0 0x7fb520101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 --2- 172.21.15.46:0/1355238714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb520100370 0x7fb5201012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 >> 172.21.15.46:0/1355238714 conn(0x7fb520077210 msgr2=0x7fb5200fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 shutdown_connections 2024-09-19T09:16:17.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:17.836+0000 7fb52826f640 1 -- 172.21.15.46:0/1355238714 wait complete. 2024-09-19T09:16:18.139 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:18.139 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.139 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.139 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:18.140 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:18.140 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.140 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:18.140 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:17 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1355238714' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:16:18.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:18.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:18.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:18.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:18.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:17 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1355238714' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:16:18.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:18.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:18.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:18.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:18.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:16:18.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:17 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1355238714' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:16:19.088 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:16:19.088 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:16:19.378 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:19.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:19 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.784 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.784 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.784 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.784 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.784 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:19 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 -- 172.21.15.46:0/3540110577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40101420 msgr2=0x7f0b4010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 --2- 172.21.15.46:0/3540110577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40101420 0x7f0b4010d950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009cd0 tx=0x7f0b3802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 -- 172.21.15.46:0/3540110577 shutdown_connections 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 --2- 172.21.15.46:0/3540110577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40101420 0x7f0b4010d950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 --2- 172.21.15.46:0/3540110577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b40100a80 0x7f0b40100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 --2- 172.21.15.46:0/3540110577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b40106a80 0x7f0b40106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 -- 172.21.15.46:0/3540110577 >> 172.21.15.46:0/3540110577 conn(0x7f0b400fc7a0 msgr2=0x7f0b400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 -- 172.21.15.46:0/3540110577 shutdown_connections 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.868+0000 7f0b46787640 1 -- 172.21.15.46:0/3540110577 wait complete. 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 Processor -- start 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 -- start start 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 0x7f0b40198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b40101420 0x7f0b40198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b40106a80 0x7f0b4019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:19.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40110e80 con 0x7f0b40100a80 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40110d00 con 0x7f0b40106a80 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b46787640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40111000 con 0x7f0b40101420 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 0x7f0b40198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b3ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 0x7f0b40198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49570/0 (socket says 172.21.15.46:49570) 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b3ffff640 1 -- 172.21.15.46:0/3449928297 learned_addr learned my addr 172.21.15.46:0/3449928297 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b3f7fe640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b40101420 0x7f0b40198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.869+0000 7f0b44d24640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b40106a80 0x7f0b4019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3ffff640 1 -- 172.21.15.46:0/3449928297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b40101420 msgr2=0x7f0b40198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3ffff640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b40101420 0x7f0b40198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3ffff640 1 -- 172.21.15.46:0/3449928297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b40106a80 msgr2=0x7f0b4019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3ffff640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b40106a80 0x7f0b4019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3ffff640 1 -- 172.21.15.46:0/3449928297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4019d3e0 con 0x7f0b40100a80 2024-09-19T09:16:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3ffff640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 0x7f0b40198430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d950 tx=0x7f0b3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30017070 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b30009c30 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4019d6d0 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000f6b0 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.870+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b401a4fb0 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.871+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b40100ee0 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.872+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0b300109d0 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.873+0000 7f0b3d7fa640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b280a32c0 0x7f0b280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.873+0000 7f0b3f7fe640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b280a32c0 0x7f0b280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.873+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7f0b300ceee0 con 0x7f0b40100a80 2024-09-19T09:16:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.874+0000 7f0b3f7fe640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b280a32c0 0x7f0b280a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b400fecd0 tx=0x7f0b3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:19.878+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b30009de0 con 0x7f0b40100a80 2024-09-19T09:16:19.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:19 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.063+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0b401a51e0 con 0x7f0b40100a80 2024-09-19T09:16:20.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:20 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3449928297' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:16:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.944+0000 7f0b3d7fa640 1 -- 172.21.15.46:0/3449928297 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) ==== 138+0+0 (secure 0 0 0) 0x7f0b3009ba50 con 0x7f0b40100a80 2024-09-19T09:16:20.946 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' created 2024-09-19T09:16:20.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:20.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.947 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:20.947 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:20.947 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.947 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:20 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3449928297' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b280a32c0 msgr2=0x7f0b280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b280a32c0 0x7f0b280a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b400fecd0 tx=0x7f0b3400b390 comp rx=0 tx=0).stop 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 msgr2=0x7f0b40198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 0x7f0b40198430 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d950 tx=0x7f0b3000de10 comp rx=0 tx=0).stop 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 shutdown_connections 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0b280a32c0 0x7f0b280a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:20.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b40106a80 0x7f0b4019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b40101420 0x7f0b40198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 --2- 172.21.15.46:0/3449928297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b40100a80 0x7f0b40198430 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.947+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 >> 172.21.15.46:0/3449928297 conn(0x7f0b400fc7a0 msgr2=0x7f0b40104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.948+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 shutdown_connections 2024-09-19T09:16:20.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:20.948+0000 7f0b46787640 1 -- 172.21.15.46:0/3449928297 wait complete. 2024-09-19T09:16:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:16:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:16:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:16:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:20 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3449928297' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:16:21.600 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:16:21.862 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:22.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:21 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3449928297' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:16:22.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:21 smithi115 ceph-mon[35055]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:16:22.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:21 smithi115 ceph-mon[35055]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:21 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3449928297' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:16:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:21 smithi046 ceph-mon[31203]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:16:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:21 smithi046 ceph-mon[31203]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:21 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3449928297' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:16:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:21 smithi099 ceph-mon[35256]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:16:22.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:21 smithi099 ceph-mon[35256]: pgmap v274: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.347+0000 7f53b11e5640 1 -- 172.21.15.46:0/3508078861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 msgr2=0x7f53ac10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.347+0000 7f53b11e5640 1 --2- 172.21.15.46:0/3508078861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac10e790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ca0 tx=0x7f53a402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 -- 172.21.15.46:0/3508078861 shutdown_connections 2024-09-19T09:16:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 --2- 172.21.15.46:0/3508078861 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac10e790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 --2- 172.21.15.46:0/3508078861 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53ac1037a0 0x7f53ac10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 --2- 172.21.15.46:0/3508078861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53ac102df0 0x7f53ac1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 -- 172.21.15.46:0/3508078861 >> 172.21.15.46:0/3508078861 conn(0x7f53ac0fc7d0 msgr2=0x7f53ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 -- 172.21.15.46:0/3508078861 shutdown_connections 2024-09-19T09:16:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 -- 172.21.15.46:0/3508078861 wait complete. 2024-09-19T09:16:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 Processor -- start 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.348+0000 7f53b11e5640 1 -- start start 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53b11e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53ac102df0 0x7f53ac1a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53b11e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53ac1037a0 0x7f53ac1a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53b11e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53b11e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac1121d0 con 0x7f53ac10c2f0 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53b11e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac112050 con 0x7f53ac102df0 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53b11e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f53ac112350 con 0x7f53ac1037a0 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49588/0 (socket says 172.21.15.46:49588) 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 -- 172.21.15.46:0/1015793433 learned_addr learned my addr 172.21.15.46:0/1015793433 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:22.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53a3fff640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53ac1037a0 0x7f53ac1a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53aad9d640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53ac102df0 0x7f53ac1a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 -- 172.21.15.46:0/1015793433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53ac1037a0 msgr2=0x7f53ac1a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53ac1037a0 0x7f53ac1a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 -- 172.21.15.46:0/1015793433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53ac102df0 msgr2=0x7f53ac1a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53ac102df0 0x7f53ac1a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 -- 172.21.15.46:0/1015793433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac19af40 con 0x7f53ac10c2f0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.349+0000 7f53ab59e640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac19a6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005cc0 tx=0x7f53a4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.350+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4004240 con 0x7f53ac10c2f0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.350+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ac19b1d0 con 0x7f53ac10c2f0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.350+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53a4003e10 con 0x7f53ac10c2f0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.350+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a4030e10 con 0x7f53ac10c2f0 2024-09-19T09:16:22.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.350+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ac1a73b0 con 0x7f53ac10c2f0 2024-09-19T09:16:22.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.351+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ac06a790 con 0x7f53ac10c2f0 2024-09-19T09:16:22.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.353+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f53a4004b40 con 0x7f53ac10c2f0 2024-09-19T09:16:22.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.353+0000 7f53a8d99640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f53980a3240 0x7f53980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.354+0000 7f53aad9d640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f53980a3240 0x7f53980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.354+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7497+0+0 (secure 0 0 0) 0x7f53a40f0c70 con 0x7f53ac10c2f0 2024-09-19T09:16:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.354+0000 7f53aad9d640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f53980a3240 0x7f53980a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f539c009990 tx=0x7f539c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:22.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.357+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53a40bdc20 con 0x7f53ac10c2f0 2024-09-19T09:16:22.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.533+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f53ac1a75e0 con 0x7f53ac10c2f0 2024-09-19T09:16:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.965+0000 7f53a8d99640 1 -- 172.21.15.46:0/1015793433 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f53a40eee20 con 0x7f53ac10c2f0 2024-09-19T09:16:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' created 2024-09-19T09:16:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f53980a3240 msgr2=0x7f53980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:22.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f53980a3240 0x7f53980a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f539c009990 tx=0x7f539c009110 comp rx=0 tx=0).stop 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 msgr2=0x7f53ac19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac19a6d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005cc0 tx=0x7f53a4003c20 comp rx=0 tx=0).stop 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 shutdown_connections 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f53980a3240 0x7f53980a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f53ac10c2f0 0x7f53ac19a6d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f53ac1037a0 0x7f53ac1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 --2- 172.21.15.46:0/1015793433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53ac102df0 0x7f53ac1a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:22.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.968+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 >> 172.21.15.46:0/1015793433 conn(0x7f53ac0fc7d0 msgr2=0x7f53ac10d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.969+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 shutdown_connections 2024-09-19T09:16:22.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:22.969+0000 7f53b11e5640 1 -- 172.21.15.46:0/1015793433 wait complete. 2024-09-19T09:16:23.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:22 smithi046 ceph-mon[31203]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:16:23.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:22 smithi046 ceph-mon[31203]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:16:23.233 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:22 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1015793433' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:16:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:22 smithi099 ceph-mon[35256]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:16:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:22 smithi099 ceph-mon[35256]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:16:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:22 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1015793433' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:16:23.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:22 smithi115 ceph-mon[35055]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:16:23.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:22 smithi115 ceph-mon[35055]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:16:23.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:22 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1015793433' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:16:23.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:16:23.928 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:24.242 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:23 smithi046 ceph-mon[31203]: pgmap v276: 33 pgs: 12 creating+peering, 20 unknown, 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:24.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:23 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1015793433' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:16:24.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:23 smithi046 ceph-mon[31203]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:16:24.243 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:23 smithi046 ceph-mon[31203]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:16:24.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:23 smithi099 ceph-mon[35256]: pgmap v276: 33 pgs: 12 creating+peering, 20 unknown, 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:24.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:23 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1015793433' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:16:24.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:23 smithi099 ceph-mon[35256]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:16:24.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:23 smithi099 ceph-mon[35256]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:16:24.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 -- 172.21.15.46:0/978069426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 msgr2=0x7fc1c0074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/978069426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c0074a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009ca0 tx=0x7fc1b002a950 comp rx=0 tx=0).stop 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 -- 172.21.15.46:0/978069426 shutdown_connections 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/978069426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1c010e3d0 0x7fc1c0110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/978069426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0074f40 0x7fc1c010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/978069426 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c0074a00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 -- 172.21.15.46:0/978069426 >> 172.21.15.46:0/978069426 conn(0x7fc1c00fd8f0 msgr2=0x7fc1c00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 -- 172.21.15.46:0/978069426 shutdown_connections 2024-09-19T09:16:24.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 -- 172.21.15.46:0/978069426 wait complete. 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.420+0000 7fc1c48a0640 1 Processor -- start 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 -- start start 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0074f40 0x7fc1c019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1c010e3d0 0x7fc1c019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c01141b0 con 0x7fc1c0074620 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0114030 con 0x7fc1c010e3d0 2024-09-19T09:16:24.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1c48a0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0114330 con 0x7fc1c0074f40 2024-09-19T09:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49602/0 (socket says 172.21.15.46:49602) 2024-09-19T09:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 -- 172.21.15.46:0/2016427073 learned_addr learned my addr 172.21.15.46:0/2016427073 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1bed9d640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1c010e3d0 0x7fc1c019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1bdd9b640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0074f40 0x7fc1c019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:24.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 -- 172.21.15.46:0/2016427073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0074f40 msgr2=0x7fc1c019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:24.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0074f40 0x7fc1c019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 -- 172.21.15.46:0/2016427073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1c010e3d0 msgr2=0x7fc1c019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:24.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1c010e3d0 0x7fc1c019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.421+0000 7fc1be59c640 1 -- 172.21.15.46:0/2016427073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c019f560 con 0x7fc1c0074620 2024-09-19T09:16:24.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.422+0000 7fc1be59c640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c019a5b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00098d0 tx=0x7fc1b0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:24.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.422+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0034040 con 0x7fc1c0074620 2024-09-19T09:16:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.422+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c019f7f0 con 0x7fc1c0074620 2024-09-19T09:16:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.422+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b002fe20 con 0x7fc1c0074620 2024-09-19T09:16:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.422+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0004750 con 0x7fc1c0074620 2024-09-19T09:16:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.422+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c01a7130 con 0x7fc1c0074620 2024-09-19T09:16:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.423+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c0074a00 con 0x7fc1c0074620 2024-09-19T09:16:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.424+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc1b0037020 con 0x7fc1c0074620 2024-09-19T09:16:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.425+0000 7fc1b77fe640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.425+0000 7fc1bdd9b640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.425+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7879+0+0 (secure 0 0 0) 0x7fc1b00f09d0 con 0x7fc1c0074620 2024-09-19T09:16:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.426+0000 7fc1bdd9b640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0101480 tx=0x7fc1a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:24.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.429+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc1b007f210 con 0x7fc1c0074620 2024-09-19T09:16:24.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:23 smithi115 ceph-mon[35055]: pgmap v276: 33 pgs: 12 creating+peering, 20 unknown, 1 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:24.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:23 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1015793433' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:16:24.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:23 smithi115 ceph-mon[35055]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:16:24.462 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:23 smithi115 ceph-mon[35055]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:16:24.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.643+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc1c01a7300 con 0x7fc1c0074620 2024-09-19T09:16:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.984+0000 7fc1b77fe640 1 -- 172.21.15.46:0/2016427073 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fc1b00bd880 con 0x7fc1c0074620 2024-09-19T09:16:24.986 INFO:teuthology.orchestra.run.smithi046.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:16:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.986+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1ac0a3240 msgr2=0x7fc1ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.986+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0101480 tx=0x7fc1a800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.986+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 msgr2=0x7fc1c019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.986+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c019a5b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00098d0 tx=0x7fc1b0003f10 comp rx=0 tx=0).stop 2024-09-19T09:16:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 shutdown_connections 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc1ac0a3240 0x7fc1ac0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1c010e3d0 0x7fc1c019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc1c0074f40 0x7fc1c019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 --2- 172.21.15.46:0/2016427073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1c0074620 0x7fc1c019a5b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 >> 172.21.15.46:0/2016427073 conn(0x7fc1c00fd8f0 msgr2=0x7fc1c00fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 shutdown_connections 2024-09-19T09:16:24.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:24.987+0000 7fc1c48a0640 1 -- 172.21.15.46:0/2016427073 wait complete. 2024-09-19T09:16:25.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:24 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2016427073' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:16:25.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:24 smithi046 ceph-mon[31203]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:16:25.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:24 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2016427073' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:16:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:24 smithi099 ceph-mon[35256]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:16:25.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:24 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2016427073' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:16:25.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:24 smithi115 ceph-mon[35055]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:16:25.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:16:25.949 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:26.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:25 smithi099 ceph-mon[35256]: pgmap v279: 97 pgs: 20 creating+peering, 59 unknown, 18 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:25 smithi099 ceph-mon[35256]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:16:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:25 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2016427073' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:16:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:25 smithi099 ceph-mon[35256]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:16:26.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:25 smithi099 ceph-mon[35256]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:16:26.336 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:25 smithi046 ceph-mon[31203]: pgmap v279: 97 pgs: 20 creating+peering, 59 unknown, 18 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:26.336 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:25 smithi046 ceph-mon[31203]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:16:26.336 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:25 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2016427073' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:16:26.336 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:25 smithi046 ceph-mon[31203]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:16:26.336 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:25 smithi046 ceph-mon[31203]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:16:26.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 -- 172.21.15.46:0/3548826812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba0104e80 msgr2=0x7f4ba0105330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:26.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 --2- 172.21.15.46:0/3548826812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba0104e80 0x7f4ba0105330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009ca0 tx=0x7f4b9802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 -- 172.21.15.46:0/3548826812 shutdown_connections 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 --2- 172.21.15.46:0/3548826812 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba0104e80 0x7f4ba0105330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 --2- 172.21.15.46:0/3548826812 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba006a370 0x7f4ba01009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 --2- 172.21.15.46:0/3548826812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0069f00 0x7f4ba0100480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 -- 172.21.15.46:0/3548826812 >> 172.21.15.46:0/3548826812 conn(0x7f4ba0077210 msgr2=0x7f4ba00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 -- 172.21.15.46:0/3548826812 shutdown_connections 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.417+0000 7f4ba6549640 1 -- 172.21.15.46:0/3548826812 wait complete. 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 Processor -- start 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 -- start start 2024-09-19T09:16:26.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0069f00 0x7f4ba01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 0x7f4ba0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba0104e80 0x7f4ba01a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0110f30 con 0x7f4ba006a370 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0110db0 con 0x7f4ba0069f00 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4ba6549640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba01110b0 con 0x7f4ba0104e80 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4b9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 0x7f4ba0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4b9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 0x7f4ba0199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49610/0 (socket says 172.21.15.46:49610) 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4b9f7fe640 1 -- 172.21.15.46:0/2972061681 learned_addr learned my addr 172.21.15.46:0/2972061681 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.418+0000 7f4b9ffff640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0069f00 0x7f4ba01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4ba4ae6640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba0104e80 0x7f4ba01a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:26.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9f7fe640 1 -- 172.21.15.46:0/2972061681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba0104e80 msgr2=0x7f4ba01a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9f7fe640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba0104e80 0x7f4ba01a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9f7fe640 1 -- 172.21.15.46:0/2972061681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0069f00 msgr2=0x7f4ba01993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9f7fe640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0069f00 0x7f4ba01993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9f7fe640 1 -- 172.21.15.46:0/2972061681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba01a4980 con 0x7f4ba006a370 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4ba4ae6640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba0104e80 0x7f4ba01a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9f7fe640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 0x7f4ba0199900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400b4a0 tx=0x7f4b9400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94015020 con 0x7f4ba006a370 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba01a4b50 con 0x7f4ba006a370 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b94011d10 con 0x7f4ba006a370 2024-09-19T09:16:26.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400f2e0 con 0x7f4ba006a370 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.419+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba01a5060 con 0x7f4ba006a370 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.420+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba01053b0 con 0x7f4ba006a370 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.421+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4b94018020 con 0x7f4ba006a370 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.422+0000 7f4b9d7fa640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b880a3240 0x7f4b880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.422+0000 7f4b9ffff640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b880a3240 0x7f4b880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.422+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f4b940cf0b0 con 0x7f4ba006a370 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.423+0000 7f4b9ffff640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b880a3240 0x7f4b880a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009990 tx=0x7f4b90009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:26.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.427+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b9401f020 con 0x7f4ba006a370 2024-09-19T09:16:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:25 smithi115 ceph-mon[35055]: pgmap v279: 97 pgs: 20 creating+peering, 59 unknown, 18 active+clean; 577 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:16:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:25 smithi115 ceph-mon[35055]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:16:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:25 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2016427073' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:16:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:25 smithi115 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:16:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:25 smithi115 ceph-mon[35055]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:16:26.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.606+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ba01a5290 con 0x7f4ba006a370 2024-09-19T09:16:26.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.607+0000 7f4b9d7fa640 1 -- 172.21.15.46:0/2972061681 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22245 (secure 0 0 0) 0x7f4b9409bf20 con 0x7f4ba006a370 2024-09-19T09:16:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:26.609 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":82,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:16:24.645850+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.609+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b880a3240 msgr2=0x7f4b880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.609+0000 7f4ba6549640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b880a3240 0x7f4b880a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009990 tx=0x7f4b90009110 comp rx=0 tx=0).stop 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.609+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 msgr2=0x7f4ba0199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.609+0000 7f4ba6549640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 0x7f4ba0199900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400b4a0 tx=0x7f4b9400b8a0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.609+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 shutdown_connections 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.609+0000 7f4ba6549640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b880a3240 0x7f4b880a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.610+0000 7f4ba6549640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ba006a370 0x7f4ba0199900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.610+0000 7f4ba6549640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ba0104e80 0x7f4ba01a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.610+0000 7f4ba6549640 1 --2- 172.21.15.46:0/2972061681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ba0069f00 0x7f4ba01993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.610+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 >> 172.21.15.46:0/2972061681 conn(0x7f4ba0077210 msgr2=0x7f4ba0102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.610+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 shutdown_connections 2024-09-19T09:16:26.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:26.610+0000 7f4ba6549640 1 -- 172.21.15.46:0/2972061681 wait complete. 2024-09-19T09:16:27.191 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:26 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] up:active 2024-09-19T09:16:27.191 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:26 smithi046 ceph-mon[31203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:26 smithi046 ceph-mon[31203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:27.192 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:26 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2972061681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:27.223 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:16:27.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:26 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] up:active 2024-09-19T09:16:27.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:26 smithi099 ceph-mon[35256]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:27.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:26 smithi099 ceph-mon[35256]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:27.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:26 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2972061681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:27.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:26 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] up:active 2024-09-19T09:16:27.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:26 smithi115 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:27.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:26 smithi115 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:27.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:26 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2972061681' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:27.499 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 -- 172.21.15.46:0/1249712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308101420 msgr2=0x7f930810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 --2- 172.21.15.46:0/1249712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308101420 0x7f930810d950 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9300009cd0 tx=0x7f930002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 -- 172.21.15.46:0/1249712822 shutdown_connections 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 --2- 172.21.15.46:0/1249712822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308101420 0x7f930810d950 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 --2- 172.21.15.46:0/1249712822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9308100a80 0x7f9308100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 --2- 172.21.15.46:0/1249712822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308106a80 0x7f9308106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 -- 172.21.15.46:0/1249712822 >> 172.21.15.46:0/1249712822 conn(0x7f93080fc7a0 msgr2=0x7f93080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 -- 172.21.15.46:0/1249712822 shutdown_connections 2024-09-19T09:16:27.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.944+0000 7f930fbb3640 1 -- 172.21.15.46:0/1249712822 wait complete. 2024-09-19T09:16:27.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 Processor -- start 2024-09-19T09:16:27.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 -- start start 2024-09-19T09:16:27.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9308100a80 0x7f9308199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:27.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308101420 0x7f9308199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:27.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 0x7f93081a4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:27.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9308110f20 con 0x7f9308106a80 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9308110da0 con 0x7f9308101420 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930fbb3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f93081110a0 con 0x7f9308100a80 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930e150640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 0x7f93081a4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930e150640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 0x7f93081a4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49618/0 (socket says 172.21.15.46:49618) 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.945+0000 7f930e150640 1 -- 172.21.15.46:0/3737797517 learned_addr learned my addr 172.21.15.46:0/3737797517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930d14e640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308101420 0x7f9308199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930d94f640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9308100a80 0x7f9308199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930e150640 1 -- 172.21.15.46:0/3737797517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9308100a80 msgr2=0x7f9308199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930e150640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9308100a80 0x7f9308199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930e150640 1 -- 172.21.15.46:0/3737797517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308101420 msgr2=0x7f9308199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930e150640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308101420 0x7f9308199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930e150640 1 -- 172.21.15.46:0/3737797517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081a49d0 con 0x7f9308106a80 2024-09-19T09:16:27.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930d14e640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308101420 0x7f9308199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:16:27.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930e150640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 0x7f93081a4490 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9300006010 tx=0x7f9300003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:27.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300004450 con 0x7f9308106a80 2024-09-19T09:16:27.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081a4ba0 con 0x7f9308106a80 2024-09-19T09:16:27.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9300003e10 con 0x7f9308106a80 2024-09-19T09:16:27.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000466e0 con 0x7f9308106a80 2024-09-19T09:16:27.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.946+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93081a5080 con 0x7f9308106a80 2024-09-19T09:16:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.947+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9308100f60 con 0x7f9308106a80 2024-09-19T09:16:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.948+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f93000305a0 con 0x7f9308106a80 2024-09-19T09:16:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.949+0000 7f92feffd640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92f40a3240 0x7f92f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.949+0000 7f930d94f640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92f40a3240 0x7f92f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.949+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f930002e030 con 0x7f9308106a80 2024-09-19T09:16:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.950+0000 7f930d94f640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92f40a3240 0x7f92f40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9304009890 tx=0x7f9304008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:27.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:27.953+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f930004b060 con 0x7f9308106a80 2024-09-19T09:16:28.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.134+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9308109010 con 0x7f9308106a80 2024-09-19T09:16:28.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.135+0000 7f92feffd640 1 -- 172.21.15.46:0/3737797517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22245 (secure 0 0 0) 0x7f93000bde10 con 0x7f9308106a80 2024-09-19T09:16:28.137 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:28.137 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":82,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:16:24.645850+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92f40a3240 msgr2=0x7f92f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92f40a3240 0x7f92f40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9304009890 tx=0x7f9304008040 comp rx=0 tx=0).stop 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 msgr2=0x7f93081a4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 0x7f93081a4490 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9300006010 tx=0x7f9300003c20 comp rx=0 tx=0).stop 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 shutdown_connections 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f92f40a3240 0x7f92f40a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9308106a80 0x7f93081a4490 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9308101420 0x7f9308199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 --2- 172.21.15.46:0/3737797517 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9308100a80 0x7f9308199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 >> 172.21.15.46:0/3737797517 conn(0x7f93080fc7a0 msgr2=0x7f93080fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:28.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 shutdown_connections 2024-09-19T09:16:28.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:28.138+0000 7f930fbb3640 1 -- 172.21.15.46:0/3737797517 wait complete. 2024-09-19T09:16:28.171 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:27 smithi046 ceph-mon[31203]: pgmap v281: 97 pgs: 8 creating+peering, 7 unknown, 82 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 6 op/s 2024-09-19T09:16:28.171 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:27 smithi046 ceph-mon[31203]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:16:28.171 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:27 smithi046 ceph-mon[31203]: Cluster is now healthy 2024-09-19T09:16:28.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:27 smithi099 ceph-mon[35256]: pgmap v281: 97 pgs: 8 creating+peering, 7 unknown, 82 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 6 op/s 2024-09-19T09:16:28.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:27 smithi099 ceph-mon[35256]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:16:28.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:27 smithi099 ceph-mon[35256]: Cluster is now healthy 2024-09-19T09:16:28.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:27 smithi115 ceph-mon[35055]: pgmap v281: 97 pgs: 8 creating+peering, 7 unknown, 82 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 6 op/s 2024-09-19T09:16:28.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:27 smithi115 ceph-mon[35055]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:16:28.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:27 smithi115 ceph-mon[35055]: Cluster is now healthy 2024-09-19T09:16:28.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:16:29.118 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:29.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:28 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3737797517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:29.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:28 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3737797517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:29.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:28 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3737797517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 -- 172.21.15.46:0/186917172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 msgr2=0x7f068c107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 --2- 172.21.15.46:0/186917172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c107ed0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0688009930 tx=0x7f068802a420 comp rx=0 tx=0).stop 2024-09-19T09:16:29.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 -- 172.21.15.46:0/186917172 shutdown_connections 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 --2- 172.21.15.46:0/186917172 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c102380 0x7f068c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 --2- 172.21.15.46:0/186917172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f068c1019e0 0x7f068c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 --2- 172.21.15.46:0/186917172 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c107ed0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 -- 172.21.15.46:0/186917172 >> 172.21.15.46:0/186917172 conn(0x7f068c0fd700 msgr2=0x7f068c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 -- 172.21.15.46:0/186917172 shutdown_connections 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 -- 172.21.15.46:0/186917172 wait complete. 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 Processor -- start 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.666+0000 7f0692f9d640 1 -- start start 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c1019e0 0x7f068c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:29.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f068c102380 0x7f068c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f068c111f60 con 0x7f068c107af0 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f068c111de0 con 0x7f068c102380 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f068c1120e0 con 0x7f068c1019e0 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52678/0 (socket says 172.21.15.46:52678) 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 -- 172.21.15.46:0/3042535994 learned_addr learned my addr 172.21.15.46:0/3042535994 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069179a640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f068c102380 0x7f068c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0691f9b640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c1019e0 0x7f068c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 -- 172.21.15.46:0/3042535994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c1019e0 msgr2=0x7f068c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:29.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c1019e0 0x7f068c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 -- 172.21.15.46:0/3042535994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f068c102380 msgr2=0x7f068c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f068c102380 0x7f068c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 -- 172.21.15.46:0/3042535994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c1a6990 con 0x7f068c107af0 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f069279c640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c074f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f068400b970 tx=0x7f068400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684019070 con 0x7f068c107af0 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f068400cb40 con 0x7f068c107af0 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068c1a6c80 con 0x7f068c107af0 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.667+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684007650 con 0x7f068c107af0 2024-09-19T09:16:29.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.668+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068c1a71c0 con 0x7f068c107af0 2024-09-19T09:16:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.669+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c101e40 con 0x7f068c107af0 2024-09-19T09:16:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.670+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f068401c070 con 0x7f068c107af0 2024-09-19T09:16:29.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.671+0000 7f0682ffd640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f06780a3240 0x7f06780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.671+0000 7f0691f9b640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f06780a3240 0x7f06780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.671+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f06840ced50 con 0x7f068c107af0 2024-09-19T09:16:29.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.671+0000 7f0691f9b640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f06780a3240 0x7f06780a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0688006010 tx=0x7f0688005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:29.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.675+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06840d2030 con 0x7f068c107af0 2024-09-19T09:16:29.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.887+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f068c103120 con 0x7f068c107af0 2024-09-19T09:16:29.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.995+0000 7f0682ffd640 1 -- 172.21.15.46:0/3042535994 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f068409b570 con 0x7f068c107af0 2024-09-19T09:16:29.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f06780a3240 msgr2=0x7f06780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:29.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f06780a3240 0x7f06780a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0688006010 tx=0x7f0688005a20 comp rx=0 tx=0).stop 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 msgr2=0x7f068c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c074f70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f068400b970 tx=0x7f068400be30 comp rx=0 tx=0).stop 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 shutdown_connections 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f06780a3240 0x7f06780a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f068c107af0 0x7f068c074f70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f068c102380 0x7f068c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 --2- 172.21.15.46:0/3042535994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c1019e0 0x7f068c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 >> 172.21.15.46:0/3042535994 conn(0x7f068c0fd700 msgr2=0x7f068c0fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 shutdown_connections 2024-09-19T09:16:29.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:29.997+0000 7f0692f9d640 1 -- 172.21.15.46:0/3042535994 wait complete. 2024-09-19T09:16:30.000 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: 2024-09-19T09:16:29.651+0000 7f297cd5d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:16:30.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:30 smithi046 ceph-mon[31203]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 5 op/s 2024-09-19T09:16:30.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:30 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3042535994' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:16:30.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:30 smithi099 ceph-mon[35256]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 5 op/s 2024-09-19T09:16:30.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:30 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3042535994' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:16:30.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:30 smithi115 ceph-mon[35055]: pgmap v282: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 5 op/s 2024-09-19T09:16:30.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:30 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3042535994' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:16:30.624 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-19T09:16:30.624 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T09:16:30.881 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:31.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:31 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3042535994' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:16:31.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:31 smithi099 ceph-mon[35256]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:31.265 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:31 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3042535994' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:16:31.265 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:31 smithi046 ceph-mon[31203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 -- 172.21.15.46:0/1302034290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4101de0 msgr2=0x7fe7b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1302034290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4101de0 0x7fe7b41021c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009900 tx=0x7fe7a802a410 comp rx=0 tx=0).stop 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 -- 172.21.15.46:0/1302034290 shutdown_connections 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1302034290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7b4106f10 0x7fe7b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1302034290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7b4102790 0x7fe7b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1302034290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4101de0 0x7fe7b41021c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 -- 172.21.15.46:0/1302034290 >> 172.21.15.46:0/1302034290 conn(0x7fe7b40fd8c0 msgr2=0x7fe7b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:31.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 -- 172.21.15.46:0/1302034290 shutdown_connections 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.349+0000 7fe7baea8640 1 -- 172.21.15.46:0/1302034290 wait complete. 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.350+0000 7fe7baea8640 1 Processor -- start 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.350+0000 7fe7baea8640 1 -- start start 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7b4101de0 0x7fe7b41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 0x7fe7b4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7b4106f10 0x7fe7b419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b4111f90 con 0x7fe7b4102790 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b4111e10 con 0x7fe7b4106f10 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b4112110 con 0x7fe7b4101de0 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 0x7fe7b4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 0x7fe7b4198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52690/0 (socket says 172.21.15.46:52690) 2024-09-19T09:16:31.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 -- 172.21.15.46:0/1392381393 learned_addr learned my addr 172.21.15.46:0/1392381393 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b8c44640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7b4101de0 0x7fe7b41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b9445640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7b4106f10 0x7fe7b419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 -- 172.21.15.46:0/1392381393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7b4101de0 msgr2=0x7fe7b41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7b4101de0 0x7fe7b41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 -- 172.21.15.46:0/1392381393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7b4106f10 msgr2=0x7fe7b419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7b4106f10 0x7fe7b419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 -- 172.21.15.46:0/1392381393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b419d480 con 0x7fe7b4102790 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b3fff640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 0x7fe7b4198a10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000b4a0 tx=0x7fe7a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0014070 con 0x7fe7b4102790 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7a0010af0 con 0x7fe7b4102790 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b419d770 con 0x7fe7b4102790 2024-09-19T09:16:31.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.351+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0017d10 con 0x7fe7b4102790 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.352+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b41a5050 con 0x7fe7b4102790 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.353+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b41021c0 con 0x7fe7b4102790 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.354+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe7a0017070 con 0x7fe7b4102790 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.355+0000 7fe7b1ffb640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe7a40a3240 0x7fe7a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.355+0000 7fe7b8c44640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe7a40a3240 0x7fe7a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.355+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe7a00cecb0 con 0x7fe7b4102790 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.355+0000 7fe7b8c44640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe7a40a3240 0x7fe7a40a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80096c0 tx=0x7fe7a8031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:31.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.359+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe7a009bb20 con 0x7fe7b4102790 2024-09-19T09:16:31.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:31 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3042535994' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:16:31.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:31 smithi115 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:31.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:31.576+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fe7b410a150 con 0x7fe7b4102790 2024-09-19T09:16:32.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.014+0000 7fe7b1ffb640 1 -- 172.21.15.46:0/1392381393 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fe7a009b420 con 0x7fe7b4102790 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe7a40a3240 msgr2=0x7fe7a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe7a40a3240 0x7fe7a40a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80096c0 tx=0x7fe7a8031490 comp rx=0 tx=0).stop 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 msgr2=0x7fe7b4198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 0x7fe7b4198a10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000b4a0 tx=0x7fe7a000b960 comp rx=0 tx=0).stop 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 shutdown_connections 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe7a40a3240 0x7fe7a40a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7b4102790 0x7fe7b4198a10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7b4106f10 0x7fe7b419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 --2- 172.21.15.46:0/1392381393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7b4101de0 0x7fe7b41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 >> 172.21.15.46:0/1392381393 conn(0x7fe7b40fd8c0 msgr2=0x7fe7b40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:32.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 shutdown_connections 2024-09-19T09:16:32.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:32.017+0000 7fe7baea8640 1 -- 172.21.15.46:0/1392381393 wait complete. 2024-09-19T09:16:32.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:32 smithi099 ceph-mon[35256]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T09:16:32.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:32 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1392381393' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:16:32.387 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:32 smithi046 ceph-mon[31203]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T09:16:32.387 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:32 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1392381393' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:16:32.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:32 smithi115 ceph-mon[35055]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T09:16:32.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:32 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1392381393' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T09:16:32.713 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:16:32.973 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:33.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:33 smithi099 ceph-mon[35256]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:16:33.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:33 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1392381393' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:16:33.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:33 smithi099 ceph-mon[35256]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:16:33.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:33 smithi099 ceph-mon[35256]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:33.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:33 smithi099 ceph-mon[35256]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:16:33.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:33 smithi099 ceph-mon[35256]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:16:33.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:33 smithi046 ceph-mon[31203]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:16:33.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:33 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1392381393' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:16:33.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:33 smithi046 ceph-mon[31203]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:16:33.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:33 smithi046 ceph-mon[31203]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:33.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:33 smithi046 ceph-mon[31203]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:16:33.333 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:33 smithi046 ceph-mon[31203]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.416+0000 7f54b30c2640 1 -- 172.21.15.46:0/1454189591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac102d30 msgr2=0x7f54ac103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.416+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1454189591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac102d30 0x7f54ac103110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009cd0 tx=0x7f54a402a910 comp rx=0 tx=0).stop 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- 172.21.15.46:0/1454189591 shutdown_connections 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1454189591 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ac1082a0 0x7f54ac10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1454189591 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac1036e0 0x7f54ac107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1454189591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac102d30 0x7f54ac103110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:33.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- 172.21.15.46:0/1454189591 >> 172.21.15.46:0/1454189591 conn(0x7f54ac0fc7d0 msgr2=0x7f54ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- 172.21.15.46:0/1454189591 shutdown_connections 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- 172.21.15.46:0/1454189591 wait complete. 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 Processor -- start 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- start start 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac102d30 0x7f54ac100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 0x7f54ac100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ac1082a0 0x7f54ac101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1120e0 con 0x7f54ac1036e0 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac111f60 con 0x7f54ac102d30 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.417+0000 7f54b30c2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112260 con 0x7f54ac1082a0 2024-09-19T09:16:33.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 0x7f54ac100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 0x7f54ac100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52708/0 (socket says 172.21.15.46:52708) 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 -- 172.21.15.46:0/1876898211 learned_addr learned my addr 172.21.15.46:0/1876898211 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54b0e5e640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac102d30 0x7f54ac100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 -- 172.21.15.46:0/1876898211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ac1082a0 msgr2=0x7f54ac101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ac1082a0 0x7f54ac101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 -- 172.21.15.46:0/1876898211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac102d30 msgr2=0x7f54ac100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac102d30 0x7f54ac100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 -- 172.21.15.46:0/1876898211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac1a6a70 con 0x7f54ac1036e0 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54b0e5e640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac102d30 0x7f54ac100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:33.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54abfff640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 0x7f54ac100ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54a0006fd0 tx=0x7f54a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0011830 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1a6d60 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54a0016070 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a000f2e0 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.418+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1a7210 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.419+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac06a850 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.420+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f54a001b460 con 0x7f54ac1036e0 2024-09-19T09:16:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.421+0000 7f54a9ffb640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f54940a3240 0x7f54940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:33.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.421+0000 7f54b0e5e640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f54940a3240 0x7f54940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:33.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.421+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f54a00ceef0 con 0x7f54ac1036e0 2024-09-19T09:16:33.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.422+0000 7f54b0e5e640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f54940a3240 0x7f54940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f54a4000f80 tx=0x7f54a4005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:33.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.426+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f54a0021250 con 0x7f54ac1036e0 2024-09-19T09:16:33.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:33 smithi115 ceph-mon[35055]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T09:16:33.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:33 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1392381393' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T09:16:33.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:33 smithi115 ceph-mon[35055]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T09:16:33.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:33 smithi115 ceph-mon[35055]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:16:33.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:33 smithi115 ceph-mon[35055]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T09:16:33.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:33 smithi115 ceph-mon[35055]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T09:16:33.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:33.638+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f54ac10a2b0 con 0x7f54ac1036e0 2024-09-19T09:16:34.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.030+0000 7f54a9ffb640 1 -- 172.21.15.46:0/1876898211 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f54a009bd60 con 0x7f54ac1036e0 2024-09-19T09:16:34.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f54940a3240 msgr2=0x7f54940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f54940a3240 0x7f54940a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f54a4000f80 tx=0x7f54a4005f40 comp rx=0 tx=0).stop 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 msgr2=0x7f54ac100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 0x7f54ac100ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54a0006fd0 tx=0x7f54a000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 shutdown_connections 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f54940a3240 0x7f54940a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54ac1036e0 0x7f54ac100ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:34.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f54ac1082a0 0x7f54ac101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:34.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 --2- 172.21.15.46:0/1876898211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54ac102d30 0x7f54ac100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:34.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 >> 172.21.15.46:0/1876898211 conn(0x7f54ac0fc7d0 msgr2=0x7f54ac105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:34.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 shutdown_connections 2024-09-19T09:16:34.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:34.032+0000 7f54b30c2640 1 -- 172.21.15.46:0/1876898211 wait complete. 2024-09-19T09:16:34.345 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T09:16:34.345 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:active 2024-09-19T09:16:34.345 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:16:34.345 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:16:34.346 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T09:16:34.346 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T09:16:34.346 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:34 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1876898211' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:active 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T09:16:34.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:34 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1876898211' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:16:34.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T09:16:34.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:active 2024-09-19T09:16:34.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T09:16:34.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T09:16:34.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T09:16:34.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T09:16:34.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1876898211' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:16:34.706 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:16:34.970 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:35.012 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: 2024-09-19T09:16:34.651+0000 7f297cd5d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T09:16:35.012 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: 2024-09-19T09:16:34.651+0000 7f297cd5d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T09:16:35.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:35 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1876898211' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:16:35.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:35 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:active 2024-09-19T09:16:35.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:35 smithi046 ceph-mon[31203]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:16:35.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:35 smithi046 ceph-mon[31203]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T09:16:35.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:35 smithi046 ceph-mon[31203]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-19T09:16:35.334 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:35 smithi046 ceph-mon[31203]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-19T09:16:35.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 -- 172.21.15.46:0/189858085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394100e20 msgr2=0x7fc394101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:35.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 --2- 172.21.15.46:0/189858085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394100e20 0x7fc394101200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc384009ca0 tx=0x7fc38402a950 comp rx=0 tx=0).stop 2024-09-19T09:16:35.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 -- 172.21.15.46:0/189858085 shutdown_connections 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 --2- 172.21.15.46:0/189858085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc394102ef0 0x7fc39410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 --2- 172.21.15.46:0/189858085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc394102570 0x7fc3941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 --2- 172.21.15.46:0/189858085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394100e20 0x7fc394101200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 -- 172.21.15.46:0/189858085 >> 172.21.15.46:0/189858085 conn(0x7fc3940fc7d0 msgr2=0x7fc3940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 -- 172.21.15.46:0/189858085 shutdown_connections 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 -- 172.21.15.46:0/189858085 wait complete. 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.418+0000 7fc398cda640 1 Processor -- start 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 -- start start 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc394100e20 0x7fc3941973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 0x7fc394197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc394102ef0 0x7fc39419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc394110fa0 con 0x7fc394102570 2024-09-19T09:16:35.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc394110e20 con 0x7fc394100e20 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc398cda640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc394111120 con 0x7fc394102ef0 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 0x7fc394197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 0x7fc394197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52722/0 (socket says 172.21.15.46:52722) 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 -- 172.21.15.46:0/4267207807 learned_addr learned my addr 172.21.15.46:0/4267207807 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc39259c640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc394100e20 0x7fc3941973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc392d9d640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc394102ef0 0x7fc39419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 -- 172.21.15.46:0/4267207807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc394102ef0 msgr2=0x7fc39419bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc394102ef0 0x7fc39419bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 -- 172.21.15.46:0/4267207807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc394100e20 msgr2=0x7fc3941973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc394100e20 0x7fc3941973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 -- 172.21.15.46:0/4267207807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39419c370 con 0x7fc394102570 2024-09-19T09:16:35.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc391d9b640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 0x7fc394197900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c920 tx=0x7fc37c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.419+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c007c70 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.420+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39419c660 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.420+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37c007e10 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.420+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c018890 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.420+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3941a3f40 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.421+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc394101200 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.422+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc37c018a70 con 0x7fc394102570 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.423+0000 7fc38b7fe640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3800a3240 0x7fc3800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.423+0000 7fc39259c640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3800a3240 0x7fc3800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:35.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.423+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc37c0cf860 con 0x7fc394102570 2024-09-19T09:16:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.423+0000 7fc39259c640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3800a3240 0x7fc3800a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3840093d0 tx=0x7fc384009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:35.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.427+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc37c014030 con 0x7fc394102570 2024-09-19T09:16:35.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:35 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1876898211' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:16:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:35 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:active 2024-09-19T09:16:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:35 smithi115 ceph-mon[35055]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:16:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:35 smithi115 ceph-mon[35055]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T09:16:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:35 smithi115 ceph-mon[35055]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-19T09:16:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:35 smithi115 ceph-mon[35055]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-19T09:16:35.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:35 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1876898211' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:16:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:35 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:active 2024-09-19T09:16:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:35 smithi099 ceph-mon[35256]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T09:16:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:35 smithi099 ceph-mon[35256]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T09:16:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:35 smithi099 ceph-mon[35256]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-09-19T09:16:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:35 smithi099 ceph-mon[35256]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-09-19T09:16:35.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:35.638+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc3941a4200 con 0x7fc394102570 2024-09-19T09:16:36.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.045+0000 7fc38b7fe640 1 -- 172.21.15.46:0/4267207807 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fc37c09c6d0 con 0x7fc394102570 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.047+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3800a3240 msgr2=0x7fc3800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.047+0000 7fc398cda640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3800a3240 0x7fc3800a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc3840093d0 tx=0x7fc384009360 comp rx=0 tx=0).stop 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.047+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 msgr2=0x7fc394197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.047+0000 7fc398cda640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 0x7fc394197900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00c920 tx=0x7fc37c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 shutdown_connections 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3800a3240 0x7fc3800a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:36.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc394102570 0x7fc394197900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:36.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc394102ef0 0x7fc39419bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:36.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 --2- 172.21.15.46:0/4267207807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc394100e20 0x7fc3941973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:36.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 >> 172.21.15.46:0/4267207807 conn(0x7fc3940fc7d0 msgr2=0x7fc394106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:36.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 shutdown_connections 2024-09-19T09:16:36.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:36.048+0000 7fc398cda640 1 -- 172.21.15.46:0/4267207807 wait complete. 2024-09-19T09:16:36.439 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 7 op/s 2024-09-19T09:16:36.439 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] up:active 2024-09-19T09:16:36.439 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:16:36.439 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:16:36.439 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: Cluster is now healthy 2024-09-19T09:16:36.440 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-19T09:16:36.440 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T09:16:36.440 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-19T09:16:36.440 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:36 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4267207807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:16:36.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 7 op/s 2024-09-19T09:16:36.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] up:active 2024-09-19T09:16:36.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:16:36.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:16:36.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: Cluster is now healthy 2024-09-19T09:16:36.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-19T09:16:36.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T09:16:36.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-19T09:16:36.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:36 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4267207807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:16:36.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 339 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s wr, 7 op/s 2024-09-19T09:16:36.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] up:active 2024-09-19T09:16:36.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T09:16:36.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T09:16:36.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: Cluster is now healthy 2024-09-19T09:16:36.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-09-19T09:16:36.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T09:16:36.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-09-19T09:16:36.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:36 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4267207807' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:16:36.800 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T09:16:36.801 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:16:37.065 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:37.304 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4267207807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:16:37.305 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:active 2024-09-19T09:16:37.305 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-mon[31203]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T09:16:37.305 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:16:37.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:37 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4267207807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:16:37.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:37 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:active 2024-09-19T09:16:37.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:37 smithi115 ceph-mon[35055]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T09:16:37.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:37 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.502+0000 7f4101578640 1 -- 172.21.15.46:0/3302461587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc103670 msgr2=0x7f40fc10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.502+0000 7f4101578640 1 --2- 172.21.15.46:0/3302461587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc103670 0x7f40fc10bb60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009900 tx=0x7f40e402a480 comp rx=0 tx=0).stop 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 -- 172.21.15.46:0/3302461587 shutdown_connections 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 --2- 172.21.15.46:0/3302461587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc103670 0x7f40fc10bb60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 --2- 172.21.15.46:0/3302461587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40fc10c180 0x7f40fc10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 --2- 172.21.15.46:0/3302461587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc102d50 0x7f40fc103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 -- 172.21.15.46:0/3302461587 >> 172.21.15.46:0/3302461587 conn(0x7f40fc0fc7d0 msgr2=0x7f40fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 -- 172.21.15.46:0/3302461587 shutdown_connections 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 -- 172.21.15.46:0/3302461587 wait complete. 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 Processor -- start 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.503+0000 7f4101578640 1 -- start start 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 0x7f40fc19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40fc103670 0x7f40fc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc10c180 0x7f40fc19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc111f80 con 0x7f40fc102d50 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc111e00 con 0x7f40fc103670 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc112100 con 0x7f40fc10c180 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 0x7f40fc19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:37.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 0x7f40fc19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52742/0 (socket says 172.21.15.46:52742) 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 -- 172.21.15.46:0/842179960 learned_addr learned my addr 172.21.15.46:0/842179960 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40fa7fc640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40fc103670 0x7f40fc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40fb7fe640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc10c180 0x7f40fc19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 -- 172.21.15.46:0/842179960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc10c180 msgr2=0x7f40fc19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc10c180 0x7f40fc19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 -- 172.21.15.46:0/842179960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40fc103670 msgr2=0x7f40fc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40fc103670 0x7f40fc19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 -- 172.21.15.46:0/842179960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc19f5c0 con 0x7f40fc102d50 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40fb7fe640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc10c180 0x7f40fc19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40faffd640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 0x7f40fc19a610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c970 tx=0x7f40ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ec007bb0 con 0x7f40fc102d50 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40ec007d50 con 0x7f40fc102d50 2024-09-19T09:16:37.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc19f8b0 con 0x7f40fc102d50 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.504+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ec00f450 con 0x7f40fc102d50 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.505+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc1a7190 con 0x7f40fc102d50 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.505+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc103130 con 0x7f40fc102d50 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.507+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f40ec004fe0 con 0x7f40fc102d50 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.507+0000 7f40f3fff640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40e80a3240 0x7f40e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.507+0000 7f40fa7fc640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40e80a3240 0x7f40e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.507+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f40ec0cfae0 con 0x7f40fc102d50 2024-09-19T09:16:37.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.508+0000 7f40fa7fc640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40e80a3240 0x7f40e80a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40fc10ea40 tx=0x7f40e4031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:37.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:37 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4267207807' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:16:37.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:37 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:active 2024-09-19T09:16:37.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:37 smithi099 ceph-mon[35256]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T09:16:37.514 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:37 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:16:37.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.511+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40ec014030 con 0x7f40fc102d50 2024-09-19T09:16:37.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.708+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f40fc102110 con 0x7f40e80a3240 2024-09-19T09:16:37.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.740+0000 7f40f3fff640 1 -- 172.21.15.46:0/842179960 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f40fc102110 con 0x7f40e80a3240 2024-09-19T09:16:37.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40e80a3240 msgr2=0x7f40e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:37.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40e80a3240 0x7f40e80a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40fc10ea40 tx=0x7f40e4031490 comp rx=0 tx=0).stop 2024-09-19T09:16:37.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 msgr2=0x7f40fc19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 0x7f40fc19a610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f40ec00c970 tx=0x7f40ec00ce30 comp rx=0 tx=0).stop 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 shutdown_connections 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40e80a3240 0x7f40e80a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40fc10c180 0x7f40fc19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40fc103670 0x7f40fc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 --2- 172.21.15.46:0/842179960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f40fc102d50 0x7f40fc19a610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 >> 172.21.15.46:0/842179960 conn(0x7f40fc0fc7d0 msgr2=0x7f40fc10d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 shutdown_connections 2024-09-19T09:16:37.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:37.742+0000 7f4101578640 1 -- 172.21.15.46:0/842179960 wait complete. 2024-09-19T09:16:37.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:16:37.713+0000 7f578d761640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:16:37.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:16:37.713+0000 7f578d761640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:16:37.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:16:37.713+0000 7f578d761640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:16:37.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:16:37.713+0000 7f578d761640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:16:37.981 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:16:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:16:37.713+0000 7f578d761640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:16:38.331 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:38 smithi046 ceph-mon[31203]: pgmap v286: 97 pgs: 97 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 5.1 KiB/s wr, 17 op/s 2024-09-19T09:16:38.332 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:38 smithi046 ceph-mon[31203]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:38.361 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:16:38.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:38 smithi115 ceph-mon[35055]: pgmap v286: 97 pgs: 97 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 5.1 KiB/s wr, 17 op/s 2024-09-19T09:16:38.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:38 smithi115 ceph-mon[35055]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:38.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:38 smithi099 ceph-mon[35256]: pgmap v286: 97 pgs: 97 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 5.1 KiB/s wr, 17 op/s 2024-09-19T09:16:38.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:38 smithi099 ceph-mon[35256]: from='client.14685 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:38.616 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:39.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.072+0000 7f8324ddf640 1 -- 172.21.15.46:0/2993315184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320102ef0 msgr2=0x7f832010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:39.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.072+0000 7f8324ddf640 1 --2- 172.21.15.46:0/2993315184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320102ef0 0x7f832010da40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f831800bda0 tx=0x7f831802c510 comp rx=0 tx=0).stop 2024-09-19T09:16:39.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 -- 172.21.15.46:0/2993315184 shutdown_connections 2024-09-19T09:16:39.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 --2- 172.21.15.46:0/2993315184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 --2- 172.21.15.46:0/2993315184 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320102ef0 0x7f832010da40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 --2- 172.21.15.46:0/2993315184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320100e20 0x7f8320101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 -- 172.21.15.46:0/2993315184 >> 172.21.15.46:0/2993315184 conn(0x7f83200fc7d0 msgr2=0x7f83200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 -- 172.21.15.46:0/2993315184 shutdown_connections 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 -- 172.21.15.46:0/2993315184 wait complete. 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.073+0000 7f8324ddf640 1 Processor -- start 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 -- start start 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320100e20 0x7f8320196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320102ef0 0x7f832019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f832010fea0 con 0x7f8320102570 2024-09-19T09:16:39.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f832010fd20 con 0x7f8320102ef0 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8324ddf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8320110020 con 0x7f8320100e20 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57060/0 (socket says 172.21.15.46:57060) 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 -- 172.21.15.46:0/3277907287 learned_addr learned my addr 172.21.15.46:0/3277907287 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f831ed9d640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320102ef0 0x7f832019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f831e59c640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320100e20 0x7f8320196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 -- 172.21.15.46:0/3277907287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320100e20 msgr2=0x7f8320196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320100e20 0x7f8320196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 -- 172.21.15.46:0/3277907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320102ef0 msgr2=0x7f832019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320102ef0 0x7f832019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f8317fff640 1 -- 172.21.15.46:0/3277907287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832019b320 con 0x7f8320102570 2024-09-19T09:16:39.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.074+0000 7f831ed9d640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320102ef0 0x7f832019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.075+0000 7f8317fff640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201968b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f830800b4a0 tx=0x7f830800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.075+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308014070 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.075+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832019b610 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.075+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8308010af0 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.075+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8308017d10 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.075+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83201a2ef0 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.076+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8320101200 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.077+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8308017070 con 0x7f8320102570 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.078+0000 7f83177fe640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f830c0a32d0 0x7f830c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.078+0000 7f831e59c640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f830c0a32d0 0x7f830c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:39.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.078+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f83080cee90 con 0x7f8320102570 2024-09-19T09:16:39.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.078+0000 7f831e59c640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f830c0a32d0 0x7f830c0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f83100045f0 tx=0x7f831000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:39.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.082+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f830809b6c0 con 0x7f8320102570 2024-09-19T09:16:39.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.283+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8320062630 con 0x7f830c0a32d0 2024-09-19T09:16:39.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.309+0000 7f83177fe640 1 -- 172.21.15.46:0/3277907287 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8320062630 con 0x7f830c0a32d0 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f830c0a32d0 msgr2=0x7f830c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f830c0a32d0 0x7f830c0a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f83100045f0 tx=0x7f831000b390 comp rx=0 tx=0).stop 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 msgr2=0x7f83201968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201968b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f830800b4a0 tx=0x7f830800b960 comp rx=0 tx=0).stop 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 shutdown_connections 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f830c0a32d0 0x7f830c0a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8320102570 0x7f83201968b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8320102ef0 0x7f832019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 --2- 172.21.15.46:0/3277907287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8320100e20 0x7f8320196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:39.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 >> 172.21.15.46:0/3277907287 conn(0x7f83200fc7d0 msgr2=0x7f83201048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:39.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 shutdown_connections 2024-09-19T09:16:39.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:39.311+0000 7f8324ddf640 1 -- 172.21.15.46:0/3277907287 wait complete. 2024-09-19T09:16:39.991 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:16:40.012 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:16:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: 2024-09-19T09:16:39.652+0000 7f297cd5d640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T09:16:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:40 smithi046 ceph-mon[31203]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2024-09-19T09:16:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:40 smithi046 ceph-mon[31203]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:16:40.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:40 smithi046 ceph-mon[31203]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:40.252 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:40.285 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:40 smithi099 ceph-mon[35256]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2024-09-19T09:16:40.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:40 smithi099 ceph-mon[35256]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:16:40.286 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:40 smithi099 ceph-mon[35256]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:40.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:40 smithi115 ceph-mon[35055]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 4.7 KiB/s wr, 14 op/s 2024-09-19T09:16:40.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:40 smithi115 ceph-mon[35055]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:16:40.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:40 smithi115 ceph-mon[35055]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:40.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/2033646737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c1008d0 msgr2=0x7ffa9c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:40.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/2033646737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c1008d0 0x7ffa9c100cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009900 tx=0x7ffa9802a410 comp rx=0 tx=0).stop 2024-09-19T09:16:40.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/2033646737 shutdown_connections 2024-09-19T09:16:40.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/2033646737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa9c10e480 0x7ffa9c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/2033646737 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa9c101280 0x7ffa9c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/2033646737 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c1008d0 0x7ffa9c100cb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/2033646737 >> 172.21.15.46:0/2033646737 conn(0x7ffa9c0fc7a0 msgr2=0x7ffa9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/2033646737 shutdown_connections 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.734+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/2033646737 wait complete. 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 Processor -- start 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 -- start start 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa9c1008d0 0x7ffa9c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 0x7ffa9c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa9c10e480 0x7ffa9c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c114200 con 0x7ffa9c101280 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c114080 con 0x7ffa9c1008d0 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa3fa7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c114380 con 0x7ffa9c10e480 2024-09-19T09:16:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa1542640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 0x7ffa9c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa1542640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 0x7ffa9c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57074/0 (socket says 172.21.15.46:57074) 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.735+0000 7ffaa1542640 1 -- 172.21.15.46:0/828305451 learned_addr learned my addr 172.21.15.46:0/828305451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1d43640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa9c1008d0 0x7ffa9c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa2544640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa9c10e480 0x7ffa9c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1542640 1 -- 172.21.15.46:0/828305451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa9c10e480 msgr2=0x7ffa9c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1542640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa9c10e480 0x7ffa9c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1542640 1 -- 172.21.15.46:0/828305451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa9c1008d0 msgr2=0x7ffa9c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1542640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa9c1008d0 0x7ffa9c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1542640 1 -- 172.21.15.46:0/828305451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c19f6f0 con 0x7ffa9c101280 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa1542640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 0x7ffa9c19ac80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00b4a0 tx=0x7ffa8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c014070 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa8c010af0 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c19f9e0 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c017d10 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.736+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c1a72c0 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.737+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c100cb0 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.738+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffa8c017070 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.739+0000 7ffa92ffd640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ffa880a32d0 0x7ffa880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.739+0000 7ffaa1d43640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ffa880a32d0 0x7ffa880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.739+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7ffa8c0cee90 con 0x7ffa9c101280 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.740+0000 7ffaa1d43640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ffa880a32d0 0x7ffa880a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009230 tx=0x7ffa980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.742+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa8c09b6c0 con 0x7ffa9c101280 2024-09-19T09:16:40.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.950+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7ffa9c062630 con 0x7ffa880a32d0 2024-09-19T09:16:40.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.955+0000 7ffa92ffd640 1 -- 172.21.15.46:0/828305451 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ffa9c062630 con 0x7ffa880a32d0 2024-09-19T09:16:40.956 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/qa/sv_0/5ee36973-fea5-4e62-b430-47c199a995d1 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ffa880a32d0 msgr2=0x7ffa880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ffa880a32d0 0x7ffa880a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009230 tx=0x7ffa980058d0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 msgr2=0x7ffa9c19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 0x7ffa9c19ac80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00b4a0 tx=0x7ffa8c00b960 comp rx=0 tx=0).stop 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 shutdown_connections 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ffa880a32d0 0x7ffa880a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa9c101280 0x7ffa9c19ac80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa9c10e480 0x7ffa9c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 --2- 172.21.15.46:0/828305451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa9c1008d0 0x7ffa9c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:40.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 >> 172.21.15.46:0/828305451 conn(0x7ffa9c0fc7a0 msgr2=0x7ffa9c10f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 shutdown_connections 2024-09-19T09:16:40.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:40.957+0000 7ffaa3fa7640 1 -- 172.21.15.46:0/828305451 wait complete. 2024-09-19T09:16:41.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:16:41.963 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:42.357 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:42 smithi046 ceph-mon[31203]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:42.358 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:42 smithi046 ceph-mon[31203]: pgmap v288: 97 pgs: 97 active+clean; 586 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.0 KiB/s wr, 19 op/s 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/2152283541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c106f10 msgr2=0x7fcf9c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/2152283541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c106f10 0x7fcf9c10ea90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009900 tx=0x7fcf9402a410 comp rx=0 tx=0).stop 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/2152283541 shutdown_connections 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/2152283541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c106f10 0x7fcf9c10ea90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/2152283541 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 0x7fcf9c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/2152283541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c101de0 0x7fcf9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/2152283541 >> 172.21.15.46:0/2152283541 conn(0x7fcf9c0fd8c0 msgr2=0x7fcf9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.443+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/2152283541 shutdown_connections 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/2152283541 wait complete. 2024-09-19T09:16:42.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 Processor -- start 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 -- start start 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 0x7fcf9c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 0x7fcf9c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c106f10 0x7fcf9c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c111f70 con 0x7fcf9c101de0 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c111df0 con 0x7fcf9c106f10 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.444+0000 7fcfa1a6d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9c1120f0 con 0x7fcf9c102790 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 0x7fcf9c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 0x7fcf9c198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57088/0 (socket says 172.21.15.46:57088) 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 -- 172.21.15.46:0/4120462935 learned_addr learned my addr 172.21.15.46:0/4120462935 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:42.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9affd640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 0x7fcf9c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 -- 172.21.15.46:0/4120462935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 msgr2=0x7fcf9c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9bfff640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c106f10 0x7fcf9c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 0x7fcf9c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 -- 172.21.15.46:0/4120462935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c106f10 msgr2=0x7fcf9c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c106f10 0x7fcf9c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 -- 172.21.15.46:0/4120462935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9c19d2e0 con 0x7fcf9c101de0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9affd640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 0x7fcf9c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9bfff640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c106f10 0x7fcf9c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf9b7fe640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 0x7fcf9c198330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00cce0 tx=0x7fcf8c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00f650 con 0x7fcf9c101de0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9c19d5d0 con 0x7fcf9c101de0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf8c00fcd0 con 0x7fcf9c101de0 2024-09-19T09:16:42.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c018c70 con 0x7fcf9c101de0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.445+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9c1a4eb0 con 0x7fcf9c101de0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.446+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9c1021c0 con 0x7fcf9c101de0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.447+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcf8c00f7f0 con 0x7fcf9c101de0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.448+0000 7fcf98ff9640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcf880a32d0 0x7fcf880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.448+0000 7fcf9affd640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcf880a32d0 0x7fcf880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.448+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fcf8c0cfe60 con 0x7fcf9c101de0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.449+0000 7fcf9affd640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcf880a32d0 0x7fcf880a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c108880 tx=0x7fcf84005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:42.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.452+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf8c014030 con 0x7fcf9c101de0 2024-09-19T09:16:42.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:42 smithi115 ceph-mon[35055]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:42.461 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:42 smithi115 ceph-mon[35055]: pgmap v288: 97 pgs: 97 active+clean; 586 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.0 KiB/s wr, 19 op/s 2024-09-19T09:16:42.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:42 smithi099 ceph-mon[35256]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:42.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:42 smithi099 ceph-mon[35256]: pgmap v288: 97 pgs: 97 active+clean; 586 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.0 KiB/s wr, 19 op/s 2024-09-19T09:16:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.652+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fcf9c062630 con 0x7fcf880a32d0 2024-09-19T09:16:42.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.677+0000 7fcf98ff9640 1 -- 172.21.15.46:0/4120462935 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcf9c062630 con 0x7fcf880a32d0 2024-09-19T09:16:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcf880a32d0 msgr2=0x7fcf880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcf880a32d0 0x7fcf880a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c108880 tx=0x7fcf84005cb0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 msgr2=0x7fcf9c198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:42.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 0x7fcf9c198330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00cce0 tx=0x7fcf8c00a620 comp rx=0 tx=0).stop 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 shutdown_connections 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcf880a32d0 0x7fcf880a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf9c106f10 0x7fcf9c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcf9c102790 0x7fcf9c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 --2- 172.21.15.46:0/4120462935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf9c101de0 0x7fcf9c198330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 >> 172.21.15.46:0/4120462935 conn(0x7fcf9c0fd8c0 msgr2=0x7fcf9c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 shutdown_connections 2024-09-19T09:16:42.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:42.680+0000 7fcfa1a6d640 1 -- 172.21.15.46:0/4120462935 wait complete. 2024-09-19T09:16:43.429 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:43 smithi046 ceph-mon[31203]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:43.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:43 smithi115 ceph-mon[35055]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:43.461 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:16:43.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:43 smithi099 ceph-mon[35256]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:43.718 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:44.099 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:44 smithi046 ceph-mon[31203]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-09-19T09:16:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 -- 172.21.15.46:0/2223983072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368101de0 msgr2=0x7f83681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 --2- 172.21.15.46:0/2223983072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368101de0 0x7f83681021c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8358009900 tx=0x7f835802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 -- 172.21.15.46:0/2223983072 shutdown_connections 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 --2- 172.21.15.46:0/2223983072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368106f10 0x7f836810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 --2- 172.21.15.46:0/2223983072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 0x7f83681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 --2- 172.21.15.46:0/2223983072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368101de0 0x7f83681021c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 -- 172.21.15.46:0/2223983072 >> 172.21.15.46:0/2223983072 conn(0x7f83680fd8c0 msgr2=0x7f83680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 -- 172.21.15.46:0/2223983072 shutdown_connections 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.185+0000 7f836e04e640 1 -- 172.21.15.46:0/2223983072 wait complete. 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 Processor -- start 2024-09-19T09:16:44.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 -- start start 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368101de0 0x7f8368198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 0x7f8368198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 0x7f836819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8368111f30 con 0x7f8368106f10 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8368111db0 con 0x7f8368102790 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f836e04e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f83681120b0 con 0x7f8368101de0 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 0x7f836819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 0x7f836819cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57110/0 (socket says 172.21.15.46:57110) 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 -- 172.21.15.46:0/3023751074 learned_addr learned my addr 172.21.15.46:0/3023751074 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f83677fe640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368101de0 0x7f8368198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8366ffd640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 0x7f8368198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 -- 172.21.15.46:0/3023751074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368101de0 msgr2=0x7f8368198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368101de0 0x7f8368198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 -- 172.21.15.46:0/3023751074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 msgr2=0x7f8368198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 0x7f8368198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8367fff640 1 -- 172.21.15.46:0/3023751074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836819d2c0 con 0x7f8368106f10 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f8366ffd640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 0x7f8368198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.186+0000 7f83677fe640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368101de0 0x7f8368198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.187+0000 7f8367fff640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 0x7f836819cbe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f836000cce0 tx=0x7f836000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.187+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836000f450 con 0x7f8368106f10 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.187+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836819d5b0 con 0x7f8368106f10 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.187+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f836000fad0 con 0x7f8368106f10 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.187+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360018c10 con 0x7f8368106f10 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.187+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83681a4e90 con 0x7f8368106f10 2024-09-19T09:16:44.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.188+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83681021c0 con 0x7f8368106f10 2024-09-19T09:16:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.189+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f836000f5f0 con 0x7f8368106f10 2024-09-19T09:16:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.190+0000 7f8364ff9640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f83500a32d0 0x7f83500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.190+0000 7f83677fe640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f83500a32d0 0x7f83500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.190+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f83600d0040 con 0x7f8368106f10 2024-09-19T09:16:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.190+0000 7f83677fe640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f83500a32d0 0x7f83500a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8358005ab0 tx=0x7f8358005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:44.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.194+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8360014030 con 0x7f8368106f10 2024-09-19T09:16:44.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.397+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f83680febc0 con 0x7f83500a32d0 2024-09-19T09:16:44.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.401+0000 7f8364ff9640 1 -- 172.21.15.46:0/3023751074 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f83680febc0 con 0x7f83500a32d0 2024-09-19T09:16:44.401 INFO:teuthology.orchestra.run.smithi046.stdout:/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f83500a32d0 msgr2=0x7f83500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f83500a32d0 0x7f83500a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8358005ab0 tx=0x7f8358005a20 comp rx=0 tx=0).stop 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 msgr2=0x7f836819cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 0x7f836819cbe0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f836000cce0 tx=0x7f836000a620 comp rx=0 tx=0).stop 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 shutdown_connections 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f83500a32d0 0x7f83500a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8368106f10 0x7f836819cbe0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8368102790 0x7f8368198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 --2- 172.21.15.46:0/3023751074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8368101de0 0x7f8368198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:44.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.403+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 >> 172.21.15.46:0/3023751074 conn(0x7f83680fd8c0 msgr2=0x7f83680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:44.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.404+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 shutdown_connections 2024-09-19T09:16:44.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:44.404+0000 7f836e04e640 1 -- 172.21.15.46:0/3023751074 wait complete. 2024-09-19T09:16:44.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:44 smithi115 ceph-mon[35055]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-09-19T09:16:44.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:44 smithi099 ceph-mon[35256]: pgmap v289: 97 pgs: 97 active+clean; 606 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 21 op/s 2024-09-19T09:16:45.127 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:16:45.383 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:45.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:45 smithi115 ceph-mon[35055]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:45.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:45 smithi046 ceph-mon[31203]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:45.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:45 smithi099 ceph-mon[35256]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.824+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/2011910497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d38103760 msgr2=0x7f7d38107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.824+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/2011910497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d38103760 0x7f7d38107ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009930 tx=0x7f7d2c02a420 comp rx=0 tx=0).stop 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/2011910497 shutdown_connections 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/2011910497 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d38103760 0x7f7d38107ba0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/2011910497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d381082e0 0x7f7d3810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/2011910497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d38102db0 0x7f7d38103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/2011910497 >> 172.21.15.46:0/2011910497 conn(0x7f7d380fc7d0 msgr2=0x7f7d380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:45.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/2011910497 shutdown_connections 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/2011910497 wait complete. 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 Processor -- start 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.825+0000 7f7d3c8b8640 1 -- start start 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3c8b8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d38102db0 0x7f7d38100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3c8b8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d38103760 0x7f7d38100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3c8b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 0x7f7d38101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3c8b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7d381120f0 con 0x7f7d381082e0 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3c8b8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38111f70 con 0x7f7d38103760 2024-09-19T09:16:45.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3c8b8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38112270 con 0x7f7d38102db0 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 0x7f7d38101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 0x7f7d38101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57128/0 (socket says 172.21.15.46:57128) 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 -- 172.21.15.46:0/170858095 learned_addr learned my addr 172.21.15.46:0/170858095 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d3659c640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d38102db0 0x7f7d38100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d35d9b640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d38103760 0x7f7d38100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 -- 172.21.15.46:0/170858095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d38102db0 msgr2=0x7f7d38100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d38102db0 0x7f7d38100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 -- 172.21.15.46:0/170858095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d38103760 msgr2=0x7f7d38100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d38103760 0x7f7d38100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:45.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 -- 172.21.15.46:0/170858095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d381a6ae0 con 0x7f7d381082e0 2024-09-19T09:16:45.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d36d9d640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 0x7f7d38101490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009fd0 tx=0x7f7d3000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:45.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30011830 con 0x7f7d381082e0 2024-09-19T09:16:45.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.826+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d30016070 con 0x7f7d381082e0 2024-09-19T09:16:45.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.827+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d381a6dd0 con 0x7f7d381082e0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.827+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3000f2e0 con 0x7f7d381082e0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.827+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381a7290 con 0x7f7d381082e0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.827+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d38103190 con 0x7f7d381082e0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.829+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7d300119d0 con 0x7f7d381082e0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.829+0000 7f7d277fe640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d200a3350 0x7f7d200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.830+0000 7f7d3659c640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d200a3350 0x7f7d200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.830+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7d300cf470 con 0x7f7d381082e0 2024-09-19T09:16:45.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.830+0000 7f7d3659c640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d200a3350 0x7f7d200a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d28005fd0 tx=0x7f7d28009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:45.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:45.833+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d3009c2f0 con 0x7f7d381082e0 2024-09-19T09:16:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.044+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d38101f40 con 0x7f7d381082e0 2024-09-19T09:16:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.044+0000 7f7d277fe640 1 -- 172.21.15.46:0/170858095 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f7d38101f40 con 0x7f7d381082e0 2024-09-19T09:16:46.045 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:46.045 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-19T09:16:36:049593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:16:36.049570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:16:46.046 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:16:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d200a3350 msgr2=0x7f7d200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d200a3350 0x7f7d200a5810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d28005fd0 tx=0x7f7d28009680 comp rx=0 tx=0).stop 2024-09-19T09:16:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 msgr2=0x7f7d38101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 0x7f7d38101490 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009fd0 tx=0x7f7d3000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:16:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 shutdown_connections 2024-09-19T09:16:46.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d200a3350 0x7f7d200a5810 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:46.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d381082e0 0x7f7d38101490 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:46.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d38103760 0x7f7d38100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:46.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 --2- 172.21.15.46:0/170858095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d38102db0 0x7f7d38100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:46.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.046+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 >> 172.21.15.46:0/170858095 conn(0x7f7d380fc7d0 msgr2=0x7f7d38105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:46.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.047+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 shutdown_connections 2024-09-19T09:16:46.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:46.047+0000 7f7d3c8b8640 1 -- 172.21.15.46:0/170858095 wait complete. 2024-09-19T09:16:46.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:46 smithi115 ceph-mon[35055]: pgmap v290: 97 pgs: 97 active+clean; 606 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-19T09:16:46.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:46 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/170858095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:46.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:46 smithi046 ceph-mon[31203]: pgmap v290: 97 pgs: 97 active+clean; 606 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-19T09:16:46.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:46 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/170858095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:46.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:46 smithi099 ceph-mon[35256]: pgmap v290: 97 pgs: 97 active+clean; 606 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 22 op/s 2024-09-19T09:16:46.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:46 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/170858095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:16:46.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:16:46.960 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 -- 172.21.15.46:0/3610880776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 msgr2=0x7f1ce410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 --2- 172.21.15.46:0/3610880776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce410ea90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009ca0 tx=0x7f1cdc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 -- 172.21.15.46:0/3610880776 shutdown_connections 2024-09-19T09:16:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 --2- 172.21.15.46:0/3610880776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce410ea90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 --2- 172.21.15.46:0/3610880776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ce4102790 0x7f1ce41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 --2- 172.21.15.46:0/3610880776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4101de0 0x7f1ce41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 -- 172.21.15.46:0/3610880776 >> 172.21.15.46:0/3610880776 conn(0x7f1ce40fd8c0 msgr2=0x7f1ce40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 -- 172.21.15.46:0/3610880776 shutdown_connections 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.411+0000 7f1cead6a640 1 -- 172.21.15.46:0/3610880776 wait complete. 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 Processor -- start 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 -- start start 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ce4101de0 0x7f1ce41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4102790 0x7f1ce41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4111fc0 con 0x7f1ce4106f10 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4111e40 con 0x7f1ce4101de0 2024-09-19T09:16:47.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1cead6a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4112140 con 0x7f1ce4102790 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1ce9307640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1ce9307640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57142/0 (socket says 172.21.15.46:57142) 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1ce9307640 1 -- 172.21.15.46:0/1816069066 learned_addr learned my addr 172.21.15.46:0/1816069066 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.412+0000 7f1ce8b06640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ce4101de0 0x7f1ce41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce9307640 1 -- 172.21.15.46:0/1816069066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4102790 msgr2=0x7f1ce41988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce9307640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4102790 0x7f1ce41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce9307640 1 -- 172.21.15.46:0/1816069066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ce4101de0 msgr2=0x7f1ce41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce9307640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ce4101de0 0x7f1ce41983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce9307640 1 -- 172.21.15.46:0/1816069066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce419d360 con 0x7f1ce4106f10 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce9307640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce419cc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc003f10 tx=0x7f1cdc003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc031710 con 0x7f1ce4106f10 2024-09-19T09:16:47.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cdc0318b0 con 0x7f1ce4106f10 2024-09-19T09:16:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce419d5f0 con 0x7f1ce4106f10 2024-09-19T09:16:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc02fb50 con 0x7f1ce4106f10 2024-09-19T09:16:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.413+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce41a4f30 con 0x7f1ce4106f10 2024-09-19T09:16:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.414+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce41021c0 con 0x7f1ce4106f10 2024-09-19T09:16:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.415+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1cdc02fd30 con 0x7f1ce4106f10 2024-09-19T09:16:47.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.416+0000 7f1ce1ffb640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1cd40a32d0 0x7f1cd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:47.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.416+0000 7f1ce8b06640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1cd40a32d0 0x7f1cd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:47.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.416+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f1cdc0f0ef0 con 0x7f1ce4106f10 2024-09-19T09:16:47.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.417+0000 7f1ce8b06640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1cd40a32d0 0x7f1cd40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8005fd0 tx=0x7f1cd8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:47.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.420+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cdc004040 con 0x7f1ce4106f10 2024-09-19T09:16:47.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.599+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ce41a5100 con 0x7f1ce4106f10 2024-09-19T09:16:47.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.600+0000 7f1ce1ffb640 1 -- 172.21.15.46:0/1816069066 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22245 (secure 0 0 0) 0x7f1cdc0dd070 con 0x7f1ce4106f10 2024-09-19T09:16:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:47.601 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":82,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:16:24.645850+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:16:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1cd40a32d0 msgr2=0x7f1cd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1cd40a32d0 0x7f1cd40a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8005fd0 tx=0x7f1cd8005850 comp rx=0 tx=0).stop 2024-09-19T09:16:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 msgr2=0x7f1ce419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce419cc80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc003f10 tx=0x7f1cdc003f40 comp rx=0 tx=0).stop 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 shutdown_connections 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1cd40a32d0 0x7f1cd40a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ce4106f10 0x7f1ce419cc80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4102790 0x7f1ce41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 --2- 172.21.15.46:0/1816069066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ce4101de0 0x7f1ce41983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 >> 172.21.15.46:0/1816069066 conn(0x7f1ce40fd8c0 msgr2=0x7f1ce40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 shutdown_connections 2024-09-19T09:16:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:47.603+0000 7f1cead6a640 1 -- 172.21.15.46:0/1816069066 wait complete. 2024-09-19T09:16:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:48 smithi046 ceph-mon[31203]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 24 op/s 2024-09-19T09:16:48.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:48 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1816069066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:48.298 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:16:48.299 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:16:48.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:48 smithi115 ceph-mon[35055]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 24 op/s 2024-09-19T09:16:48.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:48 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1816069066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:48.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:48 smithi099 ceph-mon[35256]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.1 KiB/s wr, 24 op/s 2024-09-19T09:16:48.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:48 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1816069066' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:48.552 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/143173117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 msgr2=0x7f3b74110c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/143173117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b74110c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c009ca0 tx=0x7f3b6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/143173117 shutdown_connections 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/143173117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b74110c90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/143173117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b74104990 0x7f3b741089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/143173117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 0x7f3b741043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/143173117 >> 172.21.15.46:0/143173117 conn(0x7f3b740ffa20 msgr2=0x7f3b74101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:49.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/143173117 shutdown_connections 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.027+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/143173117 wait complete. 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 Processor -- start 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 -- start start 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 0x7f3b7419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b74104990 0x7f3b7419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b7419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74114140 con 0x7f3b74109110 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3b74113fc0 con 0x7f3b74104990 2024-09-19T09:16:49.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7bc5d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3b741142c0 con 0x7f3b74103fe0 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7a1fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b7419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7a1fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b7419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48760/0 (socket says 172.21.15.46:48760) 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b7a1fa640 1 -- 172.21.15.46:0/859002680 learned_addr learned my addr 172.21.15.46:0/859002680 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.028+0000 7f3b799f9640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 0x7f3b7419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7a1fa640 1 -- 172.21.15.46:0/859002680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 msgr2=0x7f3b7419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7a1fa640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 0x7f3b7419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7a1fa640 1 -- 172.21.15.46:0/859002680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b74104990 msgr2=0x7f3b7419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7a1fa640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b74104990 0x7f3b7419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7a1fa640 1 -- 172.21.15.46:0/859002680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7419f590 con 0x7f3b74109110 2024-09-19T09:16:49.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b799f9640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 0x7f3b7419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7a1fa640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b7419eeb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c031a20 tx=0x7f3b6c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c003c30 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b6c003dd0 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7419f820 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c02fcf0 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.029+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b741a7160 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.030+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b741043c0 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.031+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3b6c004050 con 0x7f3b74109110 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.032+0000 7f3b6affd640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b600a32d0 0x7f3b600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.032+0000 7f3b799f9640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b600a32d0 0x7f3b600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:49.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.032+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f3b6c0f0c30 con 0x7f3b74109110 2024-09-19T09:16:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.033+0000 7f3b799f9640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b600a32d0 0x7f3b600a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009b40 tx=0x7f3b70005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:49.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.036+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b6c0bdb40 con 0x7f3b74109110 2024-09-19T09:16:49.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.210+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b7410c3c0 con 0x7f3b600a32d0 2024-09-19T09:16:49.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.219+0000 7f3b6affd640 1 -- 172.21.15.46:0/859002680 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258848 (secure 0 0 0) 0x7f3b7000ea90 con 0x7f3b600a32d0 2024-09-19T09:16:49.223 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:49.224 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:16:49.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b600a32d0 msgr2=0x7f3b600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:49.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b600a32d0 0x7f3b600a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009b40 tx=0x7f3b70005e50 comp rx=0 tx=0).stop 2024-09-19T09:16:49.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 msgr2=0x7f3b7419eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b7419eeb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c031a20 tx=0x7f3b6c031a50 comp rx=0 tx=0).stop 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 shutdown_connections 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b600a32d0 0x7f3b600a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b74109110 0x7f3b7419eeb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b74104990 0x7f3b7419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 --2- 172.21.15.46:0/859002680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b74103fe0 0x7f3b7419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.223+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 >> 172.21.15.46:0/859002680 conn(0x7f3b740ffa20 msgr2=0x7f3b74100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.224+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 shutdown_connections 2024-09-19T09:16:49.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:49.224+0000 7f3b7bc5d640 1 -- 172.21.15.46:0/859002680 wait complete. 2024-09-19T09:16:49.881 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T09:16:48.957081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645005,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":267,"num_read_kb":244,"num_write":414,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":339,"ondisk_log_size":339,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":347868,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593956,"statfs":{"total":1151940427776,"available":1151584210944,"internally_reserved":0,"allocated":11366400,"data_stored":7088895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46637,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":44,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003046"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983469+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:16:24.983469+0000","last_peered":"2024-09-19T09:16:24.983469+0000","last_clean":"2024-09-19T09:16:24.983469+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:16:24.983469+0000","last_undegraded":"2024-09-19T09:16:24.983469+0000","last_fullsized":"2024-09-19T09:16:24.983469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997247+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:16:24.997247+0000","last_peered":"2024-09-19T09:16:24.997247+0000","last_clean":"2024-09-19T09:16:24.997247+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:16:24.997247+0000","last_undegraded":"2024-09-19T09:16:24.997247+0000","last_fullsized":"2024-09-19T09:16:24.997247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997082+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:16:24.997082+0000","last_peered":"2024-09-19T09:16:24.997082+0000","last_clean":"2024-09-19T09:16:24.997082+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.997082+0000","last_undegraded":"2024-09-19T09:16:24.997082+0000","last_fullsized":"2024-09-19T09:16:24.997082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994665+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:16:24.994665+0000","last_peered":"2024-09-19T09:16:24.994665+0000","last_clean":"2024-09-19T09:16:24.994665+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:16:24.994665+0000","last_undegraded":"2024-09-19T09:16:24.994665+0000","last_fullsized":"2024-09-19T09:16:24.994665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999452+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:16:24.999452+0000","last_peered":"2024-09-19T09:16:24.999452+0000","last_clean":"2024-09-19T09:16:24.999452+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:16:24.999452+0000","last_undegraded":"2024-09-19T09:16:24.999452+0000","last_fullsized":"2024-09-19T09:16:24.999452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983035+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:16:24.983035+0000","last_peered":"2024-09-19T09:16:24.983035+0000","last_clean":"2024-09-19T09:16:24.983035+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:16:24.983035+0000","last_undegraded":"2024-09-19T09:16:24.983035+0000","last_fullsized":"2024-09-19T09:16:24.983035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997278+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:16:24.997278+0000","last_peered":"2024-09-19T09:16:24.997278+0000","last_clean":"2024-09-19T09:16:24.997278+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:16:24.997278+0000","last_undegraded":"2024-09-19T09:16:24.997278+0000","last_fullsized":"2024-09-19T09:16:24.997278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993833+0000","last_change":"2024-09-19T09:16:23.990830+0000","last_active":"2024-09-19T09:16:24.993833+0000","last_peered":"2024-09-19T09:16:24.993833+0000","last_clean":"2024-09-19T09:16:24.993833+0000","last_became_active":"2024-09-19T09:16:23.990551+0000","last_became_peered":"2024-09-19T09:16:23.990551+0000","last_unstale":"2024-09-19T09:16:24.993833+0000","last_undegraded":"2024-09-19T09:16:24.993833+0000","last_fullsized":"2024-09-19T09:16:24.993833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:06.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995195+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:16:24.995195+0000","last_peered":"2024-09-19T09:16:24.995195+0000","last_clean":"2024-09-19T09:16:24.995195+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:16:24.995195+0000","last_undegraded":"2024-09-19T09:16:24.995195+0000","last_fullsized":"2024-09-19T09:16:24.995195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983440+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:16:24.983440+0000","last_peered":"2024-09-19T09:16:24.983440+0000","last_clean":"2024-09-19T09:16:24.983440+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:16:24.983440+0000","last_undegraded":"2024-09-19T09:16:24.983440+0000","last_fullsized":"2024-09-19T09:16:24.983440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998697+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:16:24.998697+0000","last_peered":"2024-09-19T09:16:24.998697+0000","last_clean":"2024-09-19T09:16:24.998697+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:16:24.998697+0000","last_undegraded":"2024-09-19T09:16:24.998697+0000","last_fullsized":"2024-09-19T09:16:24.998697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994817+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:16:24.994817+0000","last_peered":"2024-09-19T09:16:24.994817+0000","last_clean":"2024-09-19T09:16:24.994817+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:16:24.994817+0000","last_undegraded":"2024-09-19T09:16:24.994817+0000","last_fullsized":"2024-09-19T09:16:24.994817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982364+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:16:24.982364+0000","last_peered":"2024-09-19T09:16:24.982364+0000","last_clean":"2024-09-19T09:16:24.982364+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:16:24.982364+0000","last_undegraded":"2024-09-19T09:16:24.982364+0000","last_fullsized":"2024-09-19T09:16:24.982364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997004+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:16:24.997004+0000","last_peered":"2024-09-19T09:16:24.997004+0000","last_clean":"2024-09-19T09:16:24.997004+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:16:24.997004+0000","last_undegraded":"2024-09-19T09:16:24.997004+0000","last_fullsized":"2024-09-19T09:16:24.997004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996593+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:16:24.996593+0000","last_peered":"2024-09-19T09:16:24.996593+0000","last_clean":"2024-09-19T09:16:24.996593+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:16:24.996593+0000","last_undegraded":"2024-09-19T09:16:24.996593+0000","last_fullsized":"2024-09-19T09:16:24.996593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994114+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:16:24.994114+0000","last_peered":"2024-09-19T09:16:24.994114+0000","last_clean":"2024-09-19T09:16:24.994114+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:16:24.994114+0000","last_undegraded":"2024-09-19T09:16:24.994114+0000","last_fullsized":"2024-09-19T09:16:24.994114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983416+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:16:24.983416+0000","last_peered":"2024-09-19T09:16:24.983416+0000","last_clean":"2024-09-19T09:16:24.983416+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:16:24.983416+0000","last_undegraded":"2024-09-19T09:16:24.983416+0000","last_fullsized":"2024-09-19T09:16:24.983416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994115+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:16:24.994115+0000","last_peered":"2024-09-19T09:16:24.994115+0000","last_clean":"2024-09-19T09:16:24.994115+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:16:24.994115+0000","last_undegraded":"2024-09-19T09:16:24.994115+0000","last_fullsized":"2024-09-19T09:16:24.994115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998941+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:16:24.998941+0000","last_peered":"2024-09-19T09:16:24.998941+0000","last_clean":"2024-09-19T09:16:24.998941+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:16:24.998941+0000","last_undegraded":"2024-09-19T09:16:24.998941+0000","last_fullsized":"2024-09-19T09:16:24.998941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983110+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:16:24.983110+0000","last_peered":"2024-09-19T09:16:24.983110+0000","last_clean":"2024-09-19T09:16:24.983110+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:16:24.983110+0000","last_undegraded":"2024-09-19T09:16:24.983110+0000","last_fullsized":"2024-09-19T09:16:24.983110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982389+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:16:24.982389+0000","last_peered":"2024-09-19T09:16:24.982389+0000","last_clean":"2024-09-19T09:16:24.982389+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:16:24.982389+0000","last_undegraded":"2024-09-19T09:16:24.982389+0000","last_fullsized":"2024-09-19T09:16:24.982389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994839+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:16:24.994839+0000","last_peered":"2024-09-19T09:16:24.994839+0000","last_clean":"2024-09-19T09:16:24.994839+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:16:24.994839+0000","last_undegraded":"2024-09-19T09:16:24.994839+0000","last_fullsized":"2024-09-19T09:16:24.994839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994841+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:16:24.994841+0000","last_peered":"2024-09-19T09:16:24.994841+0000","last_clean":"2024-09-19T09:16:24.994841+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:16:24.994841+0000","last_undegraded":"2024-09-19T09:16:24.994841+0000","last_fullsized":"2024-09-19T09:16:24.994841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994171+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:16:24.994171+0000","last_peered":"2024-09-19T09:16:24.994171+0000","last_clean":"2024-09-19T09:16:24.994171+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:16:24.994171+0000","last_undegraded":"2024-09-19T09:16:24.994171+0000","last_fullsized":"2024-09-19T09:16:24.994171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994413+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:16:24.994413+0000","last_peered":"2024-09-19T09:16:24.994413+0000","last_clean":"2024-09-19T09:16:24.994413+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:16:24.994413+0000","last_undegraded":"2024-09-19T09:16:24.994413+0000","last_fullsized":"2024-09-19T09:16:24.994413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997932+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:16:24.997932+0000","last_peered":"2024-09-19T09:16:24.997932+0000","last_clean":"2024-09-19T09:16:24.997932+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:16:24.997932+0000","last_undegraded":"2024-09-19T09:16:24.997932+0000","last_fullsized":"2024-09-19T09:16:24.997932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983394+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:16:24.983394+0000","last_peered":"2024-09-19T09:16:24.983394+0000","last_clean":"2024-09-19T09:16:24.983394+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:16:24.983394+0000","last_undegraded":"2024-09-19T09:16:24.983394+0000","last_fullsized":"2024-09-19T09:16:24.983394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982293+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:16:24.982293+0000","last_peered":"2024-09-19T09:16:24.982293+0000","last_clean":"2024-09-19T09:16:24.982293+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:16:24.982293+0000","last_undegraded":"2024-09-19T09:16:24.982293+0000","last_fullsized":"2024-09-19T09:16:24.982293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996897+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:16:24.996897+0000","last_peered":"2024-09-19T09:16:24.996897+0000","last_clean":"2024-09-19T09:16:24.996897+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:16:24.996897+0000","last_undegraded":"2024-09-19T09:16:24.996897+0000","last_fullsized":"2024-09-19T09:16:24.996897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998367+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:16:24.998367+0000","last_peered":"2024-09-19T09:16:24.998367+0000","last_clean":"2024-09-19T09:16:24.998367+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:16:24.998367+0000","last_undegraded":"2024-09-19T09:16:24.998367+0000","last_fullsized":"2024-09-19T09:16:24.998367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999424+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:16:24.999424+0000","last_peered":"2024-09-19T09:16:24.999424+0000","last_clean":"2024-09-19T09:16:24.999424+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:16:24.999424+0000","last_undegraded":"2024-09-19T09:16:24.999424+0000","last_fullsized":"2024-09-19T09:16:24.999424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983090+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:16:24.983090+0000","last_peered":"2024-09-19T09:16:24.983090+0000","last_clean":"2024-09-19T09:16:24.983090+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:16:24.983090+0000","last_undegraded":"2024-09-19T09:16:24.983090+0000","last_fullsized":"2024-09-19T09:16:24.983090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994599+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:16:24.994599+0000","last_peered":"2024-09-19T09:16:24.994599+0000","last_clean":"2024-09-19T09:16:24.994599+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:16:24.994599+0000","last_undegraded":"2024-09-19T09:16:24.994599+0000","last_fullsized":"2024-09-19T09:16:24.994599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:43.068140+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:16:43.068140+0000","last_peered":"2024-09-19T09:16:43.068140+0000","last_clean":"2024-09-19T09:16:43.068140+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:16:43.068140+0000","last_undegraded":"2024-09-19T09:16:43.068140+0000","last_fullsized":"2024-09-19T09:16:43.068140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994055+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:16:24.994055+0000","last_peered":"2024-09-19T09:16:24.994055+0000","last_clean":"2024-09-19T09:16:24.994055+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:16:24.994055+0000","last_undegraded":"2024-09-19T09:16:24.994055+0000","last_fullsized":"2024-09-19T09:16:24.994055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046259+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:16:34.046259+0000","last_peered":"2024-09-19T09:16:34.046259+0000","last_clean":"2024-09-19T09:16:34.046259+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:16:34.046259+0000","last_undegraded":"2024-09-19T09:16:34.046259+0000","last_fullsized":"2024-09-19T09:16:34.046259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.038532+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:16:33.038532+0000","last_peered":"2024-09-19T09:16:33.038532+0000","last_clean":"2024-09-19T09:16:33.038532+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:16:33.038532+0000","last_undegraded":"2024-09-19T09:16:33.038532+0000","last_fullsized":"2024-09-19T09:16:33.038532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993874+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:16:24.993874+0000","last_peered":"2024-09-19T09:16:24.993874+0000","last_clean":"2024-09-19T09:16:24.993874+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:16:24.993874+0000","last_undegraded":"2024-09-19T09:16:24.993874+0000","last_fullsized":"2024-09-19T09:16:24.993874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054421+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:16:35.054421+0000","last_peered":"2024-09-19T09:16:35.054421+0000","last_clean":"2024-09-19T09:16:35.054421+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:16:35.054421+0000","last_undegraded":"2024-09-19T09:16:35.054421+0000","last_fullsized":"2024-09-19T09:16:35.054421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993648+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:16:24.993648+0000","last_peered":"2024-09-19T09:16:24.993648+0000","last_clean":"2024-09-19T09:16:24.993648+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:16:24.993648+0000","last_undegraded":"2024-09-19T09:16:24.993648+0000","last_fullsized":"2024-09-19T09:16:24.993648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:46.071834+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:16:46.071834+0000","last_peered":"2024-09-19T09:16:46.071834+0000","last_clean":"2024-09-19T09:16:46.071834+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:16:46.071834+0000","last_undegraded":"2024-09-19T09:16:46.071834+0000","last_fullsized":"2024-09-19T09:16:46.071834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994939+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:16:24.994939+0000","last_peered":"2024-09-19T09:16:24.994939+0000","last_clean":"2024-09-19T09:16:24.994939+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:16:24.994939+0000","last_undegraded":"2024-09-19T09:16:24.994939+0000","last_fullsized":"2024-09-19T09:16:24.994939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052926+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:16:35.052926+0000","last_peered":"2024-09-19T09:16:35.052926+0000","last_clean":"2024-09-19T09:16:35.052926+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:16:35.052926+0000","last_undegraded":"2024-09-19T09:16:35.052926+0000","last_fullsized":"2024-09-19T09:16:35.052926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997081+0000","last_change":"2024-09-19T09:16:23.987959+0000","last_active":"2024-09-19T09:16:24.997081+0000","last_peered":"2024-09-19T09:16:24.997081+0000","last_clean":"2024-09-19T09:16:24.997081+0000","last_became_active":"2024-09-19T09:16:23.987676+0000","last_became_peered":"2024-09-19T09:16:23.987676+0000","last_unstale":"2024-09-19T09:16:24.997081+0000","last_undegraded":"2024-09-19T09:16:24.997081+0000","last_fullsized":"2024-09-19T09:16:24.997081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:15.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046182+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:16:34.046182+0000","last_peered":"2024-09-19T09:16:34.046182+0000","last_clean":"2024-09-19T09:16:34.046182+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:16:34.046182+0000","last_undegraded":"2024-09-19T09:16:34.046182+0000","last_fullsized":"2024-09-19T09:16:34.046182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994911+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:16:24.994911+0000","last_peered":"2024-09-19T09:16:24.994911+0000","last_clean":"2024-09-19T09:16:24.994911+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:16:24.994911+0000","last_undegraded":"2024-09-19T09:16:24.994911+0000","last_fullsized":"2024-09-19T09:16:24.994911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'24","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:46.074624+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:16:46.074624+0000","last_peered":"2024-09-19T09:16:46.074624+0000","last_clean":"2024-09-19T09:16:46.074624+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:16:46.074624+0000","last_undegraded":"2024-09-19T09:16:46.074624+0000","last_fullsized":"2024-09-19T09:16:46.074624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":59,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994231+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:16:24.994231+0000","last_peered":"2024-09-19T09:16:24.994231+0000","last_clean":"2024-09-19T09:16:24.994231+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:16:24.994231+0000","last_undegraded":"2024-09-19T09:16:24.994231+0000","last_fullsized":"2024-09-19T09:16:24.994231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056195+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:16:36.056195+0000","last_peered":"2024-09-19T09:16:36.056195+0000","last_clean":"2024-09-19T09:16:36.056195+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:16:36.056195+0000","last_undegraded":"2024-09-19T09:16:36.056195+0000","last_fullsized":"2024-09-19T09:16:36.056195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982097+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:16:24.982097+0000","last_peered":"2024-09-19T09:16:24.982097+0000","last_clean":"2024-09-19T09:16:24.982097+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:16:24.982097+0000","last_undegraded":"2024-09-19T09:16:24.982097+0000","last_fullsized":"2024-09-19T09:16:24.982097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054355+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:16:35.054355+0000","last_peered":"2024-09-19T09:16:35.054355+0000","last_clean":"2024-09-19T09:16:35.054355+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:16:35.054355+0000","last_undegraded":"2024-09-19T09:16:35.054355+0000","last_fullsized":"2024-09-19T09:16:35.054355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997417+0000","last_change":"2024-09-19T09:16:23.991471+0000","last_active":"2024-09-19T09:16:24.997417+0000","last_peered":"2024-09-19T09:16:24.997417+0000","last_clean":"2024-09-19T09:16:24.997417+0000","last_became_active":"2024-09-19T09:16:23.991110+0000","last_became_peered":"2024-09-19T09:16:23.991110+0000","last_unstale":"2024-09-19T09:16:24.997417+0000","last_undegraded":"2024-09-19T09:16:24.997417+0000","last_fullsized":"2024-09-19T09:16:24.997417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:59.954737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:43.068728+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:16:43.068728+0000","last_peered":"2024-09-19T09:16:43.068728+0000","last_clean":"2024-09-19T09:16:43.068728+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:16:43.068728+0000","last_undegraded":"2024-09-19T09:16:43.068728+0000","last_fullsized":"2024-09-19T09:16:43.068728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997018+0000","last_change":"2024-09-19T09:16:23.991777+0000","last_active":"2024-09-19T09:16:24.997018+0000","last_peered":"2024-09-19T09:16:24.997018+0000","last_clean":"2024-09-19T09:16:24.997018+0000","last_became_active":"2024-09-19T09:16:23.991294+0000","last_became_peered":"2024-09-19T09:16:23.991294+0000","last_unstale":"2024-09-19T09:16:24.997018+0000","last_undegraded":"2024-09-19T09:16:24.997018+0000","last_fullsized":"2024-09-19T09:16:24.997018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:39.740855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052584+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:16:35.052584+0000","last_peered":"2024-09-19T09:16:35.052584+0000","last_clean":"2024-09-19T09:16:35.052584+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:16:35.052584+0000","last_undegraded":"2024-09-19T09:16:35.052584+0000","last_fullsized":"2024-09-19T09:16:35.052584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996749+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:16:24.996749+0000","last_peered":"2024-09-19T09:16:24.996749+0000","last_clean":"2024-09-19T09:16:24.996749+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:16:24.996749+0000","last_undegraded":"2024-09-19T09:16:24.996749+0000","last_fullsized":"2024-09-19T09:16:24.996749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.034597+0000","last_change":"2024-09-19T09:16:21.958901+0000","last_active":"2024-09-19T09:16:34.034597+0000","last_peered":"2024-09-19T09:16:34.034597+0000","last_clean":"2024-09-19T09:16:34.034597+0000","last_became_active":"2024-09-19T09:16:21.958453+0000","last_became_peered":"2024-09-19T09:16:21.958453+0000","last_unstale":"2024-09-19T09:16:34.034597+0000","last_undegraded":"2024-09-19T09:16:34.034597+0000","last_fullsized":"2024-09-19T09:16:34.034597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:34.681594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983304+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:16:24.983304+0000","last_peered":"2024-09-19T09:16:24.983304+0000","last_clean":"2024-09-19T09:16:24.983304+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:16:24.983304+0000","last_undegraded":"2024-09-19T09:16:24.983304+0000","last_fullsized":"2024-09-19T09:16:24.983304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.050741+0000","last_change":"2024-09-19T09:16:21.961069+0000","last_active":"2024-09-19T09:16:35.050741+0000","last_peered":"2024-09-19T09:16:35.050741+0000","last_clean":"2024-09-19T09:16:35.050741+0000","last_became_active":"2024-09-19T09:16:21.960766+0000","last_became_peered":"2024-09-19T09:16:21.960766+0000","last_unstale":"2024-09-19T09:16:35.050741+0000","last_undegraded":"2024-09-19T09:16:35.050741+0000","last_fullsized":"2024-09-19T09:16:35.050741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:43.410794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998719+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:16:24.998719+0000","last_peered":"2024-09-19T09:16:24.998719+0000","last_clean":"2024-09-19T09:16:24.998719+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:16:24.998719+0000","last_undegraded":"2024-09-19T09:16:24.998719+0000","last_fullsized":"2024-09-19T09:16:24.998719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053894+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:16:35.053894+0000","last_peered":"2024-09-19T09:16:35.053894+0000","last_clean":"2024-09-19T09:16:35.053894+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:16:35.053894+0000","last_undegraded":"2024-09-19T09:16:35.053894+0000","last_fullsized":"2024-09-19T09:16:35.053894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.702748+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:16:25.702748+0000","last_peered":"2024-09-19T09:16:25.702748+0000","last_clean":"2024-09-19T09:16:25.702748+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:16:25.702748+0000","last_undegraded":"2024-09-19T09:16:25.702748+0000","last_fullsized":"2024-09-19T09:16:25.702748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:43.068906+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:16:43.068906+0000","last_peered":"2024-09-19T09:16:43.068906+0000","last_clean":"2024-09-19T09:16:43.068906+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:16:43.068906+0000","last_undegraded":"2024-09-19T09:16:43.068906+0000","last_fullsized":"2024-09-19T09:16:43.068906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998903+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:16:24.998903+0000","last_peered":"2024-09-19T09:16:24.998903+0000","last_clean":"2024-09-19T09:16:24.998903+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:16:24.998903+0000","last_undegraded":"2024-09-19T09:16:24.998903+0000","last_fullsized":"2024-09-19T09:16:24.998903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997504+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:16:24.997504+0000","last_peered":"2024-09-19T09:16:24.997504+0000","last_clean":"2024-09-19T09:16:24.997504+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:16:24.997504+0000","last_undegraded":"2024-09-19T09:16:24.997504+0000","last_fullsized":"2024-09-19T09:16:24.997504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056230+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:16:36.056230+0000","last_peered":"2024-09-19T09:16:36.056230+0000","last_clean":"2024-09-19T09:16:36.056230+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:16:36.056230+0000","last_undegraded":"2024-09-19T09:16:36.056230+0000","last_fullsized":"2024-09-19T09:16:36.056230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994708+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:16:24.994708+0000","last_peered":"2024-09-19T09:16:24.994708+0000","last_clean":"2024-09-19T09:16:24.994708+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:16:24.994708+0000","last_undegraded":"2024-09-19T09:16:24.994708+0000","last_fullsized":"2024-09-19T09:16:24.994708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.037803+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:16:33.037803+0000","last_peered":"2024-09-19T09:16:33.037803+0000","last_clean":"2024-09-19T09:16:33.037803+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:16:33.037803+0000","last_undegraded":"2024-09-19T09:16:33.037803+0000","last_fullsized":"2024-09-19T09:16:33.037803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.981964+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:16:24.981964+0000","last_peered":"2024-09-19T09:16:24.981964+0000","last_clean":"2024-09-19T09:16:24.981964+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.981964+0000","last_undegraded":"2024-09-19T09:16:24.981964+0000","last_fullsized":"2024-09-19T09:16:24.981964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:44.069271+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:16:44.069271+0000","last_peered":"2024-09-19T09:16:44.069271+0000","last_clean":"2024-09-19T09:16:44.069271+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:16:44.069271+0000","last_undegraded":"2024-09-19T09:16:44.069271+0000","last_fullsized":"2024-09-19T09:16:44.069271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994334+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:16:24.994334+0000","last_peered":"2024-09-19T09:16:24.994334+0000","last_clean":"2024-09-19T09:16:24.994334+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:16:24.994334+0000","last_undegraded":"2024-09-19T09:16:24.994334+0000","last_fullsized":"2024-09-19T09:16:24.994334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:44.069715+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:16:44.069715+0000","last_peered":"2024-09-19T09:16:44.069715+0000","last_clean":"2024-09-19T09:16:44.069715+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:16:44.069715+0000","last_undegraded":"2024-09-19T09:16:44.069715+0000","last_fullsized":"2024-09-19T09:16:44.069715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983250+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:16:24.983250+0000","last_peered":"2024-09-19T09:16:24.983250+0000","last_clean":"2024-09-19T09:16:24.983250+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:16:24.983250+0000","last_undegraded":"2024-09-19T09:16:24.983250+0000","last_fullsized":"2024-09-19T09:16:24.983250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993764+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:16:24.993764+0000","last_peered":"2024-09-19T09:16:24.993764+0000","last_clean":"2024-09-19T09:16:24.993764+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:16:24.993764+0000","last_undegraded":"2024-09-19T09:16:24.993764+0000","last_fullsized":"2024-09-19T09:16:24.993764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:26.765577+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:16:26.765577+0000","last_peered":"2024-09-19T09:16:26.765577+0000","last_clean":"2024-09-19T09:16:26.765577+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:16:26.765577+0000","last_undegraded":"2024-09-19T09:16:26.765577+0000","last_fullsized":"2024-09-19T09:16:26.765577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052268+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:16:35.052268+0000","last_peered":"2024-09-19T09:16:35.052268+0000","last_clean":"2024-09-19T09:16:35.052268+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:16:35.052268+0000","last_undegraded":"2024-09-19T09:16:35.052268+0000","last_fullsized":"2024-09-19T09:16:35.052268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982441+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:16:24.982441+0000","last_peered":"2024-09-19T09:16:24.982441+0000","last_clean":"2024-09-19T09:16:24.982441+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:16:24.982441+0000","last_undegraded":"2024-09-19T09:16:24.982441+0000","last_fullsized":"2024-09-19T09:16:24.982441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:42.994436+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:16:42.994436+0000","last_peered":"2024-09-19T09:16:42.994436+0000","last_clean":"2024-09-19T09:16:42.994436+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:16:42.994436+0000","last_undegraded":"2024-09-19T09:16:42.994436+0000","last_fullsized":"2024-09-19T09:16:42.994436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994595+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:16:24.994595+0000","last_peered":"2024-09-19T09:16:24.994595+0000","last_clean":"2024-09-19T09:16:24.994595+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:16:24.994595+0000","last_undegraded":"2024-09-19T09:16:24.994595+0000","last_fullsized":"2024-09-19T09:16:24.994595+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052464+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:16:35.052464+0000","last_peered":"2024-09-19T09:16:35.052464+0000","last_clean":"2024-09-19T09:16:35.052464+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:16:35.052464+0000","last_undegraded":"2024-09-19T09:16:35.052464+0000","last_fullsized":"2024-09-19T09:16:35.052464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997305+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:16:24.997305+0000","last_peered":"2024-09-19T09:16:24.997305+0000","last_clean":"2024-09-19T09:16:24.997305+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:16:24.997305+0000","last_undegraded":"2024-09-19T09:16:24.997305+0000","last_fullsized":"2024-09-19T09:16:24.997305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032076+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:16:32.032076+0000","last_peered":"2024-09-19T09:16:32.032076+0000","last_clean":"2024-09-19T09:16:32.032076+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:16:32.032076+0000","last_undegraded":"2024-09-19T09:16:32.032076+0000","last_fullsized":"2024-09-19T09:16:32.032076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993788+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:16:24.993788+0000","last_peered":"2024-09-19T09:16:24.993788+0000","last_clean":"2024-09-19T09:16:24.993788+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:16:24.993788+0000","last_undegraded":"2024-09-19T09:16:24.993788+0000","last_fullsized":"2024-09-19T09:16:24.993788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054341+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:16:35.054341+0000","last_peered":"2024-09-19T09:16:35.054341+0000","last_clean":"2024-09-19T09:16:35.054341+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:16:35.054341+0000","last_undegraded":"2024-09-19T09:16:35.054341+0000","last_fullsized":"2024-09-19T09:16:35.054341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983173+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:16:24.983173+0000","last_peered":"2024-09-19T09:16:24.983173+0000","last_clean":"2024-09-19T09:16:24.983173+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:16:24.983173+0000","last_undegraded":"2024-09-19T09:16:24.983173+0000","last_fullsized":"2024-09-19T09:16:24.983173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046840+0000","last_change":"2024-09-19T09:16:21.963989+0000","last_active":"2024-09-19T09:16:34.046840+0000","last_peered":"2024-09-19T09:16:34.046840+0000","last_clean":"2024-09-19T09:16:34.046840+0000","last_became_active":"2024-09-19T09:16:21.962268+0000","last_became_peered":"2024-09-19T09:16:21.962268+0000","last_unstale":"2024-09-19T09:16:34.046840+0000","last_undegraded":"2024-09-19T09:16:34.046840+0000","last_fullsized":"2024-09-19T09:16:34.046840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:39.004909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994241+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:16:24.994241+0000","last_peered":"2024-09-19T09:16:24.994241+0000","last_clean":"2024-09-19T09:16:24.994241+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:16:24.994241+0000","last_undegraded":"2024-09-19T09:16:24.994241+0000","last_fullsized":"2024-09-19T09:16:24.994241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032039+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:16:32.032039+0000","last_peered":"2024-09-19T09:16:32.032039+0000","last_clean":"2024-09-19T09:16:32.032039+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:16:32.032039+0000","last_undegraded":"2024-09-19T09:16:32.032039+0000","last_fullsized":"2024-09-19T09:16:32.032039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997481+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:16:24.997481+0000","last_peered":"2024-09-19T09:16:24.997481+0000","last_clean":"2024-09-19T09:16:24.997481+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:16:24.997481+0000","last_undegraded":"2024-09-19T09:16:24.997481+0000","last_fullsized":"2024-09-19T09:16:24.997481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995288+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:16:24.995288+0000","last_peered":"2024-09-19T09:16:24.995288+0000","last_clean":"2024-09-19T09:16:24.995288+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:16:24.995288+0000","last_undegraded":"2024-09-19T09:16:24.995288+0000","last_fullsized":"2024-09-19T09:16:24.995288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053092+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:16:35.053092+0000","last_peered":"2024-09-19T09:16:35.053092+0000","last_clean":"2024-09-19T09:16:35.053092+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:16:35.053092+0000","last_undegraded":"2024-09-19T09:16:35.053092+0000","last_fullsized":"2024-09-19T09:16:35.053092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994626+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:16:24.994626+0000","last_peered":"2024-09-19T09:16:24.994626+0000","last_clean":"2024-09-19T09:16:24.994626+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:16:24.994626+0000","last_undegraded":"2024-09-19T09:16:24.994626+0000","last_fullsized":"2024-09-19T09:16:24.994626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.055951+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:16:36.055951+0000","last_peered":"2024-09-19T09:16:36.055951+0000","last_clean":"2024-09-19T09:16:36.055951+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:16:36.055951+0000","last_undegraded":"2024-09-19T09:16:36.055951+0000","last_fullsized":"2024-09-19T09:16:36.055951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996920+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:16:24.996920+0000","last_peered":"2024-09-19T09:16:24.996920+0000","last_clean":"2024-09-19T09:16:24.996920+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:16:24.996920+0000","last_undegraded":"2024-09-19T09:16:24.996920+0000","last_fullsized":"2024-09-19T09:16:24.996920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.000171+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:16:25.000171+0000","last_peered":"2024-09-19T09:16:25.000171+0000","last_clean":"2024-09-19T09:16:25.000171+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:16:25.000171+0000","last_undegraded":"2024-09-19T09:16:25.000171+0000","last_fullsized":"2024-09-19T09:16:25.000171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994481+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:16:24.994481+0000","last_peered":"2024-09-19T09:16:24.994481+0000","last_clean":"2024-09-19T09:16:24.994481+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:16:24.994481+0000","last_undegraded":"2024-09-19T09:16:24.994481+0000","last_fullsized":"2024-09-19T09:16:24.994481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:45.070470+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:16:45.070470+0000","last_peered":"2024-09-19T09:16:45.070470+0000","last_clean":"2024-09-19T09:16:45.070470+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:16:45.070470+0000","last_undegraded":"2024-09-19T09:16:45.070470+0000","last_fullsized":"2024-09-19T09:16:45.070470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54403,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":141,"num_read_kb":135,"num_write":231,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":163209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":431075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":1068513,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1023903,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":430722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1023188,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":430190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":479050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":478437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":432061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:16:49.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:16:50.142 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:50 smithi046 ceph-mon[31203]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2024-09-19T09:16:50.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:50 smithi046 ceph-mon[31203]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:16:50.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:50 smithi115 ceph-mon[35055]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2024-09-19T09:16:50.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:50 smithi115 ceph-mon[35055]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:16:50.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:50 smithi099 ceph-mon[35256]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2024-09-19T09:16:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:50 smithi099 ceph-mon[35256]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 -- 172.21.15.46:0/1343163953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 msgr2=0x7f30041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 --2- 172.21.15.46:0/1343163953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30041021c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3000009900 tx=0x7f300002a410 comp rx=0 tx=0).stop 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 -- 172.21.15.46:0/1343163953 shutdown_connections 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 --2- 172.21.15.46:0/1343163953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004106f10 0x7f300410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 --2- 172.21.15.46:0/1343163953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3004102790 0x7f30041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 --2- 172.21.15.46:0/1343163953 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30041021c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 -- 172.21.15.46:0/1343163953 >> 172.21.15.46:0/1343163953 conn(0x7f30040fd8c0 msgr2=0x7f30040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 -- 172.21.15.46:0/1343163953 shutdown_connections 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 -- 172.21.15.46:0/1343163953 wait complete. 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.685+0000 7f300c419640 1 Processor -- start 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 -- start start 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004102790 0x7f3004074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3004106f10 0x7f3004074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3004111f90 con 0x7f3004101de0 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3004111e10 con 0x7f3004106f10 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300c419640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3004112110 con 0x7f3004102790 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48778/0 (socket says 172.21.15.46:48778) 2024-09-19T09:16:50.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 -- 172.21.15.46:0/286129941 learned_addr learned my addr 172.21.15.46:0/286129941 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a9b6640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3004106f10 0x7f3004074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f30099b4640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004102790 0x7f3004074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 -- 172.21.15.46:0/286129941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004102790 msgr2=0x7f3004074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004102790 0x7f3004074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 -- 172.21.15.46:0/286129941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3004106f10 msgr2=0x7f3004074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3004106f10 0x7f3004074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 -- 172.21.15.46:0/286129941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30041a6950 con 0x7f3004101de0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.686+0000 7f300a1b5640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30040744f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3000006010 tx=0x7f30000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.687+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300003f030 con 0x7f3004101de0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.687+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3000003ce0 con 0x7f3004101de0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.687+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30041a6be0 con 0x7f3004101de0 2024-09-19T09:16:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.687+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000035070 con 0x7f3004101de0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.687+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30041a7110 con 0x7f3004101de0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.688+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30041021c0 con 0x7f3004101de0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.689+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3000042030 con 0x7f3004101de0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.690+0000 7f2ffb7fe640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff00a3350 0x7f2ff00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.690+0000 7f30099b4640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff00a3350 0x7f2ff00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.690+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f30000efd00 con 0x7f3004101de0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.690+0000 7f30099b4640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff00a3350 0x7f2ff00a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3004075f80 tx=0x7f2ff400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.694+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f30000f3030 con 0x7f3004101de0 2024-09-19T09:16:50.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.868+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3004062630 con 0x7f2ff00a3350 2024-09-19T09:16:50.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.875+0000 7f2ffb7fe640 1 -- 172.21.15.46:0/286129941 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258848 (secure 0 0 0) 0x7f3004062630 con 0x7f2ff00a3350 2024-09-19T09:16:50.877 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:16:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff00a3350 msgr2=0x7f2ff00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff00a3350 0x7f2ff00a5810 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3004075f80 tx=0x7f2ff400b390 comp rx=0 tx=0).stop 2024-09-19T09:16:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 msgr2=0x7f30040744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30040744f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3000006010 tx=0x7f30000042f0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 shutdown_connections 2024-09-19T09:16:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff00a3350 0x7f2ff00a5810 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3004106f10 0x7f3004074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3004102790 0x7f3004074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 --2- 172.21.15.46:0/286129941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3004101de0 0x7f30040744f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.877+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 >> 172.21.15.46:0/286129941 conn(0x7f30040fd8c0 msgr2=0x7f30040fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.878+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 shutdown_connections 2024-09-19T09:16:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:50.878+0000 7f300c419640 1 -- 172.21.15.46:0/286129941 wait complete. 2024-09-19T09:16:51.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:51 smithi046 ceph-mon[31203]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:16:51.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:51 smithi115 ceph-mon[35055]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:16:51.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:51 smithi099 ceph-mon[35256]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:16:51.636 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T09:16:48.957081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645005,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":267,"num_read_kb":244,"num_write":414,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":339,"ondisk_log_size":339,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":347868,"kb_used_data":11100,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593956,"statfs":{"total":1151940427776,"available":1151584210944,"internally_reserved":0,"allocated":11366400,"data_stored":7088895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46637,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":44,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003046"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983469+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:16:24.983469+0000","last_peered":"2024-09-19T09:16:24.983469+0000","last_clean":"2024-09-19T09:16:24.983469+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:16:24.983469+0000","last_undegraded":"2024-09-19T09:16:24.983469+0000","last_fullsized":"2024-09-19T09:16:24.983469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997247+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:16:24.997247+0000","last_peered":"2024-09-19T09:16:24.997247+0000","last_clean":"2024-09-19T09:16:24.997247+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:16:24.997247+0000","last_undegraded":"2024-09-19T09:16:24.997247+0000","last_fullsized":"2024-09-19T09:16:24.997247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997082+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:16:24.997082+0000","last_peered":"2024-09-19T09:16:24.997082+0000","last_clean":"2024-09-19T09:16:24.997082+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.997082+0000","last_undegraded":"2024-09-19T09:16:24.997082+0000","last_fullsized":"2024-09-19T09:16:24.997082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994665+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:16:24.994665+0000","last_peered":"2024-09-19T09:16:24.994665+0000","last_clean":"2024-09-19T09:16:24.994665+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:16:24.994665+0000","last_undegraded":"2024-09-19T09:16:24.994665+0000","last_fullsized":"2024-09-19T09:16:24.994665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999452+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:16:24.999452+0000","last_peered":"2024-09-19T09:16:24.999452+0000","last_clean":"2024-09-19T09:16:24.999452+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:16:24.999452+0000","last_undegraded":"2024-09-19T09:16:24.999452+0000","last_fullsized":"2024-09-19T09:16:24.999452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983035+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:16:24.983035+0000","last_peered":"2024-09-19T09:16:24.983035+0000","last_clean":"2024-09-19T09:16:24.983035+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:16:24.983035+0000","last_undegraded":"2024-09-19T09:16:24.983035+0000","last_fullsized":"2024-09-19T09:16:24.983035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997278+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:16:24.997278+0000","last_peered":"2024-09-19T09:16:24.997278+0000","last_clean":"2024-09-19T09:16:24.997278+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:16:24.997278+0000","last_undegraded":"2024-09-19T09:16:24.997278+0000","last_fullsized":"2024-09-19T09:16:24.997278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993833+0000","last_change":"2024-09-19T09:16:23.990830+0000","last_active":"2024-09-19T09:16:24.993833+0000","last_peered":"2024-09-19T09:16:24.993833+0000","last_clean":"2024-09-19T09:16:24.993833+0000","last_became_active":"2024-09-19T09:16:23.990551+0000","last_became_peered":"2024-09-19T09:16:23.990551+0000","last_unstale":"2024-09-19T09:16:24.993833+0000","last_undegraded":"2024-09-19T09:16:24.993833+0000","last_fullsized":"2024-09-19T09:16:24.993833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:06.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995195+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:16:24.995195+0000","last_peered":"2024-09-19T09:16:24.995195+0000","last_clean":"2024-09-19T09:16:24.995195+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:16:24.995195+0000","last_undegraded":"2024-09-19T09:16:24.995195+0000","last_fullsized":"2024-09-19T09:16:24.995195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983440+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:16:24.983440+0000","last_peered":"2024-09-19T09:16:24.983440+0000","last_clean":"2024-09-19T09:16:24.983440+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:16:24.983440+0000","last_undegraded":"2024-09-19T09:16:24.983440+0000","last_fullsized":"2024-09-19T09:16:24.983440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998697+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:16:24.998697+0000","last_peered":"2024-09-19T09:16:24.998697+0000","last_clean":"2024-09-19T09:16:24.998697+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:16:24.998697+0000","last_undegraded":"2024-09-19T09:16:24.998697+0000","last_fullsized":"2024-09-19T09:16:24.998697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994817+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:16:24.994817+0000","last_peered":"2024-09-19T09:16:24.994817+0000","last_clean":"2024-09-19T09:16:24.994817+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:16:24.994817+0000","last_undegraded":"2024-09-19T09:16:24.994817+0000","last_fullsized":"2024-09-19T09:16:24.994817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982364+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:16:24.982364+0000","last_peered":"2024-09-19T09:16:24.982364+0000","last_clean":"2024-09-19T09:16:24.982364+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:16:24.982364+0000","last_undegraded":"2024-09-19T09:16:24.982364+0000","last_fullsized":"2024-09-19T09:16:24.982364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997004+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:16:24.997004+0000","last_peered":"2024-09-19T09:16:24.997004+0000","last_clean":"2024-09-19T09:16:24.997004+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:16:24.997004+0000","last_undegraded":"2024-09-19T09:16:24.997004+0000","last_fullsized":"2024-09-19T09:16:24.997004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996593+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:16:24.996593+0000","last_peered":"2024-09-19T09:16:24.996593+0000","last_clean":"2024-09-19T09:16:24.996593+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:16:24.996593+0000","last_undegraded":"2024-09-19T09:16:24.996593+0000","last_fullsized":"2024-09-19T09:16:24.996593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994114+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:16:24.994114+0000","last_peered":"2024-09-19T09:16:24.994114+0000","last_clean":"2024-09-19T09:16:24.994114+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:16:24.994114+0000","last_undegraded":"2024-09-19T09:16:24.994114+0000","last_fullsized":"2024-09-19T09:16:24.994114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983416+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:16:24.983416+0000","last_peered":"2024-09-19T09:16:24.983416+0000","last_clean":"2024-09-19T09:16:24.983416+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:16:24.983416+0000","last_undegraded":"2024-09-19T09:16:24.983416+0000","last_fullsized":"2024-09-19T09:16:24.983416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994115+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:16:24.994115+0000","last_peered":"2024-09-19T09:16:24.994115+0000","last_clean":"2024-09-19T09:16:24.994115+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:16:24.994115+0000","last_undegraded":"2024-09-19T09:16:24.994115+0000","last_fullsized":"2024-09-19T09:16:24.994115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998941+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:16:24.998941+0000","last_peered":"2024-09-19T09:16:24.998941+0000","last_clean":"2024-09-19T09:16:24.998941+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:16:24.998941+0000","last_undegraded":"2024-09-19T09:16:24.998941+0000","last_fullsized":"2024-09-19T09:16:24.998941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983110+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:16:24.983110+0000","last_peered":"2024-09-19T09:16:24.983110+0000","last_clean":"2024-09-19T09:16:24.983110+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:16:24.983110+0000","last_undegraded":"2024-09-19T09:16:24.983110+0000","last_fullsized":"2024-09-19T09:16:24.983110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982389+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:16:24.982389+0000","last_peered":"2024-09-19T09:16:24.982389+0000","last_clean":"2024-09-19T09:16:24.982389+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:16:24.982389+0000","last_undegraded":"2024-09-19T09:16:24.982389+0000","last_fullsized":"2024-09-19T09:16:24.982389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994839+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:16:24.994839+0000","last_peered":"2024-09-19T09:16:24.994839+0000","last_clean":"2024-09-19T09:16:24.994839+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:16:24.994839+0000","last_undegraded":"2024-09-19T09:16:24.994839+0000","last_fullsized":"2024-09-19T09:16:24.994839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994841+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:16:24.994841+0000","last_peered":"2024-09-19T09:16:24.994841+0000","last_clean":"2024-09-19T09:16:24.994841+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:16:24.994841+0000","last_undegraded":"2024-09-19T09:16:24.994841+0000","last_fullsized":"2024-09-19T09:16:24.994841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994171+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:16:24.994171+0000","last_peered":"2024-09-19T09:16:24.994171+0000","last_clean":"2024-09-19T09:16:24.994171+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:16:24.994171+0000","last_undegraded":"2024-09-19T09:16:24.994171+0000","last_fullsized":"2024-09-19T09:16:24.994171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994413+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:16:24.994413+0000","last_peered":"2024-09-19T09:16:24.994413+0000","last_clean":"2024-09-19T09:16:24.994413+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:16:24.994413+0000","last_undegraded":"2024-09-19T09:16:24.994413+0000","last_fullsized":"2024-09-19T09:16:24.994413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997932+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:16:24.997932+0000","last_peered":"2024-09-19T09:16:24.997932+0000","last_clean":"2024-09-19T09:16:24.997932+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:16:24.997932+0000","last_undegraded":"2024-09-19T09:16:24.997932+0000","last_fullsized":"2024-09-19T09:16:24.997932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983394+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:16:24.983394+0000","last_peered":"2024-09-19T09:16:24.983394+0000","last_clean":"2024-09-19T09:16:24.983394+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:16:24.983394+0000","last_undegraded":"2024-09-19T09:16:24.983394+0000","last_fullsized":"2024-09-19T09:16:24.983394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982293+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:16:24.982293+0000","last_peered":"2024-09-19T09:16:24.982293+0000","last_clean":"2024-09-19T09:16:24.982293+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:16:24.982293+0000","last_undegraded":"2024-09-19T09:16:24.982293+0000","last_fullsized":"2024-09-19T09:16:24.982293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996897+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:16:24.996897+0000","last_peered":"2024-09-19T09:16:24.996897+0000","last_clean":"2024-09-19T09:16:24.996897+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:16:24.996897+0000","last_undegraded":"2024-09-19T09:16:24.996897+0000","last_fullsized":"2024-09-19T09:16:24.996897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998367+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:16:24.998367+0000","last_peered":"2024-09-19T09:16:24.998367+0000","last_clean":"2024-09-19T09:16:24.998367+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:16:24.998367+0000","last_undegraded":"2024-09-19T09:16:24.998367+0000","last_fullsized":"2024-09-19T09:16:24.998367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999424+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:16:24.999424+0000","last_peered":"2024-09-19T09:16:24.999424+0000","last_clean":"2024-09-19T09:16:24.999424+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:16:24.999424+0000","last_undegraded":"2024-09-19T09:16:24.999424+0000","last_fullsized":"2024-09-19T09:16:24.999424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983090+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:16:24.983090+0000","last_peered":"2024-09-19T09:16:24.983090+0000","last_clean":"2024-09-19T09:16:24.983090+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:16:24.983090+0000","last_undegraded":"2024-09-19T09:16:24.983090+0000","last_fullsized":"2024-09-19T09:16:24.983090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994599+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:16:24.994599+0000","last_peered":"2024-09-19T09:16:24.994599+0000","last_clean":"2024-09-19T09:16:24.994599+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:16:24.994599+0000","last_undegraded":"2024-09-19T09:16:24.994599+0000","last_fullsized":"2024-09-19T09:16:24.994599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:43.068140+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:16:43.068140+0000","last_peered":"2024-09-19T09:16:43.068140+0000","last_clean":"2024-09-19T09:16:43.068140+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:16:43.068140+0000","last_undegraded":"2024-09-19T09:16:43.068140+0000","last_fullsized":"2024-09-19T09:16:43.068140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994055+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:16:24.994055+0000","last_peered":"2024-09-19T09:16:24.994055+0000","last_clean":"2024-09-19T09:16:24.994055+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:16:24.994055+0000","last_undegraded":"2024-09-19T09:16:24.994055+0000","last_fullsized":"2024-09-19T09:16:24.994055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046259+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:16:34.046259+0000","last_peered":"2024-09-19T09:16:34.046259+0000","last_clean":"2024-09-19T09:16:34.046259+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:16:34.046259+0000","last_undegraded":"2024-09-19T09:16:34.046259+0000","last_fullsized":"2024-09-19T09:16:34.046259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.038532+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:16:33.038532+0000","last_peered":"2024-09-19T09:16:33.038532+0000","last_clean":"2024-09-19T09:16:33.038532+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:16:33.038532+0000","last_undegraded":"2024-09-19T09:16:33.038532+0000","last_fullsized":"2024-09-19T09:16:33.038532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993874+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:16:24.993874+0000","last_peered":"2024-09-19T09:16:24.993874+0000","last_clean":"2024-09-19T09:16:24.993874+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:16:24.993874+0000","last_undegraded":"2024-09-19T09:16:24.993874+0000","last_fullsized":"2024-09-19T09:16:24.993874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054421+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:16:35.054421+0000","last_peered":"2024-09-19T09:16:35.054421+0000","last_clean":"2024-09-19T09:16:35.054421+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:16:35.054421+0000","last_undegraded":"2024-09-19T09:16:35.054421+0000","last_fullsized":"2024-09-19T09:16:35.054421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993648+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:16:24.993648+0000","last_peered":"2024-09-19T09:16:24.993648+0000","last_clean":"2024-09-19T09:16:24.993648+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:16:24.993648+0000","last_undegraded":"2024-09-19T09:16:24.993648+0000","last_fullsized":"2024-09-19T09:16:24.993648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:46.071834+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:16:46.071834+0000","last_peered":"2024-09-19T09:16:46.071834+0000","last_clean":"2024-09-19T09:16:46.071834+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:16:46.071834+0000","last_undegraded":"2024-09-19T09:16:46.071834+0000","last_fullsized":"2024-09-19T09:16:46.071834+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994939+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:16:24.994939+0000","last_peered":"2024-09-19T09:16:24.994939+0000","last_clean":"2024-09-19T09:16:24.994939+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:16:24.994939+0000","last_undegraded":"2024-09-19T09:16:24.994939+0000","last_fullsized":"2024-09-19T09:16:24.994939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052926+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:16:35.052926+0000","last_peered":"2024-09-19T09:16:35.052926+0000","last_clean":"2024-09-19T09:16:35.052926+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:16:35.052926+0000","last_undegraded":"2024-09-19T09:16:35.052926+0000","last_fullsized":"2024-09-19T09:16:35.052926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997081+0000","last_change":"2024-09-19T09:16:23.987959+0000","last_active":"2024-09-19T09:16:24.997081+0000","last_peered":"2024-09-19T09:16:24.997081+0000","last_clean":"2024-09-19T09:16:24.997081+0000","last_became_active":"2024-09-19T09:16:23.987676+0000","last_became_peered":"2024-09-19T09:16:23.987676+0000","last_unstale":"2024-09-19T09:16:24.997081+0000","last_undegraded":"2024-09-19T09:16:24.997081+0000","last_fullsized":"2024-09-19T09:16:24.997081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:15.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046182+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:16:34.046182+0000","last_peered":"2024-09-19T09:16:34.046182+0000","last_clean":"2024-09-19T09:16:34.046182+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:16:34.046182+0000","last_undegraded":"2024-09-19T09:16:34.046182+0000","last_fullsized":"2024-09-19T09:16:34.046182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994911+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:16:24.994911+0000","last_peered":"2024-09-19T09:16:24.994911+0000","last_clean":"2024-09-19T09:16:24.994911+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:16:24.994911+0000","last_undegraded":"2024-09-19T09:16:24.994911+0000","last_fullsized":"2024-09-19T09:16:24.994911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'24","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:46.074624+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:16:46.074624+0000","last_peered":"2024-09-19T09:16:46.074624+0000","last_clean":"2024-09-19T09:16:46.074624+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:16:46.074624+0000","last_undegraded":"2024-09-19T09:16:46.074624+0000","last_fullsized":"2024-09-19T09:16:46.074624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":59,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994231+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:16:24.994231+0000","last_peered":"2024-09-19T09:16:24.994231+0000","last_clean":"2024-09-19T09:16:24.994231+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:16:24.994231+0000","last_undegraded":"2024-09-19T09:16:24.994231+0000","last_fullsized":"2024-09-19T09:16:24.994231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056195+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:16:36.056195+0000","last_peered":"2024-09-19T09:16:36.056195+0000","last_clean":"2024-09-19T09:16:36.056195+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:16:36.056195+0000","last_undegraded":"2024-09-19T09:16:36.056195+0000","last_fullsized":"2024-09-19T09:16:36.056195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982097+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:16:24.982097+0000","last_peered":"2024-09-19T09:16:24.982097+0000","last_clean":"2024-09-19T09:16:24.982097+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:16:24.982097+0000","last_undegraded":"2024-09-19T09:16:24.982097+0000","last_fullsized":"2024-09-19T09:16:24.982097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054355+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:16:35.054355+0000","last_peered":"2024-09-19T09:16:35.054355+0000","last_clean":"2024-09-19T09:16:35.054355+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:16:35.054355+0000","last_undegraded":"2024-09-19T09:16:35.054355+0000","last_fullsized":"2024-09-19T09:16:35.054355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997417+0000","last_change":"2024-09-19T09:16:23.991471+0000","last_active":"2024-09-19T09:16:24.997417+0000","last_peered":"2024-09-19T09:16:24.997417+0000","last_clean":"2024-09-19T09:16:24.997417+0000","last_became_active":"2024-09-19T09:16:23.991110+0000","last_became_peered":"2024-09-19T09:16:23.991110+0000","last_unstale":"2024-09-19T09:16:24.997417+0000","last_undegraded":"2024-09-19T09:16:24.997417+0000","last_fullsized":"2024-09-19T09:16:24.997417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:59.954737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:43.068728+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:16:43.068728+0000","last_peered":"2024-09-19T09:16:43.068728+0000","last_clean":"2024-09-19T09:16:43.068728+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:16:43.068728+0000","last_undegraded":"2024-09-19T09:16:43.068728+0000","last_fullsized":"2024-09-19T09:16:43.068728+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997018+0000","last_change":"2024-09-19T09:16:23.991777+0000","last_active":"2024-09-19T09:16:24.997018+0000","last_peered":"2024-09-19T09:16:24.997018+0000","last_clean":"2024-09-19T09:16:24.997018+0000","last_became_active":"2024-09-19T09:16:23.991294+0000","last_became_peered":"2024-09-19T09:16:23.991294+0000","last_unstale":"2024-09-19T09:16:24.997018+0000","last_undegraded":"2024-09-19T09:16:24.997018+0000","last_fullsized":"2024-09-19T09:16:24.997018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:39.740855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052584+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:16:35.052584+0000","last_peered":"2024-09-19T09:16:35.052584+0000","last_clean":"2024-09-19T09:16:35.052584+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:16:35.052584+0000","last_undegraded":"2024-09-19T09:16:35.052584+0000","last_fullsized":"2024-09-19T09:16:35.052584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996749+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:16:24.996749+0000","last_peered":"2024-09-19T09:16:24.996749+0000","last_clean":"2024-09-19T09:16:24.996749+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:16:24.996749+0000","last_undegraded":"2024-09-19T09:16:24.996749+0000","last_fullsized":"2024-09-19T09:16:24.996749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.034597+0000","last_change":"2024-09-19T09:16:21.958901+0000","last_active":"2024-09-19T09:16:34.034597+0000","last_peered":"2024-09-19T09:16:34.034597+0000","last_clean":"2024-09-19T09:16:34.034597+0000","last_became_active":"2024-09-19T09:16:21.958453+0000","last_became_peered":"2024-09-19T09:16:21.958453+0000","last_unstale":"2024-09-19T09:16:34.034597+0000","last_undegraded":"2024-09-19T09:16:34.034597+0000","last_fullsized":"2024-09-19T09:16:34.034597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:34.681594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983304+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:16:24.983304+0000","last_peered":"2024-09-19T09:16:24.983304+0000","last_clean":"2024-09-19T09:16:24.983304+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:16:24.983304+0000","last_undegraded":"2024-09-19T09:16:24.983304+0000","last_fullsized":"2024-09-19T09:16:24.983304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.050741+0000","last_change":"2024-09-19T09:16:21.961069+0000","last_active":"2024-09-19T09:16:35.050741+0000","last_peered":"2024-09-19T09:16:35.050741+0000","last_clean":"2024-09-19T09:16:35.050741+0000","last_became_active":"2024-09-19T09:16:21.960766+0000","last_became_peered":"2024-09-19T09:16:21.960766+0000","last_unstale":"2024-09-19T09:16:35.050741+0000","last_undegraded":"2024-09-19T09:16:35.050741+0000","last_fullsized":"2024-09-19T09:16:35.050741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:43.410794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998719+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:16:24.998719+0000","last_peered":"2024-09-19T09:16:24.998719+0000","last_clean":"2024-09-19T09:16:24.998719+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:16:24.998719+0000","last_undegraded":"2024-09-19T09:16:24.998719+0000","last_fullsized":"2024-09-19T09:16:24.998719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053894+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:16:35.053894+0000","last_peered":"2024-09-19T09:16:35.053894+0000","last_clean":"2024-09-19T09:16:35.053894+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:16:35.053894+0000","last_undegraded":"2024-09-19T09:16:35.053894+0000","last_fullsized":"2024-09-19T09:16:35.053894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.702748+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:16:25.702748+0000","last_peered":"2024-09-19T09:16:25.702748+0000","last_clean":"2024-09-19T09:16:25.702748+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:16:25.702748+0000","last_undegraded":"2024-09-19T09:16:25.702748+0000","last_fullsized":"2024-09-19T09:16:25.702748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:43.068906+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:16:43.068906+0000","last_peered":"2024-09-19T09:16:43.068906+0000","last_clean":"2024-09-19T09:16:43.068906+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:16:43.068906+0000","last_undegraded":"2024-09-19T09:16:43.068906+0000","last_fullsized":"2024-09-19T09:16:43.068906+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998903+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:16:24.998903+0000","last_peered":"2024-09-19T09:16:24.998903+0000","last_clean":"2024-09-19T09:16:24.998903+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:16:24.998903+0000","last_undegraded":"2024-09-19T09:16:24.998903+0000","last_fullsized":"2024-09-19T09:16:24.998903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997504+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:16:24.997504+0000","last_peered":"2024-09-19T09:16:24.997504+0000","last_clean":"2024-09-19T09:16:24.997504+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:16:24.997504+0000","last_undegraded":"2024-09-19T09:16:24.997504+0000","last_fullsized":"2024-09-19T09:16:24.997504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056230+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:16:36.056230+0000","last_peered":"2024-09-19T09:16:36.056230+0000","last_clean":"2024-09-19T09:16:36.056230+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:16:36.056230+0000","last_undegraded":"2024-09-19T09:16:36.056230+0000","last_fullsized":"2024-09-19T09:16:36.056230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994708+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:16:24.994708+0000","last_peered":"2024-09-19T09:16:24.994708+0000","last_clean":"2024-09-19T09:16:24.994708+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:16:24.994708+0000","last_undegraded":"2024-09-19T09:16:24.994708+0000","last_fullsized":"2024-09-19T09:16:24.994708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.037803+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:16:33.037803+0000","last_peered":"2024-09-19T09:16:33.037803+0000","last_clean":"2024-09-19T09:16:33.037803+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:16:33.037803+0000","last_undegraded":"2024-09-19T09:16:33.037803+0000","last_fullsized":"2024-09-19T09:16:33.037803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.981964+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:16:24.981964+0000","last_peered":"2024-09-19T09:16:24.981964+0000","last_clean":"2024-09-19T09:16:24.981964+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.981964+0000","last_undegraded":"2024-09-19T09:16:24.981964+0000","last_fullsized":"2024-09-19T09:16:24.981964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:44.069271+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:16:44.069271+0000","last_peered":"2024-09-19T09:16:44.069271+0000","last_clean":"2024-09-19T09:16:44.069271+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:16:44.069271+0000","last_undegraded":"2024-09-19T09:16:44.069271+0000","last_fullsized":"2024-09-19T09:16:44.069271+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994334+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:16:24.994334+0000","last_peered":"2024-09-19T09:16:24.994334+0000","last_clean":"2024-09-19T09:16:24.994334+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:16:24.994334+0000","last_undegraded":"2024-09-19T09:16:24.994334+0000","last_fullsized":"2024-09-19T09:16:24.994334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:44.069715+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:16:44.069715+0000","last_peered":"2024-09-19T09:16:44.069715+0000","last_clean":"2024-09-19T09:16:44.069715+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:16:44.069715+0000","last_undegraded":"2024-09-19T09:16:44.069715+0000","last_fullsized":"2024-09-19T09:16:44.069715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983250+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:16:24.983250+0000","last_peered":"2024-09-19T09:16:24.983250+0000","last_clean":"2024-09-19T09:16:24.983250+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:16:24.983250+0000","last_undegraded":"2024-09-19T09:16:24.983250+0000","last_fullsized":"2024-09-19T09:16:24.983250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993764+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:16:24.993764+0000","last_peered":"2024-09-19T09:16:24.993764+0000","last_clean":"2024-09-19T09:16:24.993764+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:16:24.993764+0000","last_undegraded":"2024-09-19T09:16:24.993764+0000","last_fullsized":"2024-09-19T09:16:24.993764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:26.765577+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:16:26.765577+0000","last_peered":"2024-09-19T09:16:26.765577+0000","last_clean":"2024-09-19T09:16:26.765577+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:16:26.765577+0000","last_undegraded":"2024-09-19T09:16:26.765577+0000","last_fullsized":"2024-09-19T09:16:26.765577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052268+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:16:35.052268+0000","last_peered":"2024-09-19T09:16:35.052268+0000","last_clean":"2024-09-19T09:16:35.052268+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:16:35.052268+0000","last_undegraded":"2024-09-19T09:16:35.052268+0000","last_fullsized":"2024-09-19T09:16:35.052268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982441+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:16:24.982441+0000","last_peered":"2024-09-19T09:16:24.982441+0000","last_clean":"2024-09-19T09:16:24.982441+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:16:24.982441+0000","last_undegraded":"2024-09-19T09:16:24.982441+0000","last_fullsized":"2024-09-19T09:16:24.982441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'11","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:42.994436+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:16:42.994436+0000","last_peered":"2024-09-19T09:16:42.994436+0000","last_clean":"2024-09-19T09:16:42.994436+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:16:42.994436+0000","last_undegraded":"2024-09-19T09:16:42.994436+0000","last_fullsized":"2024-09-19T09:16:42.994436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994595+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:16:24.994595+0000","last_peered":"2024-09-19T09:16:24.994595+0000","last_clean":"2024-09-19T09:16:24.994595+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:16:24.994595+0000","last_undegraded":"2024-09-19T09:16:24.994595+0000","last_fullsized":"2024-09-19T09:16:24.994595+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052464+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:16:35.052464+0000","last_peered":"2024-09-19T09:16:35.052464+0000","last_clean":"2024-09-19T09:16:35.052464+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:16:35.052464+0000","last_undegraded":"2024-09-19T09:16:35.052464+0000","last_fullsized":"2024-09-19T09:16:35.052464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997305+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:16:24.997305+0000","last_peered":"2024-09-19T09:16:24.997305+0000","last_clean":"2024-09-19T09:16:24.997305+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:16:24.997305+0000","last_undegraded":"2024-09-19T09:16:24.997305+0000","last_fullsized":"2024-09-19T09:16:24.997305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032076+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:16:32.032076+0000","last_peered":"2024-09-19T09:16:32.032076+0000","last_clean":"2024-09-19T09:16:32.032076+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:16:32.032076+0000","last_undegraded":"2024-09-19T09:16:32.032076+0000","last_fullsized":"2024-09-19T09:16:32.032076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993788+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:16:24.993788+0000","last_peered":"2024-09-19T09:16:24.993788+0000","last_clean":"2024-09-19T09:16:24.993788+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:16:24.993788+0000","last_undegraded":"2024-09-19T09:16:24.993788+0000","last_fullsized":"2024-09-19T09:16:24.993788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054341+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:16:35.054341+0000","last_peered":"2024-09-19T09:16:35.054341+0000","last_clean":"2024-09-19T09:16:35.054341+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:16:35.054341+0000","last_undegraded":"2024-09-19T09:16:35.054341+0000","last_fullsized":"2024-09-19T09:16:35.054341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983173+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:16:24.983173+0000","last_peered":"2024-09-19T09:16:24.983173+0000","last_clean":"2024-09-19T09:16:24.983173+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:16:24.983173+0000","last_undegraded":"2024-09-19T09:16:24.983173+0000","last_fullsized":"2024-09-19T09:16:24.983173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046840+0000","last_change":"2024-09-19T09:16:21.963989+0000","last_active":"2024-09-19T09:16:34.046840+0000","last_peered":"2024-09-19T09:16:34.046840+0000","last_clean":"2024-09-19T09:16:34.046840+0000","last_became_active":"2024-09-19T09:16:21.962268+0000","last_became_peered":"2024-09-19T09:16:21.962268+0000","last_unstale":"2024-09-19T09:16:34.046840+0000","last_undegraded":"2024-09-19T09:16:34.046840+0000","last_fullsized":"2024-09-19T09:16:34.046840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:39.004909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994241+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:16:24.994241+0000","last_peered":"2024-09-19T09:16:24.994241+0000","last_clean":"2024-09-19T09:16:24.994241+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:16:24.994241+0000","last_undegraded":"2024-09-19T09:16:24.994241+0000","last_fullsized":"2024-09-19T09:16:24.994241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032039+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:16:32.032039+0000","last_peered":"2024-09-19T09:16:32.032039+0000","last_clean":"2024-09-19T09:16:32.032039+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:16:32.032039+0000","last_undegraded":"2024-09-19T09:16:32.032039+0000","last_fullsized":"2024-09-19T09:16:32.032039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997481+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:16:24.997481+0000","last_peered":"2024-09-19T09:16:24.997481+0000","last_clean":"2024-09-19T09:16:24.997481+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:16:24.997481+0000","last_undegraded":"2024-09-19T09:16:24.997481+0000","last_fullsized":"2024-09-19T09:16:24.997481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995288+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:16:24.995288+0000","last_peered":"2024-09-19T09:16:24.995288+0000","last_clean":"2024-09-19T09:16:24.995288+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:16:24.995288+0000","last_undegraded":"2024-09-19T09:16:24.995288+0000","last_fullsized":"2024-09-19T09:16:24.995288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053092+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:16:35.053092+0000","last_peered":"2024-09-19T09:16:35.053092+0000","last_clean":"2024-09-19T09:16:35.053092+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:16:35.053092+0000","last_undegraded":"2024-09-19T09:16:35.053092+0000","last_fullsized":"2024-09-19T09:16:35.053092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994626+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:16:24.994626+0000","last_peered":"2024-09-19T09:16:24.994626+0000","last_clean":"2024-09-19T09:16:24.994626+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:16:24.994626+0000","last_undegraded":"2024-09-19T09:16:24.994626+0000","last_fullsized":"2024-09-19T09:16:24.994626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.055951+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:16:36.055951+0000","last_peered":"2024-09-19T09:16:36.055951+0000","last_clean":"2024-09-19T09:16:36.055951+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:16:36.055951+0000","last_undegraded":"2024-09-19T09:16:36.055951+0000","last_fullsized":"2024-09-19T09:16:36.055951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996920+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:16:24.996920+0000","last_peered":"2024-09-19T09:16:24.996920+0000","last_clean":"2024-09-19T09:16:24.996920+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:16:24.996920+0000","last_undegraded":"2024-09-19T09:16:24.996920+0000","last_fullsized":"2024-09-19T09:16:24.996920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.000171+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:16:25.000171+0000","last_peered":"2024-09-19T09:16:25.000171+0000","last_clean":"2024-09-19T09:16:25.000171+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:16:25.000171+0000","last_undegraded":"2024-09-19T09:16:25.000171+0000","last_fullsized":"2024-09-19T09:16:25.000171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994481+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:16:24.994481+0000","last_peered":"2024-09-19T09:16:24.994481+0000","last_clean":"2024-09-19T09:16:24.994481+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:16:24.994481+0000","last_undegraded":"2024-09-19T09:16:24.994481+0000","last_fullsized":"2024-09-19T09:16:24.994481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:45.070470+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:16:45.070470+0000","last_peered":"2024-09-19T09:16:45.070470+0000","last_clean":"2024-09-19T09:16:45.070470+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:16:45.070470+0000","last_undegraded":"2024-09-19T09:16:45.070470+0000","last_fullsized":"2024-09-19T09:16:45.070470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54403,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":141,"num_read_kb":135,"num_write":231,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":163209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514514,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":431075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":1068513,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1023903,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":430722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1023188,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":430190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215162,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":479050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":478437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":432061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:16:51.640 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:16:51.641 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:16:51.641 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:16:51.902 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:52.316 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:52 smithi046 ceph-mon[31203]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.332+0000 7f72a69d3640 1 -- 172.21.15.46:0/3806401466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a01078c0 msgr2=0x7f72a0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.332+0000 7f72a69d3640 1 --2- 172.21.15.46:0/3806401466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a01078c0 0x7f72a0109d10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7298009ca0 tx=0x7f729802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 -- 172.21.15.46:0/3806401466 shutdown_connections 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 --2- 172.21.15.46:0/3806401466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a01078c0 0x7f72a0109d10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 --2- 172.21.15.46:0/3806401466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72a0104f90 0x7f72a0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 --2- 172.21.15.46:0/3806401466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 0x7f72a0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 -- 172.21.15.46:0/3806401466 >> 172.21.15.46:0/3806401466 conn(0x7f72a00fc280 msgr2=0x7f72a00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:52.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 -- 172.21.15.46:0/3806401466 shutdown_connections 2024-09-19T09:16:52.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 -- 172.21.15.46:0/3806401466 wait complete. 2024-09-19T09:16:52.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 Processor -- start 2024-09-19T09:16:52.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.333+0000 7f72a69d3640 1 -- start start 2024-09-19T09:16:52.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a69d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 0x7f72a0101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a69d3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 0x7f72a0100610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a69d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72a01078c0 0x7f72a0100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a69d3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72a010d880 con 0x7f72a0104f90 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a69d3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f72a010d700 con 0x7f72a0102660 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a69d3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f72a010da00 con 0x7f72a01078c0 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 0x7f72a0100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 0x7f72a0100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48804/0 (socket says 172.21.15.46:48804) 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 -- 172.21.15.46:0/1260454534 learned_addr learned my addr 172.21.15.46:0/1260454534 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f72a4f70640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72a01078c0 0x7f72a0100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729ffff640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 0x7f72a0101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 -- 172.21.15.46:0/1260454534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72a01078c0 msgr2=0x7f72a0100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:52.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72a01078c0 0x7f72a0100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 -- 172.21.15.46:0/1260454534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 msgr2=0x7f72a0101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 0x7f72a0101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 -- 172.21.15.46:0/1260454534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a0101410 con 0x7f72a0104f90 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729ffff640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 0x7f72a0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729f7fe640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 0x7f72a0100610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f729400d740 tx=0x7f729400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294017070 con 0x7f72a0104f90 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.334+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f729400de50 con 0x7f72a0104f90 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.335+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a01a1fe0 con 0x7f72a0104f90 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.335+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294004e00 con 0x7f72a0104f90 2024-09-19T09:16:52.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.335+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a01a2440 con 0x7f72a0104f90 2024-09-19T09:16:52.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.336+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a00fdd70 con 0x7f72a0104f90 2024-09-19T09:16:52.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.337+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7294004fa0 con 0x7f72a0104f90 2024-09-19T09:16:52.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.337+0000 7f729d7fa640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f72880a32d0 0x7f72880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:52.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.338+0000 7f729ffff640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f72880a32d0 0x7f72880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:52.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.338+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f72940cf2c0 con 0x7f72a0104f90 2024-09-19T09:16:52.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.338+0000 7f729ffff640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f72880a32d0 0x7f72880a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f729000abe0 tx=0x7f729000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:52.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.342+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f729409c030 con 0x7f72a0104f90 2024-09-19T09:16:52.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:52 smithi115 ceph-mon[35055]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2024-09-19T09:16:52.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:52 smithi099 ceph-mon[35256]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2024-09-19T09:16:52.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.586+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f72a0062df0 con 0x7f72a0104f90 2024-09-19T09:16:52.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.588+0000 7f729d7fa640 1 -- 172.21.15.46:0/1260454534 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f729409b930 con 0x7f72a0104f90 2024-09-19T09:16:52.589 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-09-19T09:16:52.589 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQAE7OtmBGr9IhAAqvTvPkObI7un64Afazt1iQ== 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f72880a32d0 msgr2=0x7f72880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f72880a32d0 0x7f72880a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f729000abe0 tx=0x7f729000a5c0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 msgr2=0x7f72a0100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 0x7f72a0100610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f729400d740 tx=0x7f729400dc00 comp rx=0 tx=0).stop 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 shutdown_connections 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f72880a32d0 0x7f72880a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72a0104f90 0x7f72a0100610 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72a01078c0 0x7f72a0100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 --2- 172.21.15.46:0/1260454534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72a0102660 0x7f72a0101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:52.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.591+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 >> 172.21.15.46:0/1260454534 conn(0x7f72a00fc280 msgr2=0x7f72a0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:52.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.592+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 shutdown_connections 2024-09-19T09:16:52.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:52.592+0000 7f72a69d3640 1 -- 172.21.15.46:0/1260454534 wait complete. 2024-09-19T09:16:53.197 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:53 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1260454534' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:16:53.197 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:53 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1260454534' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:16:53.225 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:16:53.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:16:53.225 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:16:53.262 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:16:53.263 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:16:53.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:16:53.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:53 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1260454534' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:16:53.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:53 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1260454534' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:16:53.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:53 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1260454534' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:16:53.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:53 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1260454534' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:16:53.557 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 -- 172.21.15.46:0/2621889175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc106f10 msgr2=0x7fedbc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 --2- 172.21.15.46:0/2621889175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc106f10 0x7fedbc10ea90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009ca0 tx=0x7fedb402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 -- 172.21.15.46:0/2621889175 shutdown_connections 2024-09-19T09:16:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 --2- 172.21.15.46:0/2621889175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc106f10 0x7fedbc10ea90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 --2- 172.21.15.46:0/2621889175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc102790 0x7fedbc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 --2- 172.21.15.46:0/2621889175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedbc101de0 0x7fedbc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 -- 172.21.15.46:0/2621889175 >> 172.21.15.46:0/2621889175 conn(0x7fedbc0fd8c0 msgr2=0x7fedbc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 -- 172.21.15.46:0/2621889175 shutdown_connections 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.025+0000 7fedc0dad640 1 -- 172.21.15.46:0/2621889175 wait complete. 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 Processor -- start 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 -- start start 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc101de0 0x7fedbc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 0x7fedbc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedbc106f10 0x7fedbc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:54.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc111f90 con 0x7fedbc102790 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc111e10 con 0x7fedbc106f10 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedc0dad640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc112110 con 0x7fedbc101de0 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedb9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 0x7fedbc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedb9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 0x7fedbc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48816/0 (socket says 172.21.15.46:48816) 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.026+0000 7fedb9d9b640 1 -- 172.21.15.46:0/1232898142 learned_addr learned my addr 172.21.15.46:0/1232898142 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedba59c640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc101de0 0x7fedbc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedbad9d640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedbc106f10 0x7fedbc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedb9d9b640 1 -- 172.21.15.46:0/1232898142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc101de0 msgr2=0x7fedbc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedb9d9b640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc101de0 0x7fedbc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedb9d9b640 1 -- 172.21.15.46:0/1232898142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedbc106f10 msgr2=0x7fedbc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedb9d9b640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedbc106f10 0x7fedbc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedb9d9b640 1 -- 172.21.15.46:0/1232898142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc1a68d0 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedba59c640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc101de0 0x7fedbc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedb9d9b640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 0x7fedbc074a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedb000b4a0 tx=0x7fedb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0014070 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc1a6bc0 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedb0010af0 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0017d10 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.027+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc1a7100 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.028+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc1021c0 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.029+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fedb0017070 con 0x7fedbc102790 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.030+0000 7fedab7fe640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feda40a32d0 0x7feda40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:54.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.030+0000 7fedba59c640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feda40a32d0 0x7feda40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.030+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fedb00ced60 con 0x7fedbc102790 2024-09-19T09:16:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.030+0000 7fedba59c640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feda40a32d0 0x7feda40a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fedac00abe0 tx=0x7fedac00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:54.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.035+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedb009bae0 con 0x7fedbc102790 2024-09-19T09:16:54.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.261+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fedbc1a7330 con 0x7fedbc102790 2024-09-19T09:16:54.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.265+0000 7fedab7fe640 1 -- 172.21.15.46:0/1232898142 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264049 (secure 0 0 0) 0x7fedb009b3e0 con 0x7fedbc102790 2024-09-19T09:16:54.269 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feda40a32d0 msgr2=0x7feda40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feda40a32d0 0x7feda40a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fedac00abe0 tx=0x7fedac00a5c0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 msgr2=0x7fedbc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 0x7fedbc074a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedb000b4a0 tx=0x7fedb000b960 comp rx=0 tx=0).stop 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 shutdown_connections 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feda40a32d0 0x7feda40a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedbc102790 0x7fedbc074a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedbc106f10 0x7fedbc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 --2- 172.21.15.46:0/1232898142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedbc101de0 0x7fedbc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:54.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 >> 172.21.15.46:0/1232898142 conn(0x7fedbc0fd8c0 msgr2=0x7fedbc0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:54.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 shutdown_connections 2024-09-19T09:16:54.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:54.269+0000 7fedc0dad640 1 -- 172.21.15.46:0/1232898142 wait complete. 2024-09-19T09:16:54.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:54 smithi115 ceph-mon[35055]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 13 op/s 2024-09-19T09:16:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:54 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1232898142' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:16:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:54 smithi046 ceph-mon[31203]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 13 op/s 2024-09-19T09:16:54.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:54 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1232898142' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:16:55.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:54 smithi099 ceph-mon[35256]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 13 op/s 2024-09-19T09:16:55.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:54 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1232898142' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:16:55.047 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":1744336406},{"type":"v1","addr":"172.21.15.46:6801","nonce":1744336406}]},"active_addr":"172.21.15.46:6801/1744336406","active_change":"2024-09-19T09:09:28.870293+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":4145036145}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1508192985}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":1356655432}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3120025951}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":794812614}]}]} 2024-09-19T09:16:55.053 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:16:55.054 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:16:55.054 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:16:55.313 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:55.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1062664209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918106f10 msgr2=0x7fe91810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1062664209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918106f10 0x7fe91810ea90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe910009ca0 tx=0x7fe91002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1062664209 shutdown_connections 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1062664209 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918106f10 0x7fe91810ea90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1062664209 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918102790 0x7fe9181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1062664209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918101de0 0x7fe9181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1062664209 >> 172.21.15.46:0/1062664209 conn(0x7fe9180fd8c0 msgr2=0x7fe9180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1062664209 shutdown_connections 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.918+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1062664209 wait complete. 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 Processor -- start 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 -- start start 2024-09-19T09:16:55.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 0x7fe9181983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918102790 0x7fe918198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918106f10 0x7fe91819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe918111f70 con 0x7fe918101de0 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe918111df0 con 0x7fe918102790 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91ccf0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe9181120f0 con 0x7fe918106f10 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 0x7fe9181983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 0x7fe9181983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48826/0 (socket says 172.21.15.46:48826) 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 -- 172.21.15.46:0/1010438113 learned_addr learned my addr 172.21.15.46:0/1010438113 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe90dd9b640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918102790 0x7fe918198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe916d9d640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918106f10 0x7fe91819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 -- 172.21.15.46:0/1010438113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918106f10 msgr2=0x7fe91819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:55.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918106f10 0x7fe91819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 -- 172.21.15.46:0/1010438113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918102790 msgr2=0x7fe918198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918102790 0x7fe918198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.919+0000 7fe91659c640 1 -- 172.21.15.46:0/1010438113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91819d3a0 con 0x7fe918101de0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe916d9d640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918106f10 0x7fe91819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe90dd9b640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918102790 0x7fe918198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe91659c640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 0x7fe9181983f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d950 tx=0x7fe90800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe908017030 con 0x7fe918101de0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe908004020 con 0x7fe918101de0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91819d690 con 0x7fe918101de0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9080047a0 con 0x7fe918101de0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.920+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9181a4f70 con 0x7fe918101de0 2024-09-19T09:16:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.921+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9181021c0 con 0x7fe918101de0 2024-09-19T09:16:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.922+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe9080041d0 con 0x7fe918101de0 2024-09-19T09:16:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.923+0000 7fe90ffff640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9040a32d0 0x7fe9040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.923+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe9080cf9f0 con 0x7fe918101de0 2024-09-19T09:16:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.923+0000 7fe90dd9b640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9040a32d0 0x7fe9040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.923+0000 7fe90dd9b640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9040a32d0 0x7fe9040a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe900005fd0 tx=0x7fe9000094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:55.926+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe90809c760 con 0x7fe918101de0 2024-09-19T09:16:56.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.106+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe918199750 con 0x7fe918101de0 2024-09-19T09:16:56.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.107+0000 7fe90ffff640 1 -- 172.21.15.46:0/1010438113 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22245 (secure 0 0 0) 0x7fe90809c060 con 0x7fe918101de0 2024-09-19T09:16:56.108 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:56.108 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":82,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:16:24.645850+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9040a32d0 msgr2=0x7fe9040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9040a32d0 0x7fe9040a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe900005fd0 tx=0x7fe9000094d0 comp rx=0 tx=0).stop 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 msgr2=0x7fe9181983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 0x7fe9181983f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe90800d950 tx=0x7fe90800de10 comp rx=0 tx=0).stop 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 shutdown_connections 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9040a32d0 0x7fe9040a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe918106f10 0x7fe91819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:56.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe918102790 0x7fe918198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 --2- 172.21.15.46:0/1010438113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe918101de0 0x7fe9181983f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.109+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 >> 172.21.15.46:0/1010438113 conn(0x7fe9180fd8c0 msgr2=0x7fe9180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.110+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 shutdown_connections 2024-09-19T09:16:56.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:56.110+0000 7fe91ccf0640 1 -- 172.21.15.46:0/1010438113 wait complete. 2024-09-19T09:16:56.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:56 smithi046 ceph-mon[31203]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-19T09:16:56.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:56 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1010438113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:56.816 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:16:56.816 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:16:56.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:56 smithi115 ceph-mon[35055]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-19T09:16:56.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:56 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1010438113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:56 smithi099 ceph-mon[35256]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-19T09:16:57.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:56 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1010438113' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:57.077 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 -- 172.21.15.46:0/514439403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 msgr2=0x7fb29410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/514439403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb29410ea90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009ca0 tx=0x7fb28c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 -- 172.21.15.46:0/514439403 shutdown_connections 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/514439403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb29410ea90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/514439403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294102790 0x7fb2941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/514439403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294101de0 0x7fb2941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 -- 172.21.15.46:0/514439403 >> 172.21.15.46:0/514439403 conn(0x7fb2940fd8c0 msgr2=0x7fb2940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 -- 172.21.15.46:0/514439403 shutdown_connections 2024-09-19T09:16:57.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.554+0000 7fb29a4d3640 1 -- 172.21.15.46:0/514439403 wait complete. 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 Processor -- start 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 -- start start 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294101de0 0x7fb2940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294102790 0x7fb294074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb294074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb294111f70 con 0x7fb294106f10 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb294111df0 con 0x7fb294101de0 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb29a4d3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb2941120f0 con 0x7fb294102790 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb298a70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb294074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb298a70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb294074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48840/0 (socket says 172.21.15.46:48840) 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb298a70640 1 -- 172.21.15.46:0/2213553893 learned_addr learned my addr 172.21.15.46:0/2213553893 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:16:57.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.555+0000 7fb2937fe640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294102790 0x7fb294074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb293fff640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294101de0 0x7fb2940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb298a70640 1 -- 172.21.15.46:0/2213553893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294102790 msgr2=0x7fb294074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb298a70640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294102790 0x7fb294074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb298a70640 1 -- 172.21.15.46:0/2213553893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294101de0 msgr2=0x7fb2940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb298a70640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294101de0 0x7fb2940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb298a70640 1 -- 172.21.15.46:0/2213553893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2941a68b0 con 0x7fb294106f10 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb293fff640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294101de0 0x7fb2940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb298a70640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb294074f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb28c031a20 tx=0x7fb28c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c003c30 con 0x7fb294106f10 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2941a6b40 con 0x7fb294106f10 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb28c003dd0 con 0x7fb294106f10 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c02fc40 con 0x7fb294106f10 2024-09-19T09:16:57.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.556+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2941a7080 con 0x7fb294106f10 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.557+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2941021c0 con 0x7fb294106f10 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.558+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb28c004050 con 0x7fb294106f10 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.559+0000 7fb2917fa640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb27c0a32d0 0x7fb27c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.559+0000 7fb293fff640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb27c0a32d0 0x7fb27c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.559+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb28c0f0c80 con 0x7fb294106f10 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.559+0000 7fb293fff640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb27c0a32d0 0x7fb27c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb284009b50 tx=0x7fb284005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:16:57.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.563+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb28c0bdb90 con 0x7fb294106f10 2024-09-19T09:16:57.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.739+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb29410a150 con 0x7fb294106f10 2024-09-19T09:16:57.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.741+0000 7fb2917fa640 1 -- 172.21.15.46:0/2213553893 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22245 (secure 0 0 0) 0x7fb28c02fde0 con 0x7fb294106f10 2024-09-19T09:16:57.741 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:16:57.741 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":82,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:16:24.645850+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:16:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb27c0a32d0 msgr2=0x7fb27c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:57.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb27c0a32d0 0x7fb27c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb284009b50 tx=0x7fb284005f90 comp rx=0 tx=0).stop 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 msgr2=0x7fb294074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb294074f70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb28c031a20 tx=0x7fb28c031a50 comp rx=0 tx=0).stop 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 shutdown_connections 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb27c0a32d0 0x7fb27c0a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb294106f10 0x7fb294074f70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb294102790 0x7fb294074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 --2- 172.21.15.46:0/2213553893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb294101de0 0x7fb2940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 >> 172.21.15.46:0/2213553893 conn(0x7fb2940fd8c0 msgr2=0x7fb2940feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 shutdown_connections 2024-09-19T09:16:57.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:16:57.743+0000 7fb29a4d3640 1 -- 172.21.15.46:0/2213553893 wait complete. 2024-09-19T09:16:58.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:16:58.414 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:16:58.415 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:16:58.415 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:16:58.415 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:16:58.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:16:58.416 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:16:58.417 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:16:58.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:16:58.418 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:16:58.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:16:58.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:16:58.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:58 smithi046 ceph-mon[31203]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T09:16:58.768 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:16:58 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2213553893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:58.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:58 smithi115 ceph-mon[35055]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T09:16:58.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:16:58 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2213553893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:59.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:58 smithi099 ceph-mon[35256]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T09:16:59.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:16:58 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2213553893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:16:59.235 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:59.243 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:59.244 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:59.251 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:59.258 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:16:59.262 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:00.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 -- 172.21.15.46:0/1300578454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 msgr2=0x7f557010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 --2- 172.21.15.46:0/1300578454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557010ea90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5568009900 tx=0x7f556802a410 comp rx=0 tx=0).stop 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 -- 172.21.15.46:0/1300578454 shutdown_connections 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 --2- 172.21.15.46:0/1300578454 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557010ea90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 --2- 172.21.15.46:0/1300578454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5570102790 0x7f55701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 --2- 172.21.15.46:0/1300578454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570101de0 0x7f55701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 -- 172.21.15.46:0/1300578454 >> 172.21.15.46:0/1300578454 conn(0x7f55700fd8c0 msgr2=0x7f55700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 -- 172.21.15.46:0/1300578454 shutdown_connections 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.561+0000 7f55754fe640 1 -- 172.21.15.46:0/1300578454 wait complete. 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 Processor -- start 2024-09-19T09:17:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 -- start start 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5570101de0 0x7f5570198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570102790 0x7f5570198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5570111fb0 con 0x7f5570106f10 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5570111e30 con 0x7f5570101de0 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f55754fe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5570112130 con 0x7f5570102790 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f556f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f556f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557019ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43422/0 (socket says 172.21.15.46:43422) 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f556f7fe640 1 -- 172.21.15.46:0/3093468179 learned_addr learned my addr 172.21.15.46:0/3093468179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f556e7fc640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570102790 0x7f5570198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.562+0000 7f556effd640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5570101de0 0x7f5570198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f556f7fe640 1 -- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570102790 msgr2=0x7f5570198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f556f7fe640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5570102790 0x7f5570198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f556f7fe640 1 -- 172.21.15.46:0/3093468179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5570101de0 msgr2=0x7f5570198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f556f7fe640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5570101de0 0x7f5570198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f556f7fe640 1 -- 172.21.15.46:0/3093468179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557019d520 con 0x7f5570106f10 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f556f7fe640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557019ce40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5568005ab0 tx=0x7f55680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556803f030 con 0x7f5570106f10 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557019d7b0 con 0x7f5570106f10 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5568003ce0 con 0x7f5570106f10 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568035070 con 0x7f5570106f10 2024-09-19T09:17:00.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.563+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55701a50f0 con 0x7f5570106f10 2024-09-19T09:17:00.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.564+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5570062900 con 0x7f5570106f10 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.565+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5568042030 con 0x7f5570106f10 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.566+0000 7f5567fff640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f555c0a32d0 0x7f555c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.566+0000 7f556effd640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f555c0a32d0 0x7f555c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.566+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f55680f02a0 con 0x7f5570106f10 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.566+0000 7f5567fff640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] conn(0x7f555c0ac9f0 0x7f555c0aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.566+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 --> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f555c0af4c0 con 0x7f555c0ac9f0 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.566+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f55680f0780 con 0x7f5570106f10 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.567+0000 7f556effd640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f555c0a32d0 0x7f555c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5560005fd0 tx=0x7f5560009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.567+0000 7f556e7fc640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] conn(0x7f555c0ac9f0 0x7f555c0aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.567+0000 7f556e7fc640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] conn(0x7f555c0ac9f0 0x7f555c0aee10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:00.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.568+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== osd.2 v2:172.21.15.115:6800/888012303 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f555c0af4c0 con 0x7f555c0ac9f0 2024-09-19T09:17:00.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.582+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 --> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5570062d00 con 0x7f555c0ac9f0 2024-09-19T09:17:00.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.582+0000 7f5567fff640 1 -- 172.21.15.46:0/3093468179 <== osd.2 v2:172.21.15.115:6800/888012303 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5570062d00 con 0x7f555c0ac9f0 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] conn(0x7f555c0ac9f0 msgr2=0x7f555c0aee10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] conn(0x7f555c0ac9f0 0x7f555c0aee10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f555c0a32d0 msgr2=0x7f555c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f555c0a32d0 0x7f555c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5560005fd0 tx=0x7f5560009680 comp rx=0 tx=0).stop 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 msgr2=0x7f557019ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 --2- 172.21.15.46:0/3093468179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5570106f10 0x7f557019ce40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5568005ab0 tx=0x7f55680042f0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f556f7fe640 1 -- 172.21.15.46:0/3093468179 reap_dead start 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 shutdown_connections 2024-09-19T09:17:00.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 >> 172.21.15.46:0/3093468179 conn(0x7f55700fd8c0 msgr2=0x7f55700fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 shutdown_connections 2024-09-19T09:17:00.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.583+0000 7f55754fe640 1 -- 172.21.15.46:0/3093468179 wait complete. 2024-09-19T09:17:00.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:00 smithi046 ceph-mon[31203]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 -- 172.21.15.46:0/3919640215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c106a80 msgr2=0x7f759c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 --2- 172.21.15.46:0/3919640215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c106a80 0x7f759c106e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7598009930 tx=0x7f759802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 -- 172.21.15.46:0/3919640215 shutdown_connections 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 --2- 172.21.15.46:0/3919640215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f759c101420 0x7f759c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 --2- 172.21.15.46:0/3919640215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f759c100a80 0x7f759c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 --2- 172.21.15.46:0/3919640215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c106a80 0x7f759c106e60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.735+0000 7f75a3542640 1 -- 172.21.15.46:0/3919640215 >> 172.21.15.46:0/3919640215 conn(0x7f759c0fc7a0 msgr2=0x7f759c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.736+0000 7f75a3542640 1 -- 172.21.15.46:0/3919640215 shutdown_connections 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.736+0000 7f75a3542640 1 -- 172.21.15.46:0/3919640215 wait complete. 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.736+0000 7f75a3542640 1 Processor -- start 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.736+0000 7f75a3542640 1 -- start start 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f759c100a80 0x7f759c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c101420 0x7f759c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f759c106a80 0x7f759c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f759c110e80 con 0x7f759c101420 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f759c110d00 con 0x7f759c106a80 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f759c111000 con 0x7f759c100a80 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c101420 0x7f759c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c101420 0x7f759c1978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43438/0 (socket says 172.21.15.46:43438) 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 -- 172.21.15.46:0/594570244 learned_addr learned my addr 172.21.15.46:0/594570244 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a12de640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f759c100a80 0x7f759c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 -- 172.21.15.46:0/594570244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f759c100a80 msgr2=0x7f759c197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f759c100a80 0x7f759c197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a1adf640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f759c106a80 0x7f759c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 -- 172.21.15.46:0/594570244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f759c106a80 msgr2=0x7f759c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f759c106a80 0x7f759c19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 -- 172.21.15.46:0/594570244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c19c330 con 0x7f759c101420 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a0add640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c101420 0x7f759c1978c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e9f0 tx=0x7f758c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c00cd80 con 0x7f759c101420 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.737+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c19c620 con 0x7f759c101420 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.738+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f758c010910 con 0x7f759c101420 2024-09-19T09:17:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.738+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c0188f0 con 0x7f759c101420 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.738+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c1a3f00 con 0x7f759c101420 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.738+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f759c062980 con 0x7f759c101420 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.740+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f758c010ac0 con 0x7f759c101420 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.740+0000 7f75927fc640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f75880a32d0 0x7f75880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75a12de640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f75880a32d0 0x7f75880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f758c0d0460 con 0x7f759c101420 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75927fc640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] conn(0x7f75880acb20 0x7f75880aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:00.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 --> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75880af5f0 con 0x7f75880acb20 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f758c0d0940 con 0x7f759c101420 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75a1adf640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] conn(0x7f75880acb20 0x7f75880aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75a12de640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f75880a32d0 0x7f75880a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f7598005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.741+0000 7f75a1adf640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] conn(0x7f75880acb20 0x7f75880aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.742+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== osd.0 v2:172.21.15.46:6802/1945664236 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75880af5f0 con 0x7f75880acb20 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 --> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f759c062e00 con 0x7f75880acb20 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75927fc640 1 -- 172.21.15.46:0/594570244 <== osd.0 v2:172.21.15.46:6802/1945664236 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f759c062e00 con 0x7f75880acb20 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] conn(0x7f75880acb20 msgr2=0x7f75880aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] conn(0x7f75880acb20 0x7f75880aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f75880a32d0 msgr2=0x7f75880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f75880a32d0 0x7f75880a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7598000c00 tx=0x7f7598005a20 comp rx=0 tx=0).stop 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c101420 msgr2=0x7f759c1978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:00.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.756+0000 7f75a3542640 1 --2- 172.21.15.46:0/594570244 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f759c101420 0x7f759c1978c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f758c00e9f0 tx=0x7f758c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:17:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.757+0000 7f75a1adf640 1 -- 172.21.15.46:0/594570244 reap_dead start 2024-09-19T09:17:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.757+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 shutdown_connections 2024-09-19T09:17:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.757+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 >> 172.21.15.46:0/594570244 conn(0x7f759c0fc7a0 msgr2=0x7f759c0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.757+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 shutdown_connections 2024-09-19T09:17:00.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:00.757+0000 7f75a3542640 1 -- 172.21.15.46:0/594570244 wait complete. 2024-09-19T09:17:00.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:00 smithi115 ceph-mon[35055]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-19T09:17:01.023 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:00 smithi099 ceph-mon[35256]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-19T09:17:01.214 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:01.214 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:01.215 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:01.216 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 -- 172.21.15.46:0/1937985654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 msgr2=0x7fe3701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 --2- 172.21.15.46:0/1937985654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe3701021c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009900 tx=0x7fe36c02a410 comp rx=0 tx=0).stop 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 -- 172.21.15.46:0/1937985654 shutdown_connections 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 --2- 172.21.15.46:0/1937985654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe370106f10 0x7fe37010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 --2- 172.21.15.46:0/1937985654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe370102790 0x7fe3701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 --2- 172.21.15.46:0/1937985654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe3701021c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 -- 172.21.15.46:0/1937985654 >> 172.21.15.46:0/1937985654 conn(0x7fe3700fd8c0 msgr2=0x7fe3700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.694+0000 7fe378241640 1 -- 172.21.15.46:0/1937985654 shutdown_connections 2024-09-19T09:17:01.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.695+0000 7fe378241640 1 -- 172.21.15.46:0/1937985654 wait complete. 2024-09-19T09:17:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.695+0000 7fe378241640 1 Processor -- start 2024-09-19T09:17:01.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.695+0000 7fe378241640 1 -- start start 2024-09-19T09:17:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe378241640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe370198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe378241640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe370102790 0x7fe3701989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe378241640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe370106f10 0x7fe37019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe378241640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe370111f70 con 0x7fe370101de0 2024-09-19T09:17:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe378241640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe370111df0 con 0x7fe370102790 2024-09-19T09:17:01.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe378241640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe3701120f0 con 0x7fe370106f10 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe370198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe370198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43460/0 (socket says 172.21.15.46:43460) 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 -- 172.21.15.46:0/74061299 learned_addr learned my addr 172.21.15.46:0/74061299 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe3757dc640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe370102790 0x7fe3701989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe3767de640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe370106f10 0x7fe37019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 -- 172.21.15.46:0/74061299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe370106f10 msgr2=0x7fe37019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe370106f10 0x7fe37019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 -- 172.21.15.46:0/74061299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe370102790 msgr2=0x7fe3701989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe370102790 0x7fe3701989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe375fdd640 1 -- 172.21.15.46:0/74061299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37019d420 con 0x7fe370101de0 2024-09-19T09:17:01.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.696+0000 7fe3767de640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe370106f10 0x7fe37019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.697+0000 7fe375fdd640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe370198470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe36c006010 tx=0x7fe36c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:01.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.697+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c03f070 con 0x7fe370101de0 2024-09-19T09:17:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.697+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe36c03a440 con 0x7fe370101de0 2024-09-19T09:17:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.697+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37019d6b0 con 0x7fe370101de0 2024-09-19T09:17:01.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.697+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36c035050 con 0x7fe370101de0 2024-09-19T09:17:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.697+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe370074420 con 0x7fe370101de0 2024-09-19T09:17:01.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.698+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe370062980 con 0x7fe370101de0 2024-09-19T09:17:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.700+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe36c042070 con 0x7fe370101de0 2024-09-19T09:17:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe366ffd640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe35c0a3350 0x7fe35c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fe36c0f01c0 con 0x7fe370101de0 2024-09-19T09:17:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe3757dc640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe35c0a3350 0x7fe35c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe366ffd640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] conn(0x7fe35c0acba0 0x7fe35c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:01.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 --> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe36c001d30 con 0x7fe35c0acba0 2024-09-19T09:17:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe36c0f05b0 con 0x7fe370101de0 2024-09-19T09:17:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.701+0000 7fe3767de640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] conn(0x7fe35c0acba0 0x7fe35c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.702+0000 7fe3757dc640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe35c0a3350 0x7fe35c0a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe3700fdce0 tx=0x7fe36000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.702+0000 7fe3767de640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] conn(0x7fe35c0acba0 0x7fe35c0aefc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.703+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== osd.9 v2:172.21.15.46:6826/4010805716 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe36c001d30 con 0x7fe35c0acba0 2024-09-19T09:17:01.705 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.717+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 --> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe370062e00 con 0x7fe35c0acba0 2024-09-19T09:17:01.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe366ffd640 1 -- 172.21.15.46:0/74061299 <== osd.9 v2:172.21.15.46:6826/4010805716 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe370062e00 con 0x7fe35c0acba0 2024-09-19T09:17:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] conn(0x7fe35c0acba0 msgr2=0x7fe35c0aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] conn(0x7fe35c0acba0 0x7fe35c0aefc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe35c0a3350 msgr2=0x7fe35c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe35c0a3350 0x7fe35c0a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe3700fdce0 tx=0x7fe36000b390 comp rx=0 tx=0).stop 2024-09-19T09:17:01.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 msgr2=0x7fe370198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:01.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 --2- 172.21.15.46:0/74061299 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe370101de0 0x7fe370198470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe36c006010 tx=0x7fe36c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:17:01.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe3767de640 1 -- 172.21.15.46:0/74061299 reap_dead start 2024-09-19T09:17:01.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 shutdown_connections 2024-09-19T09:17:01.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 >> 172.21.15.46:0/74061299 conn(0x7fe3700fd8c0 msgr2=0x7fe3700fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:01.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 shutdown_connections 2024-09-19T09:17:01.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:01.718+0000 7fe378241640 1 -- 172.21.15.46:0/74061299 wait complete. 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 -- 172.21.15.46:0/4137554988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304106fc0 msgr2=0x7f530410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 --2- 172.21.15.46:0/4137554988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304106fc0 0x7f530410eaf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009cd0 tx=0x7f52fc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 -- 172.21.15.46:0/4137554988 shutdown_connections 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 --2- 172.21.15.46:0/4137554988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304106fc0 0x7f530410eaf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 --2- 172.21.15.46:0/4137554988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304100d20 0x7f5304106860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 --2- 172.21.15.46:0/4137554988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304100370 0x7f5304100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 -- 172.21.15.46:0/4137554988 >> 172.21.15.46:0/4137554988 conn(0x7f5304077210 msgr2=0x7f53040fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:02.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 -- 172.21.15.46:0/4137554988 shutdown_connections 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.133+0000 7f5308e5a640 1 -- 172.21.15.46:0/4137554988 wait complete. 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 Processor -- start 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 -- start start 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304100370 0x7f5304198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304100d20 0x7f5304198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304106fc0 0x7f530419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5304111fa0 con 0x7f5304100d20 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5304111e20 con 0x7f5304100370 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5308e5a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5304112120 con 0x7f5304106fc0 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304100d20 0x7f5304198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304100d20 0x7f5304198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43474/0 (socket says 172.21.15.46:43474) 2024-09-19T09:17:02.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f52fbfff640 1 -- 172.21.15.46:0/3785077933 learned_addr learned my addr 172.21.15.46:0/3785077933 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f5302d9d640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304106fc0 0x7f530419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.134+0000 7f530259c640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304100370 0x7f5304198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fbfff640 1 -- 172.21.15.46:0/3785077933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304106fc0 msgr2=0x7f530419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fbfff640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304106fc0 0x7f530419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fbfff640 1 -- 172.21.15.46:0/3785077933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304100370 msgr2=0x7f5304198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fbfff640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304100370 0x7f5304198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fbfff640 1 -- 172.21.15.46:0/3785077933 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530419d3d0 con 0x7f5304100d20 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f530259c640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304100370 0x7f5304198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fbfff640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304100d20 0x7f5304198960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c970 tx=0x7f52ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec007bb0 con 0x7f5304100d20 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52ec007d50 con 0x7f5304100d20 2024-09-19T09:17:02.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00f450 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530419d6c0 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.135+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53041a4fa0 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.136+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5304062880 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.137+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f52ec0046c0 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f52fb7fe640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32d0 0x7f52f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f530259c640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32d0 0x7f52f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f52ec0cfa50 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f52fb7fe640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] conn(0x7f52f00acb20 0x7f52f00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 --> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52ec012ec0 con 0x7f52f00acb20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f52ec0cff30 con 0x7f5304100d20 2024-09-19T09:17:02.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f5302d9d640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] conn(0x7f52f00acb20 0x7f52f00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.138+0000 7f530259c640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32d0 0x7f52f00a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52f400abe0 tx=0x7f52f400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.139+0000 7f5302d9d640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] conn(0x7f52f00acb20 0x7f52f00aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.139+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== osd.3 v2:172.21.15.46:6810/3435329392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52ec012ec0 con 0x7f52f00acb20 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.153+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 --> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5304062d00 con 0x7f52f00acb20 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.153+0000 7f52fb7fe640 1 -- 172.21.15.46:0/3785077933 <== osd.3 v2:172.21.15.46:6810/3435329392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5304062d00 con 0x7f52f00acb20 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.153+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] conn(0x7f52f00acb20 msgr2=0x7f52f00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.153+0000 7f5308e5a640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] conn(0x7f52f00acb20 0x7f52f00aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.153+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32d0 msgr2=0x7f52f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32d0 0x7f52f00a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52f400abe0 tx=0x7f52f400a5c0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304100d20 msgr2=0x7f5304198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 --2- 172.21.15.46:0/3785077933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304100d20 0x7f5304198960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c970 tx=0x7f52ec00ce30 comp rx=0 tx=0).stop 2024-09-19T09:17:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5302d9d640 1 -- 172.21.15.46:0/3785077933 reap_dead start 2024-09-19T09:17:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 shutdown_connections 2024-09-19T09:17:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 >> 172.21.15.46:0/3785077933 conn(0x7f5304077210 msgr2=0x7f53040fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 shutdown_connections 2024-09-19T09:17:02.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.154+0000 7f5308e5a640 1 -- 172.21.15.46:0/3785077933 wait complete. 2024-09-19T09:17:02.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:02 smithi046 ceph-mon[31203]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:17:02.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:02 smithi115 ceph-mon[35055]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:17:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:02 smithi099 ceph-mon[35256]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 -- 172.21.15.46:0/4123394175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 msgr2=0x7fc748103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 --2- 172.21.15.46:0/4123394175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748103120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc738009ca0 tx=0x7fc73802a950 comp rx=0 tx=0).stop 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 -- 172.21.15.46:0/4123394175 shutdown_connections 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 --2- 172.21.15.46:0/4123394175 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc74810c170 0x7fc74810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 --2- 172.21.15.46:0/4123394175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc748103660 0x7fc74810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 --2- 172.21.15.46:0/4123394175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748103120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 -- 172.21.15.46:0/4123394175 >> 172.21.15.46:0/4123394175 conn(0x7fc7480fc7a0 msgr2=0x7fc7480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 -- 172.21.15.46:0/4123394175 shutdown_connections 2024-09-19T09:17:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 -- 172.21.15.46:0/4123394175 wait complete. 2024-09-19T09:17:03.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.067+0000 7fc74d32d640 1 Processor -- start 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 -- start start 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc748103660 0x7fc7481989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc74810c170 0x7fc74819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc748111f70 con 0x7fc748102d40 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc748111df0 con 0x7fc748103660 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc74d32d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc7481120f0 con 0x7fc74810c170 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43508/0 (socket says 172.21.15.46:43508) 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 -- 172.21.15.46:0/248199582 learned_addr learned my addr 172.21.15.46:0/248199582 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc7477fe640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc74810c170 0x7fc74819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc7467fc640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc748103660 0x7fc7481989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 -- 172.21.15.46:0/248199582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc74810c170 msgr2=0x7fc74819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc74810c170 0x7fc74819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 -- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc748103660 msgr2=0x7fc7481989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc748103660 0x7fc7481989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 -- 172.21.15.46:0/248199582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc74819d440 con 0x7fc748102d40 2024-09-19T09:17:03.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.068+0000 7fc746ffd640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748198490 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc738005cc0 tx=0x7fc73802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.069+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738034040 con 0x7fc748102d40 2024-09-19T09:17:03.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.069+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc738030920 con 0x7fc748102d40 2024-09-19T09:17:03.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.069+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc74819d6d0 con 0x7fc748102d40 2024-09-19T09:17:03.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.069+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738004830 con 0x7fc748102d40 2024-09-19T09:17:03.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.069+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7481a5010 con 0x7fc748102d40 2024-09-19T09:17:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.070+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc748062900 con 0x7fc748102d40 2024-09-19T09:17:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.071+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc738037020 con 0x7fc748102d40 2024-09-19T09:17:03.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc72ffff640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc7300a3350 0x7fc7300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc7467fc640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc7300a3350 0x7fc7300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fc7380f08a0 con 0x7fc748102d40 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc72ffff640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] conn(0x7fc7300acba0 0x7fc7300aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 --> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc73800b150 con 0x7fc7300acba0 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc7380f0d80 con 0x7fc748102d40 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc7467fc640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc7300a3350 0x7fc7300a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc74810d6b0 tx=0x7fc73c005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.072+0000 7fc7477fe640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] conn(0x7fc7300acba0 0x7fc7300aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.073+0000 7fc7477fe640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] conn(0x7fc7300acba0 0x7fc7300aefc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.074+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== osd.1 v2:172.21.15.99:6800/469175428 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc73800b150 con 0x7fc7300acba0 2024-09-19T09:17:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.087+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 --> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc748062d00 con 0x7fc7300acba0 2024-09-19T09:17:03.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc72ffff640 1 -- 172.21.15.46:0/248199582 <== osd.1 v2:172.21.15.99:6800/469175428 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc748062d00 con 0x7fc7300acba0 2024-09-19T09:17:03.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] conn(0x7fc7300acba0 msgr2=0x7fc7300aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc74d32d640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] conn(0x7fc7300acba0 0x7fc7300aefc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc7300a3350 msgr2=0x7fc7300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc74d32d640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc7300a3350 0x7fc7300a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc74810d6b0 tx=0x7fc73c005f70 comp rx=0 tx=0).stop 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 msgr2=0x7fc748198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc74d32d640 1 --2- 172.21.15.46:0/248199582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc748102d40 0x7fc748198490 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc738005cc0 tx=0x7fc73802f630 comp rx=0 tx=0).stop 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.088+0000 7fc7477fe640 1 -- 172.21.15.46:0/248199582 reap_dead start 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.089+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 shutdown_connections 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.089+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 >> 172.21.15.46:0/248199582 conn(0x7fc7480fc7a0 msgr2=0x7fc7480fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.089+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 shutdown_connections 2024-09-19T09:17:03.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.089+0000 7fc74d32d640 1 -- 172.21.15.46:0/248199582 wait complete. 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 -- 172.21.15.46:0/354395883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8101de0 msgr2=0x7f80b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 --2- 172.21.15.46:0/354395883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8101de0 0x7f80b81021c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009ca0 tx=0x7f80a802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 -- 172.21.15.46:0/354395883 shutdown_connections 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 --2- 172.21.15.46:0/354395883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b8106f10 0x7f80b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 --2- 172.21.15.46:0/354395883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80b8102790 0x7f80b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 --2- 172.21.15.46:0/354395883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8101de0 0x7f80b81021c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.236+0000 7f80bdc73640 1 -- 172.21.15.46:0/354395883 >> 172.21.15.46:0/354395883 conn(0x7f80b80fd8c0 msgr2=0x7f80b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.237+0000 7f80bdc73640 1 -- 172.21.15.46:0/354395883 shutdown_connections 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.237+0000 7f80bdc73640 1 -- 172.21.15.46:0/354395883 wait complete. 2024-09-19T09:17:03.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.237+0000 7f80bdc73640 1 Processor -- start 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.237+0000 7f80bdc73640 1 -- start start 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.237+0000 7f80bdc73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b8101de0 0x7f80b81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80b8102790 0x7f80b8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8106f10 0x7f80b819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8111fe0 con 0x7f80b8106f10 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8111e60 con 0x7f80b8102790 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112160 con 0x7f80b8101de0 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8106f10 0x7f80b819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8106f10 0x7f80b819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43526/0 (socket says 172.21.15.46:43526) 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 -- 172.21.15.46:0/1820202109 learned_addr learned my addr 172.21.15.46:0/1820202109 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b77fe640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b8101de0 0x7f80b81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b6ffd640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80b8102790 0x7f80b8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 -- 172.21.15.46:0/1820202109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b8101de0 msgr2=0x7f80b81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b8101de0 0x7f80b81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 -- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80b8102790 msgr2=0x7f80b8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80b8102790 0x7f80b8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 -- 172.21.15.46:0/1820202109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b819d4a0 con 0x7f80b8106f10 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b77fe640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80b8101de0 0x7f80b81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:03.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b7fff640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8106f10 0x7f80b819cdc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c970 tx=0x7f80b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0007bb0 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b0007d50 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b819d790 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b000f450 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.238+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b81a5070 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.239+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80b8062980 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.241+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f80b0004f00 con 0x7f80b8106f10 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.241+0000 7f80b4ff9640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80a00a32d0 0x7f80a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.241+0000 7f80b77fe640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80a00a32d0 0x7f80a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.241+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f80b00cfb70 con 0x7f80b8106f10 2024-09-19T09:17:03.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.242+0000 7f80b4ff9640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] conn(0x7f80a00acb20 0x7f80a00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.242+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 --> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80b0017e70 con 0x7f80a00acb20 2024-09-19T09:17:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.242+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f80b00cff20 con 0x7f80b8106f10 2024-09-19T09:17:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.242+0000 7f80b77fe640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80a00a32d0 0x7f80a00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000f80 tx=0x7f80a8031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.242+0000 7f80b6ffd640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] conn(0x7f80a00acb20 0x7f80a00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.242+0000 7f80b6ffd640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] conn(0x7f80a00acb20 0x7f80a00aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.243+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== osd.7 v2:172.21.15.99:6816/1504821892 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80b0017e70 con 0x7f80a00acb20 2024-09-19T09:17:03.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.257+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 --> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80b8062e00 con 0x7f80a00acb20 2024-09-19T09:17:03.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80b4ff9640 1 -- 172.21.15.46:0/1820202109 <== osd.7 v2:172.21.15.99:6816/1504821892 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f80b8062e00 con 0x7f80a00acb20 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] conn(0x7f80a00acb20 msgr2=0x7f80a00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] conn(0x7f80a00acb20 0x7f80a00aef40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80a00a32d0 msgr2=0x7f80a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80a00a32d0 0x7f80a00a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000f80 tx=0x7f80a8031bb0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8106f10 msgr2=0x7f80b819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 --2- 172.21.15.46:0/1820202109 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f80b8106f10 0x7f80b819cdc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80b000c970 tx=0x7f80b000ce30 comp rx=0 tx=0).stop 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80b7fff640 1 -- 172.21.15.46:0/1820202109 reap_dead start 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 shutdown_connections 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.258+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 >> 172.21.15.46:0/1820202109 conn(0x7f80b80fd8c0 msgr2=0x7f80b80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.259+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 shutdown_connections 2024-09-19T09:17:03.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.259+0000 7f80bdc73640 1 -- 172.21.15.46:0/1820202109 wait complete. 2024-09-19T09:17:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 -- 172.21.15.46:0/2842852494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 msgr2=0x7f161010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 --2- 172.21.15.46:0/2842852494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f161010d950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1608009cd0 tx=0x7f160802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 -- 172.21.15.46:0/2842852494 shutdown_connections 2024-09-19T09:17:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 --2- 172.21.15.46:0/2842852494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f161010d950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 --2- 172.21.15.46:0/2842852494 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1610100a80 0x7f1610100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 --2- 172.21.15.46:0/2842852494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1610106a80 0x7f1610106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.733+0000 7f161744f640 1 -- 172.21.15.46:0/2842852494 >> 172.21.15.46:0/2842852494 conn(0x7f16100fc7a0 msgr2=0x7f16100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.734+0000 7f161744f640 1 -- 172.21.15.46:0/2842852494 shutdown_connections 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.734+0000 7f161744f640 1 -- 172.21.15.46:0/2842852494 wait complete. 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.734+0000 7f161744f640 1 Processor -- start 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.734+0000 7f161744f640 1 -- start start 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.734+0000 7f161744f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1610100a80 0x7f1610198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.734+0000 7f161744f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f16101988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f161744f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1610106a80 0x7f161019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f161744f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1610110ed0 con 0x7f1610101420 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f161744f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1610110d50 con 0x7f1610100a80 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f161744f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1610111050 con 0x7f1610106a80 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f16101988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f16101988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43536/0 (socket says 172.21.15.46:43536) 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 -- 172.21.15.46:0/891222465 learned_addr learned my addr 172.21.15.46:0/891222465 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16151eb640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1610100a80 0x7f1610198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16159ec640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1610106a80 0x7f161019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 -- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1610106a80 msgr2=0x7f161019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1610106a80 0x7f161019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 -- 172.21.15.46:0/891222465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1610100a80 msgr2=0x7f1610198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1610100a80 0x7f1610198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 -- 172.21.15.46:0/891222465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161019d330 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16159ec640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1610106a80 0x7f161019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16149ea640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f16101988c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f160000c920 tx=0x7f160000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600007c70 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1600007e10 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161019d620 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.735+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1600018890 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.736+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101a4f00 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.736+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1610062980 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.738+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1600018a50 con 0x7f1610101420 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.738+0000 7f16067fc640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15fc0a32d0 0x7f15fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16151eb640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15fc0a32d0 0x7f15fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f16000cff50 con 0x7f1610101420 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16067fc640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] conn(0x7f15fc0acb20 0x7f15fc0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 --> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15fc0af5f0 con 0x7f15fc0acb20 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f16000d0300 con 0x7f1610101420 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16151eb640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15fc0a32d0 0x7f15fc0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f160c00bb60 tx=0x7f160c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.739+0000 7f16159ec640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] conn(0x7f15fc0acb20 0x7f15fc0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.740+0000 7f16159ec640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] conn(0x7f15fc0acb20 0x7f15fc0aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.740+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== osd.11 v2:172.21.15.115:6824/2141739994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15fc0af5f0 con 0x7f15fc0acb20 2024-09-19T09:17:03.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.754+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 --> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1610062e00 con 0x7f15fc0acb20 2024-09-19T09:17:03.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f16067fc640 1 -- 172.21.15.46:0/891222465 <== osd.11 v2:172.21.15.115:6824/2141739994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1610062e00 con 0x7f15fc0acb20 2024-09-19T09:17:03.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] conn(0x7f15fc0acb20 msgr2=0x7f15fc0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f161744f640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] conn(0x7f15fc0acb20 0x7f15fc0aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15fc0a32d0 msgr2=0x7f15fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f161744f640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15fc0a32d0 0x7f15fc0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f160c00bb60 tx=0x7f160c00b390 comp rx=0 tx=0).stop 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 msgr2=0x7f16101988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f161744f640 1 --2- 172.21.15.46:0/891222465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1610101420 0x7f16101988c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f160000c920 tx=0x7f160000cde0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.755+0000 7f16159ec640 1 -- 172.21.15.46:0/891222465 reap_dead start 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.756+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 shutdown_connections 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.756+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 >> 172.21.15.46:0/891222465 conn(0x7f16100fc7a0 msgr2=0x7f161006a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.756+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 shutdown_connections 2024-09-19T09:17:03.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:03.756+0000 7f161744f640 1 -- 172.21.15.46:0/891222465 wait complete. 2024-09-19T09:17:04.524 INFO:teuthology.orchestra.run.smithi046.stdout:326417514518 2024-09-19T09:17:04.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:17:04.946 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:04 smithi046 ceph-mon[31203]: pgmap v299: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:17:04.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:04 smithi115 ceph-mon[35055]: pgmap v299: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:17:04.975 INFO:teuthology.orchestra.run.smithi046.stdout:270582939680 2024-09-19T09:17:04.975 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:17:05.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:04 smithi099 ceph-mon[35256]: pgmap v299: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:17:05.589 INFO:teuthology.orchestra.run.smithi046.stdout:103079215165 2024-09-19T09:17:05.590 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:17:05.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 -- 172.21.15.46:0/206641051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8934102d30 msgr2=0x7f8934103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 --2- 172.21.15.46:0/206641051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8934102d30 0x7f8934103110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8924009930 tx=0x7f892402a420 comp rx=0 tx=0).stop 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 -- 172.21.15.46:0/206641051 shutdown_connections 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 --2- 172.21.15.46:0/206641051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89341082a0 0x7f893410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 --2- 172.21.15.46:0/206641051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89341036e0 0x7f8934107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 --2- 172.21.15.46:0/206641051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8934102d30 0x7f8934103110 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 -- 172.21.15.46:0/206641051 >> 172.21.15.46:0/206641051 conn(0x7f89340fc7d0 msgr2=0x7f89340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 -- 172.21.15.46:0/206641051 shutdown_connections 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 -- 172.21.15.46:0/206641051 wait complete. 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 Processor -- start 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.955+0000 7f893af35640 1 -- start start 2024-09-19T09:17:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f893af35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8934102d30 0x7f89341a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f893af35640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89341036e0 0x7f89341a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f893af35640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89341082a0 0x7f893419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f893af35640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89341120a0 con 0x7f89341082a0 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f893af35640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8934111f20 con 0x7f89341036e0 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f893af35640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8934112220 con 0x7f8934102d30 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89341082a0 0x7f893419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89341082a0 0x7f893419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43550/0 (socket says 172.21.15.46:43550) 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 -- 172.21.15.46:0/828807055 learned_addr learned my addr 172.21.15.46:0/828807055 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f8933fff640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89341036e0 0x7f89341a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f8938cd1640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8934102d30 0x7f89341a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 -- 172.21.15.46:0/828807055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8934102d30 msgr2=0x7f89341a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8934102d30 0x7f89341a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 -- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89341036e0 msgr2=0x7f89341a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89341036e0 0x7f89341a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 -- 172.21.15.46:0/828807055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893419aeb0 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f8938cd1640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8934102d30 0x7f89341a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.956+0000 7f89394d2640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89341082a0 0x7f893419a640 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f892c00eaa0 tx=0x7f892c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.957+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c00cdb0 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.957+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892c005020 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.957+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893419b1a0 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.957+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0116b0 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.957+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341a7320 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.958+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8934062940 con 0x7f89341082a0 2024-09-19T09:17:05.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.959+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f892c005560 con 0x7f89341082a0 2024-09-19T09:17:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8931ffb640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f891c0a32d0 0x7f891c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8938cd1640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f891c0a32d0 0x7f891c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f892c0cfae0 con 0x7f89341082a0 2024-09-19T09:17:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8931ffb640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] conn(0x7f891c0acb20 0x7f891c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 --> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f892c018ec0 con 0x7f891c0acb20 2024-09-19T09:17:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f892c0d42c0 con 0x7f89341082a0 2024-09-19T09:17:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8938cd1640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f891c0a32d0 0x7f891c0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8924000c00 tx=0x7f8924005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.960+0000 7f8933fff640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] conn(0x7f891c0acb20 0x7f891c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.961+0000 7f8933fff640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] conn(0x7f891c0acb20 0x7f891c0aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.961+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== osd.4 v2:172.21.15.99:6808/3922710855 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f892c018ec0 con 0x7f891c0acb20 2024-09-19T09:17:05.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.975+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 --> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8934062dc0 con 0x7f891c0acb20 2024-09-19T09:17:05.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f8931ffb640 1 -- 172.21.15.46:0/828807055 <== osd.4 v2:172.21.15.99:6808/3922710855 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8934062dc0 con 0x7f891c0acb20 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] conn(0x7f891c0acb20 msgr2=0x7f891c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] conn(0x7f891c0acb20 0x7f891c0aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f891c0a32d0 msgr2=0x7f891c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f891c0a32d0 0x7f891c0a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8924000c00 tx=0x7f8924005a20 comp rx=0 tx=0).stop 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89341082a0 msgr2=0x7f893419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 --2- 172.21.15.46:0/828807055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89341082a0 0x7f893419a640 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f892c00eaa0 tx=0x7f892c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f89394d2640 1 -- 172.21.15.46:0/828807055 reap_dead start 2024-09-19T09:17:05.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 shutdown_connections 2024-09-19T09:17:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 >> 172.21.15.46:0/828807055 conn(0x7f89340fc7d0 msgr2=0x7f8934100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 shutdown_connections 2024-09-19T09:17:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:05.976+0000 7f893af35640 1 -- 172.21.15.46:0/828807055 wait complete. 2024-09-19T09:17:06.597 INFO:teuthology.orchestra.run.smithi046.stdout:133143986234 2024-09-19T09:17:06.597 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:17:06.889 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:06 smithi046 ceph-mon[31203]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:17:06.923 INFO:teuthology.orchestra.run.smithi046.stdout:77309411395 2024-09-19T09:17:06.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:17:06.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:06 smithi115 ceph-mon[35055]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:17:07.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:06 smithi099 ceph-mon[35256]: pgmap v300: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:17:07.870 INFO:teuthology.orchestra.run.smithi046.stdout:206158430250 2024-09-19T09:17:07.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 -- 172.21.15.46:0/1360160002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe810c170 msgr2=0x7f8fe810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 --2- 172.21.15.46:0/1360160002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe810c170 0x7f8fe810e610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009ca0 tx=0x7f8fe002a950 comp rx=0 tx=0).stop 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 -- 172.21.15.46:0/1360160002 shutdown_connections 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 --2- 172.21.15.46:0/1360160002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe810c170 0x7f8fe810e610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 --2- 172.21.15.46:0/1360160002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe8103660 0x7f8fe810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 --2- 172.21.15.46:0/1360160002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fe8102d40 0x7f8fe8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 -- 172.21.15.46:0/1360160002 >> 172.21.15.46:0/1360160002 conn(0x7f8fe80fc7a0 msgr2=0x7f8fe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:08.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 -- 172.21.15.46:0/1360160002 shutdown_connections 2024-09-19T09:17:08.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.208+0000 7f8fee723640 1 -- 172.21.15.46:0/1360160002 wait complete. 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 Processor -- start 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 -- start start 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe8102d40 0x7f8fe8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fe8103660 0x7f8fe81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe810c170 0x7f8fe819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8111fb0 con 0x7f8fe8102d40 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8111e30 con 0x7f8fe8103660 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fee723640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe8112130 con 0x7f8fe810c170 2024-09-19T09:17:08.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fe7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe8102d40 0x7f8fe8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fe7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe8102d40 0x7f8fe8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43554/0 (socket says 172.21.15.46:43554) 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.209+0000 7f8fe7fff640 1 -- 172.21.15.46:0/2703187540 learned_addr learned my addr 172.21.15.46:0/2703187540 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8feccc0640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe810c170 0x7f8fe819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe7fff640 1 -- 172.21.15.46:0/2703187540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe810c170 msgr2=0x7f8fe819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe7fff640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe810c170 0x7f8fe819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe7fff640 1 -- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fe8103660 msgr2=0x7f8fe81989b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:17:08.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe7fff640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8fe8103660 0x7f8fe81989b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe7fff640 1 -- 172.21.15.46:0/2703187540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe819d420 con 0x7f8fe8102d40 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8feccc0640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe810c170 0x7f8fe819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe7fff640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe8102d40 0x7f8fe8198470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c890 tx=0x7f8fd800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd8004220 con 0x7f8fe8102d40 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fd80043c0 con 0x7f8fe8102d40 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe819d710 con 0x7f8fe8102d40 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80049e0 con 0x7f8fe8102d40 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.210+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe81a4ff0 con 0x7f8fe8102d40 2024-09-19T09:17:08.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.211+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fe8062940 con 0x7f8fe8102d40 2024-09-19T09:17:08.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.212+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8fd80079b0 con 0x7f8fe8102d40 2024-09-19T09:17:08.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.213+0000 7f8fe57fa640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8fd00a32d0 0x7f8fd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.213+0000 7f8fe77fe640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8fd00a32d0 0x7f8fd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.213+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f8fd80cfb80 con 0x7f8fe8102d40 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.213+0000 7f8fe57fa640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] conn(0x7f8fd00acb20 0x7f8fd00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.213+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 --> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fd00af5f0 con 0x7f8fd00acb20 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.213+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f8fd80d0060 con 0x7f8fe8102d40 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.214+0000 7f8fe77fe640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8fd00a32d0 0x7f8fd00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80feda0 tx=0x7f8fdc007b20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.214+0000 7f8feccc0640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] conn(0x7f8fd00acb20 0x7f8fd00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.214+0000 7f8feccc0640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] conn(0x7f8fd00acb20 0x7f8fd00aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.215+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== osd.10 v2:172.21.15.99:6824/3505432402 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fd00af5f0 con 0x7f8fd00acb20 2024-09-19T09:17:08.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.229+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 --> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8fe8062dc0 con 0x7f8fd00acb20 2024-09-19T09:17:08.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.229+0000 7f8fe57fa640 1 -- 172.21.15.46:0/2703187540 <== osd.10 v2:172.21.15.99:6824/3505432402 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8fe8062dc0 con 0x7f8fd00acb20 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] conn(0x7f8fd00acb20 msgr2=0x7f8fd00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] conn(0x7f8fd00acb20 0x7f8fd00aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8fd00a32d0 msgr2=0x7f8fd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8fd00a32d0 0x7f8fd00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80feda0 tx=0x7f8fdc007b20 comp rx=0 tx=0).stop 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe8102d40 msgr2=0x7f8fe8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 --2- 172.21.15.46:0/2703187540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8fe8102d40 0x7f8fe8198470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c890 tx=0x7f8fd800cd50 comp rx=0 tx=0).stop 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8feccc0640 1 -- 172.21.15.46:0/2703187540 reap_dead start 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 shutdown_connections 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 >> 172.21.15.46:0/2703187540 conn(0x7f8fe80fc7a0 msgr2=0x7f8fe80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 shutdown_connections 2024-09-19T09:17:08.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:08.230+0000 7f8fee723640 1 -- 172.21.15.46:0/2703187540 wait complete. 2024-09-19T09:17:08.580 INFO:teuthology.orchestra.run.smithi046.stdout:34359738443 2024-09-19T09:17:08.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:17:08.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:08 smithi115 ceph-mon[35055]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:17:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:08 smithi046 ceph-mon[31203]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:17:09.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:08 smithi099 ceph-mon[35256]: pgmap v301: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:17:09.177 INFO:teuthology.orchestra.run.smithi046.stdout:292057776156 2024-09-19T09:17:09.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 -- 172.21.15.46:0/3919574610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea8102d30 msgr2=0x7f2ea8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 --2- 172.21.15.46:0/3919574610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea8102d30 0x7f2ea8103110 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009930 tx=0x7f2e9802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:09.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 -- 172.21.15.46:0/3919574610 shutdown_connections 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 --2- 172.21.15.46:0/3919574610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ea81082a0 0x7f2ea810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 --2- 172.21.15.46:0/3919574610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ea81036e0 0x7f2ea8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 --2- 172.21.15.46:0/3919574610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea8102d30 0x7f2ea8103110 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 -- 172.21.15.46:0/3919574610 >> 172.21.15.46:0/3919574610 conn(0x7f2ea80fc7d0 msgr2=0x7f2ea80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 -- 172.21.15.46:0/3919574610 shutdown_connections 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 -- 172.21.15.46:0/3919574610 wait complete. 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 Processor -- start 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.389+0000 7f2eae567640 1 -- start start 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eae567640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ea8102d30 0x7f2ea8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eae567640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ea81036e0 0x7f2ea8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eae567640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea81082a0 0x7f2ea8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eae567640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea81120a0 con 0x7f2ea81082a0 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eae567640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8111f20 con 0x7f2ea81036e0 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eae567640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8112220 con 0x7f2ea8102d30 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea81082a0 0x7f2ea8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea81082a0 0x7f2ea8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60070/0 (socket says 172.21.15.46:60070) 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 -- 172.21.15.46:0/3843363813 learned_addr learned my addr 172.21.15.46:0/3843363813 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2ea7fff640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ea8102d30 0x7f2ea8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2ea77fe640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ea81036e0 0x7f2ea8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 -- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ea8102d30 msgr2=0x7f2ea8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2ea8102d30 0x7f2ea8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 -- 172.21.15.46:0/3843363813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ea81036e0 msgr2=0x7f2ea8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ea81036e0 0x7f2ea8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 -- 172.21.15.46:0/3843363813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea81a6ae0 con 0x7f2ea81082a0 2024-09-19T09:17:09.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2ea77fe640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2ea81036e0 0x7f2ea8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.390+0000 7f2eacb04640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea81082a0 0x7f2ea8101410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000eaa0 tx=0x7f2ea000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.391+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000cdb0 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.391+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ea0005020 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.391+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea81a6dd0 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.391+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00116b0 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.391+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea81a7290 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.392+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ea8062900 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.393+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2ea0005560 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea57fa640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2e900a32d0 0x7f2e900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea7fff640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2e900a32d0 0x7f2e900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2ea00d0050 con 0x7f2ea81082a0 2024-09-19T09:17:09.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea57fa640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] conn(0x7f2e900acb20 0x7f2e900aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 --> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ea0014ec0 con 0x7f2e900acb20 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2ea00d0400 con 0x7f2ea81082a0 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea77fe640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] conn(0x7f2e900acb20 0x7f2e900aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.394+0000 7f2ea7fff640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2e900a32d0 0x7f2e900a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009900 tx=0x7f2e980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.395+0000 7f2ea77fe640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] conn(0x7f2e900acb20 0x7f2e900aef40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.395+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== osd.8 v2:172.21.15.115:6816/849207919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ea0014ec0 con 0x7f2e900acb20 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.409+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 --> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ea8062d80 con 0x7f2e900acb20 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.410+0000 7f2ea57fa640 1 -- 172.21.15.46:0/3843363813 <== osd.8 v2:172.21.15.115:6816/849207919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2ea8062d80 con 0x7f2e900acb20 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] conn(0x7f2e900acb20 msgr2=0x7f2e900aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] conn(0x7f2e900acb20 0x7f2e900aef40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2e900a32d0 msgr2=0x7f2e900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2e900a32d0 0x7f2e900a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009900 tx=0x7f2e980058d0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea81082a0 msgr2=0x7f2ea8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 --2- 172.21.15.46:0/3843363813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ea81082a0 0x7f2ea8101410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000eaa0 tx=0x7f2ea000ef60 comp rx=0 tx=0).stop 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eacb04640 1 -- 172.21.15.46:0/3843363813 reap_dead start 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 shutdown_connections 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.411+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 >> 172.21.15.46:0/3843363813 conn(0x7f2ea80fc7d0 msgr2=0x7f2ea8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.412+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 shutdown_connections 2024-09-19T09:17:09.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:09.412+0000 7f2eae567640 1 -- 172.21.15.46:0/3843363813 wait complete. 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 -- 172.21.15.46:0/1008682645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d5010e4f0 msgr2=0x7f6d50110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 --2- 172.21.15.46:0/1008682645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d5010e4f0 0x7f6d50110900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009ca0 tx=0x7f6d4802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 -- 172.21.15.46:0/1008682645 shutdown_connections 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 --2- 172.21.15.46:0/1008682645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d5010e4f0 0x7f6d50110900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 --2- 172.21.15.46:0/1008682645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d50101380 0x7f6d5010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 --2- 172.21.15.46:0/1008682645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d501009d0 0x7f6d50100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 -- 172.21.15.46:0/1008682645 >> 172.21.15.46:0/1008682645 conn(0x7f6d500fc7d0 msgr2=0x7f6d500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 -- 172.21.15.46:0/1008682645 shutdown_connections 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.977+0000 7f6d5693b640 1 -- 172.21.15.46:0/1008682645 wait complete. 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 Processor -- start 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 -- start start 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d501009d0 0x7f6d5019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50101380 0x7f6d5019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d5010e4f0 0x7f6d5019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6d50114230 con 0x7f6d50101380 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6d501140b0 con 0x7f6d5010e4f0 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d5693b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6d501143b0 con 0x7f6d501009d0 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50101380 0x7f6d5019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d47fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50101380 0x7f6d5019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43488/0 (socket says 172.21.15.46:43488) 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.978+0000 7f6d47fff640 1 -- 172.21.15.46:0/2554940136 learned_addr learned my addr 172.21.15.46:0/2554940136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d4ffff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d501009d0 0x7f6d5019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d54ed8640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d5010e4f0 0x7f6d5019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d47fff640 1 -- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d501009d0 msgr2=0x7f6d5019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d47fff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d501009d0 0x7f6d5019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d47fff640 1 -- 172.21.15.46:0/2554940136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d5010e4f0 msgr2=0x7f6d5019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d47fff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d5010e4f0 0x7f6d5019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d47fff640 1 -- 172.21.15.46:0/2554940136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5019f6a0 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d4ffff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6d501009d0 0x7f6d5019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d47fff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50101380 0x7f6d5019ac30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e9f0 tx=0x7f6d3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800cd80 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d38010910 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5019f990 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38018990 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.979+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d501a7270 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.980+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d50062980 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.982+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6d38010ac0 con 0x7f6d50101380 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.982+0000 7f6d4dffb640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6d3c0a32d0 0x7f6d3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.982+0000 7f6d4ffff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6d3c0a32d0 0x7f6d3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.982+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f6d380d0460 con 0x7f6d50101380 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.983+0000 7f6d4dffb640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] conn(0x7f6d3c0acb20 0x7f6d3c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.983+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 --> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d38010760 con 0x7f6d3c0acb20 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.983+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6d380d0810 con 0x7f6d50101380 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.983+0000 7f6d4ffff640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6d3c0a32d0 0x7f6d3c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6d40005fd0 tx=0x7f6d4000b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.983+0000 7f6d54ed8640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] conn(0x7f6d3c0acb20 0x7f6d3c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.983+0000 7f6d54ed8640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] conn(0x7f6d3c0acb20 0x7f6d3c0aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.984+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== osd.5 v2:172.21.15.115:6808/1551008641 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d38010760 con 0x7f6d3c0acb20 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.998+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 --> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6d50062d80 con 0x7f6d3c0acb20 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.998+0000 7f6d4dffb640 1 -- 172.21.15.46:0/2554940136 <== osd.5 v2:172.21.15.115:6808/1551008641 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6d50062d80 con 0x7f6d3c0acb20 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] conn(0x7f6d3c0acb20 msgr2=0x7f6d3c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] conn(0x7f6d3c0acb20 0x7f6d3c0aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6d3c0a32d0 msgr2=0x7f6d3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6d3c0a32d0 0x7f6d3c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6d40005fd0 tx=0x7f6d4000b5f0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50101380 msgr2=0x7f6d5019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 --2- 172.21.15.46:0/2554940136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d50101380 0x7f6d5019ac30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800e9f0 tx=0x7f6d3800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d54ed8640 1 -- 172.21.15.46:0/2554940136 reap_dead start 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 shutdown_connections 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 >> 172.21.15.46:0/2554940136 conn(0x7f6d500fc7d0 msgr2=0x7f6d500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 shutdown_connections 2024-09-19T09:17:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:02.999+0000 7f6d5693b640 1 -- 172.21.15.46:0/2554940136 wait complete. 2024-09-19T09:17:10.592 INFO:teuthology.orchestra.run.smithi046.stdout:236223201318 2024-09-19T09:17:10.593 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:17:10.702 INFO:teuthology.orchestra.run.smithi046.stdout:154618822708 2024-09-19T09:17:10.703 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:17:10.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:10 smithi115 ceph-mon[35055]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T09:17:10.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:10 smithi046 ceph-mon[31203]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T09:17:11.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:10 smithi099 ceph-mon[35256]: pgmap v302: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T09:17:11.397 INFO:teuthology.orchestra.run.smithi046.stdout:55834574920 2024-09-19T09:17:11.398 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:17:11.466 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 -- 172.21.15.46:0/3771175480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8160102d30 msgr2=0x7f8160103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 --2- 172.21.15.46:0/3771175480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8160102d30 0x7f8160103110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f815c009930 tx=0x7f815c02a420 comp rx=0 tx=0).stop 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 -- 172.21.15.46:0/3771175480 shutdown_connections 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 --2- 172.21.15.46:0/3771175480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81601082a0 0x7f816010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 --2- 172.21.15.46:0/3771175480 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81601036e0 0x7f8160107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 --2- 172.21.15.46:0/3771175480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8160102d30 0x7f8160103110 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 -- 172.21.15.46:0/3771175480 >> 172.21.15.46:0/3771175480 conn(0x7f81600fc7d0 msgr2=0x7f81600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:12.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 -- 172.21.15.46:0/3771175480 shutdown_connections 2024-09-19T09:17:12.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.998+0000 7f81681d0640 1 -- 172.21.15.46:0/3771175480 wait complete. 2024-09-19T09:17:12.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 Processor -- start 2024-09-19T09:17:12.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 -- start start 2024-09-19T09:17:12.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8160102d30 0x7f81601985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81601036e0 0x7f8160198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81601082a0 0x7f816019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f81601120a0 con 0x7f81601082a0 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8160111f20 con 0x7f8160102d30 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f81681d0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8160112220 con 0x7f81601036e0 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f816676d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81601082a0 0x7f816019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f816676d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81601082a0 0x7f816019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60094/0 (socket says 172.21.15.46:60094) 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:11.999+0000 7f8165f6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8160102d30 0x7f81601985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 -- 172.21.15.46:0/2331688687 learned_addr learned my addr 172.21.15.46:0/2331688687 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816576b640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81601036e0 0x7f8160198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 -- 172.21.15.46:0/2331688687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81601036e0 msgr2=0x7f8160198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:12.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81601036e0 0x7f8160198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 -- 172.21.15.46:0/2331688687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8160102d30 msgr2=0x7f81601985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8160102d30 0x7f81601985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 -- 172.21.15.46:0/2331688687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816019d5a0 con 0x7f81601082a0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f816676d640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81601082a0 0x7f816019cec0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8158009fd0 tx=0x7f815800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158017070 con 0x7f81601082a0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816019d890 con 0x7f81601082a0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8158003e50 con 0x7f81601082a0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81580106c0 con 0x7f81601082a0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.000+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a5170 con 0x7f81601082a0 2024-09-19T09:17:12.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.001+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8160062980 con 0x7f81601082a0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.002+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8158003970 con 0x7f81601082a0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f8156ffd640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f814c0a32d0 0x7f814c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f8165f6c640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f814c0a32d0 0x7f814c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f81580cf960 con 0x7f81601082a0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f8156ffd640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] conn(0x7f814c0acb20 0x7f814c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 --> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f815801de50 con 0x7f814c0acb20 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f81580cfe40 con 0x7f81601082a0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.003+0000 7f816576b640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] conn(0x7f814c0acb20 0x7f814c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.004+0000 7f8165f6c640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f814c0a32d0 0x7f814c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f815c009900 tx=0x7f815c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:12.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.004+0000 7f816576b640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] conn(0x7f814c0acb20 0x7f814c0aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:12.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.004+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== osd.6 v2:172.21.15.46:6818/2376082017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f815801de50 con 0x7f814c0acb20 2024-09-19T09:17:12.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.018+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 --> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8160062e00 con 0x7f814c0acb20 2024-09-19T09:17:12.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.018+0000 7f8156ffd640 1 -- 172.21.15.46:0/2331688687 <== osd.6 v2:172.21.15.46:6818/2376082017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8160062e00 con 0x7f814c0acb20 2024-09-19T09:17:12.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] conn(0x7f814c0acb20 msgr2=0x7f814c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] conn(0x7f814c0acb20 0x7f814c0aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f814c0a32d0 msgr2=0x7f814c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f814c0a32d0 0x7f814c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f815c009900 tx=0x7f815c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81601082a0 msgr2=0x7f816019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 --2- 172.21.15.46:0/2331688687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81601082a0 0x7f816019cec0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8158009fd0 tx=0x7f815800b260 comp rx=0 tx=0).stop 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f816676d640 1 -- 172.21.15.46:0/2331688687 reap_dead start 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 shutdown_connections 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 >> 172.21.15.46:0/2331688687 conn(0x7f81600fc7d0 msgr2=0x7f8160105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 shutdown_connections 2024-09-19T09:17:12.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:12.019+0000 7f81681d0640 1 -- 172.21.15.46:0/2331688687 wait complete. 2024-09-19T09:17:12.283 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.284 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.291 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.292 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.295 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.299 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.729 INFO:teuthology.orchestra.run.smithi046.stdout:184683593776 2024-09-19T09:17:12.730 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:17:12.766 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.768 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:12.868 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:12 smithi046 ceph-mon[31203]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T09:17:12.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:12 smithi115 ceph-mon[35055]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T09:17:13.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:12 smithi099 ceph-mon[35256]: pgmap v303: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T09:17:13.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 -- 172.21.15.46:0/373377423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 msgr2=0x7f36a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 --2- 172.21.15.46:0/373377423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a810ea90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009900 tx=0x7f36a002a410 comp rx=0 tx=0).stop 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 -- 172.21.15.46:0/373377423 shutdown_connections 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 --2- 172.21.15.46:0/373377423 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a810ea90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 --2- 172.21.15.46:0/373377423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36a8102790 0x7f36a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 --2- 172.21.15.46:0/373377423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a8101de0 0x7f36a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 -- 172.21.15.46:0/373377423 >> 172.21.15.46:0/373377423 conn(0x7f36a80fd8c0 msgr2=0x7f36a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 -- 172.21.15.46:0/373377423 shutdown_connections 2024-09-19T09:17:13.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.440+0000 7f36af5c3640 1 -- 172.21.15.46:0/373377423 wait complete. 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 Processor -- start 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 -- start start 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a8101de0 0x7f36a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36a8102790 0x7f36a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8112010 con 0x7f36a8106f10 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8111e90 con 0x7f36a8102790 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36af5c3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f36a8112190 con 0x7f36a8101de0 2024-09-19T09:17:13.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60116/0 (socket says 172.21.15.46:60116) 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 -- 172.21.15.46:0/2589475112 learned_addr learned my addr 172.21.15.46:0/2589475112 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36acb5e640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36a8102790 0x7f36a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36ad35f640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a8101de0 0x7f36a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 -- 172.21.15.46:0/2589475112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a8101de0 msgr2=0x7f36a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a8101de0 0x7f36a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 -- 172.21.15.46:0/2589475112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36a8102790 msgr2=0x7f36a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.441+0000 7f36adb60640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36a8102790 0x7f36a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36adb60640 1 -- 172.21.15.46:0/2589475112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a81a6a30 con 0x7f36a8106f10 2024-09-19T09:17:13.642 INFO:teuthology.orchestra.run.smithi046.stdout:206158430252 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36adb60640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a8074f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009230 tx=0x7f36a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a003f030 con 0x7f36a8106f10 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a0003ce0 con 0x7f36a8106f10 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a81a6cc0 con 0x7f36a8106f10 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a0035070 con 0x7f36a8106f10 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.442+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a81a71a0 con 0x7f36a8106f10 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.443+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a8102240 con 0x7f36a8106f10 2024-09-19T09:17:13.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.444+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f36a0042030 con 0x7f36a8106f10 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.445+0000 7f36a67fc640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f36900a32d0 0x7f36900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.445+0000 7f36ad35f640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f36900a32d0 0x7f36900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.445+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f36a00f01b0 con 0x7f36a8106f10 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.446+0000 7f36ad35f640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f36900a32d0 0x7f36900a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3698009f20 tx=0x7f36980094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.449+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f36a00bcf20 con 0x7f36a8106f10 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.636+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f36a810a0f0 con 0x7f36a8106f10 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.636+0000 7f36a67fc640 1 -- 172.21.15.46:0/2589475112 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f36a00bc820 con 0x7f36a8106f10 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f36900a32d0 msgr2=0x7f36900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:13.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f36900a32d0 0x7f36900a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3698009f20 tx=0x7f36980094f0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 msgr2=0x7f36a8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a8074f70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009230 tx=0x7f36a00042f0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 shutdown_connections 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f36900a32d0 0x7f36900a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36a8106f10 0x7f36a8074f70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36a8102790 0x7f36a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.638+0000 7f36af5c3640 1 --2- 172.21.15.46:0/2589475112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a8101de0 0x7f36a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.639+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 >> 172.21.15.46:0/2589475112 conn(0x7f36a80fd8c0 msgr2=0x7f36a80fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.639+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 shutdown_connections 2024-09-19T09:17:13.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:13.639+0000 7f36af5c3640 1 -- 172.21.15.46:0/2589475112 wait complete. 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 -- 172.21.15.46:0/3436936790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 msgr2=0x7f433810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 --2- 172.21.15.46:0/3436936790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433810ec40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4330009cd0 tx=0x7f433002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 -- 172.21.15.46:0/3436936790 shutdown_connections 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 --2- 172.21.15.46:0/3436936790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433810ec40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 --2- 172.21.15.46:0/3436936790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43381036e0 0x7f4338107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 --2- 172.21.15.46:0/3436936790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4338102d30 0x7f4338103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 -- 172.21.15.46:0/3436936790 >> 172.21.15.46:0/3436936790 conn(0x7f43380fc7d0 msgr2=0x7f43380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 -- 172.21.15.46:0/3436936790 shutdown_connections 2024-09-19T09:17:14.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.768+0000 7f433e9b3640 1 -- 172.21.15.46:0/3436936790 wait complete. 2024-09-19T09:17:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.769+0000 7f433e9b3640 1 Processor -- start 2024-09-19T09:17:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.769+0000 7f433e9b3640 1 -- start start 2024-09-19T09:17:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.769+0000 7f433e9b3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4338102d30 0x7f4338198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.769+0000 7f433e9b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43381036e0 0x7f4338198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.769+0000 7f433e9b3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433e9b3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f43381120a0 con 0x7f43381082a0 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433e9b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4338111f20 con 0x7f43381036e0 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433e9b3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4338112220 con 0x7f4338102d30 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60146/0 (socket says 172.21.15.46:60146) 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 -- 172.21.15.46:0/2754525747 learned_addr learned my addr 172.21.15.46:0/2754525747 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f4337fff640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4338102d30 0x7f4338198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f43377fe640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43381036e0 0x7f4338198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 -- 172.21.15.46:0/2754525747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4338102d30 msgr2=0x7f4338198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4338102d30 0x7f4338198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 -- 172.21.15.46:0/2754525747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43381036e0 msgr2=0x7f4338198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43381036e0 0x7f4338198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 -- 172.21.15.46:0/2754525747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433819d510 con 0x7f43381082a0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433cf50640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433819ce30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4330005cc0 tx=0x7f43300093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330003e00 con 0x7f43381082a0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4330004520 con 0x7f43381082a0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433819d7a0 con 0x7f43381082a0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.770+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4330030db0 con 0x7f43381082a0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.771+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43381a50e0 con 0x7f43381082a0 2024-09-19T09:17:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.772+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4338103110 con 0x7f43381082a0 2024-09-19T09:17:14.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.773+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f43300046d0 con 0x7f43381082a0 2024-09-19T09:17:14.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.774+0000 7f43357fa640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f43200a3350 0x7f43200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.774+0000 7f4337fff640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f43200a3350 0x7f43200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.774+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f433002e030 con 0x7f43381082a0 2024-09-19T09:17:14.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.774+0000 7f4337fff640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f43200a3350 0x7f43200a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4328009bd0 tx=0x7f4328005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:14.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.778+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f433004b060 con 0x7f43381082a0 2024-09-19T09:17:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 -- 172.21.15.46:0/1638034857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834100a80 msgr2=0x7f8834100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 --2- 172.21.15.46:0/1638034857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834100a80 0x7f8834100ee0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8828009930 tx=0x7f882802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 -- 172.21.15.46:0/1638034857 shutdown_connections 2024-09-19T09:17:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 --2- 172.21.15.46:0/1638034857 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834100a80 0x7f8834100ee0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 --2- 172.21.15.46:0/1638034857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8834101420 0x7f883410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 --2- 172.21.15.46:0/1638034857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 0x7f8834106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 -- 172.21.15.46:0/1638034857 >> 172.21.15.46:0/1638034857 conn(0x7f88340fc7a0 msgr2=0x7f88340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 -- 172.21.15.46:0/1638034857 shutdown_connections 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.673+0000 7f8838890640 1 -- 172.21.15.46:0/1638034857 wait complete. 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 Processor -- start 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 -- start start 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8834100a80 0x7f88341a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 0x7f88341a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 0x7f883419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8834110f20 con 0x7f8834101420 2024-09-19T09:17:14.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8834110da0 con 0x7f8834106a80 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8838890640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f88341110a0 con 0x7f8834100a80 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8831d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 0x7f88341a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8831d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 0x7f88341a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60128/0 (socket says 172.21.15.46:60128) 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.674+0000 7f8831d9b640 1 -- 172.21.15.46:0/765681532 learned_addr learned my addr 172.21.15.46:0/765681532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8832d9d640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 0x7f883419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f883259c640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8834100a80 0x7f88341a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8831d9b640 1 -- 172.21.15.46:0/765681532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8834100a80 msgr2=0x7f88341a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8831d9b640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8834100a80 0x7f88341a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8831d9b640 1 -- 172.21.15.46:0/765681532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 msgr2=0x7f883419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8831d9b640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 0x7f883419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8831d9b640 1 -- 172.21.15.46:0/765681532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883419ad30 con 0x7f8834101420 2024-09-19T09:17:14.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8832d9d640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 0x7f883419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8831d9b640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 0x7f88341a0980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8828009a50 tx=0x7f8828004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882803f030 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883419afc0 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8828003ce0 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88341a7310 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.675+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828035070 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.676+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8834100f60 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.677+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8828042030 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.678+0000 7f88237fe640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f881c0a32d0 0x7f881c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.678+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f88280efe10 con 0x7f8834101420 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.678+0000 7f883259c640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f881c0a32d0 0x7f881c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:14.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.679+0000 7f883259c640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f881c0a32d0 0x7f881c0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8824009890 tx=0x7f8824008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.683+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8828049030 con 0x7f8834101420 2024-09-19T09:17:14.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:14 smithi046 ceph-mon[31203]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T09:17:14.871 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:14 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2589475112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:17:14.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.879+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f88341a7540 con 0x7f8834101420 2024-09-19T09:17:14.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.879+0000 7f88237fe640 1 -- 172.21.15.46:0/765681532 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88280bcb80 con 0x7f8834101420 2024-09-19T09:17:14.880 INFO:teuthology.orchestra.run.smithi046.stdout:77309411397 2024-09-19T09:17:14.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f881c0a32d0 msgr2=0x7f881c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f881c0a32d0 0x7f881c0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8824009890 tx=0x7f8824008040 comp rx=0 tx=0).stop 2024-09-19T09:17:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 msgr2=0x7f88341a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 0x7f88341a0980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8828009a50 tx=0x7f8828004270 comp rx=0 tx=0).stop 2024-09-19T09:17:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 shutdown_connections 2024-09-19T09:17:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f881c0a32d0 0x7f881c0a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8834101420 0x7f88341a0980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8834106a80 0x7f883419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 --2- 172.21.15.46:0/765681532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8834100a80 0x7f88341a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 >> 172.21.15.46:0/765681532 conn(0x7f88340fc7a0 msgr2=0x7f883406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 shutdown_connections 2024-09-19T09:17:14.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.881+0000 7f8838890640 1 -- 172.21.15.46:0/765681532 wait complete. 2024-09-19T09:17:14.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:14 smithi115 ceph-mon[35055]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T09:17:14.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:14 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2589475112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:17:14.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.961+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f433810a2b0 con 0x7f43381082a0 2024-09-19T09:17:14.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.962+0000 7f43357fa640 1 -- 172.21.15.46:0/2754525747 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f43300bdcf0 con 0x7f43381082a0 2024-09-19T09:17:14.962 INFO:teuthology.orchestra.run.smithi046.stdout:292057776157 2024-09-19T09:17:14.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f43200a3350 msgr2=0x7f43200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f43200a3350 0x7f43200a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4328009bd0 tx=0x7f4328005f90 comp rx=0 tx=0).stop 2024-09-19T09:17:14.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 msgr2=0x7f433819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:14.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433819ce30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4330005cc0 tx=0x7f43300093d0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 shutdown_connections 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f43200a3350 0x7f43200a5810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f43381082a0 0x7f433819ce30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43381036e0 0x7f4338198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 --2- 172.21.15.46:0/2754525747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4338102d30 0x7f4338198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 >> 172.21.15.46:0/2754525747 conn(0x7f43380fc7d0 msgr2=0x7f4338105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 shutdown_connections 2024-09-19T09:17:14.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:14.964+0000 7f433e9b3640 1 -- 172.21.15.46:0/2754525747 wait complete. 2024-09-19T09:17:15.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:14 smithi099 ceph-mon[35256]: pgmap v304: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T09:17:15.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:14 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2589475112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:17:15.527 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411397 for osd.2 2024-09-19T09:17:15.528 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:15.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/765681532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:17:15.793 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2754525747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:17:15.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/765681532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:17:15.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2754525747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:17:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/765681532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:17:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2754525747' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:17:16.054 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776156 got 292057776157 for osd.10 2024-09-19T09:17:16.054 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.303+0000 7f30109fa640 1 -- 172.21.15.46:0/2460168123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 msgr2=0x7f300c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.303+0000 7f30109fa640 1 --2- 172.21.15.46:0/2460168123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c1029b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009900 tx=0x7f2ff402a480 comp rx=0 tx=0).stop 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 -- 172.21.15.46:0/2460168123 shutdown_connections 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 --2- 172.21.15.46:0/2460168123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c1029b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 --2- 172.21.15.46:0/2460168123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c102ef0 0x7f300c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 --2- 172.21.15.46:0/2460168123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f300c100e20 0x7f300c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 -- 172.21.15.46:0/2460168123 >> 172.21.15.46:0/2460168123 conn(0x7f300c0fc7d0 msgr2=0x7f300c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 -- 172.21.15.46:0/2460168123 shutdown_connections 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 -- 172.21.15.46:0/2460168123 wait complete. 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 Processor -- start 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.304+0000 7f30109fa640 1 -- start start 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f30109fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c100e20 0x7f300c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f30109fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f30109fa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f300c102ef0 0x7f300c1a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f30109fa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f300c110f80 con 0x7f300c102570 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f30109fa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f300c110e00 con 0x7f300c100e20 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f30109fa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f300c111100 con 0x7f300c102ef0 2024-09-19T09:17:16.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60182/0 (socket says 172.21.15.46:60182) 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 -- 172.21.15.46:0/3601999906 learned_addr learned my addr 172.21.15.46:0/3601999906 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f300a59c640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c100e20 0x7f300c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f300ad9d640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f300c102ef0 0x7f300c1a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 -- 172.21.15.46:0/3601999906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f300c102ef0 msgr2=0x7f300c1a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f300c102ef0 0x7f300c1a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 -- 172.21.15.46:0/3601999906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c100e20 msgr2=0x7f300c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c100e20 0x7f300c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 -- 172.21.15.46:0/3601999906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300c1a49a0 con 0x7f300c102570 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.305+0000 7f3009d9b640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c199920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4006010 tx=0x7f2ff4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:16.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.306+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff403f070 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.306+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff4031c30 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.306+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4035030 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.306+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300c1a4b70 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.306+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300c1a5020 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.307+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300c101200 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.308+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2ff4042070 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.309+0000 7f30037fe640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff80a3350 0x7f2ff80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.309+0000 7f300a59c640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff80a3350 0x7f2ff80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.309+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f2ff40f0510 con 0x7f300c102570 2024-09-19T09:17:16.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.310+0000 7f300a59c640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff80a3350 0x7f2ff80a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc005fd0 tx=0x7f2ffc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:16.554 INFO:teuthology.orchestra.run.smithi046.stdout:55834574922 2024-09-19T09:17:16.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.313+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ff4031de0 con 0x7f300c102570 2024-09-19T09:17:16.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f300c109090 con 0x7f300c102570 2024-09-19T09:17:16.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30037fe640 1 -- 172.21.15.46:0/3601999906 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ff40bcc70 con 0x7f300c102570 2024-09-19T09:17:16.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff80a3350 msgr2=0x7f2ff80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:16.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff80a3350 0x7f2ff80a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc005fd0 tx=0x7f2ffc009680 comp rx=0 tx=0).stop 2024-09-19T09:17:16.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 msgr2=0x7f300c199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:16.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c199920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4006010 tx=0x7f2ff4003c10 comp rx=0 tx=0).stop 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 shutdown_connections 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2ff80a3350 0x7f2ff80a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f300c102570 0x7f300c199920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f300c102ef0 0x7f300c1a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 --2- 172.21.15.46:0/3601999906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f300c100e20 0x7f300c1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 >> 172.21.15.46:0/3601999906 conn(0x7f300c0fc7d0 msgr2=0x7f300c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:16.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 shutdown_connections 2024-09-19T09:17:16.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.496+0000 7f30109fa640 1 -- 172.21.15.46:0/3601999906 wait complete. 2024-09-19T09:17:16.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:16 smithi115 ceph-mon[35055]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:17:16.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:16 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2939101752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:17:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:16 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3601999906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:17:16.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:16 smithi046 ceph-mon[31203]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:17:16.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:16 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2939101752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:17:16.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:16 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3601999906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:17:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:16 smithi099 ceph-mon[35256]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:17:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:16 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2939101752' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:17:17.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:16 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3601999906' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:17:17.377 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574922 for osd.1 2024-09-19T09:17:17.377 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 -- 172.21.15.46:0/998482394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318100e20 msgr2=0x7fb318101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:17.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 --2- 172.21.15.46:0/998482394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318100e20 0x7fb318101200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb308009ca0 tx=0x7fb30802a950 comp rx=0 tx=0).stop 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 -- 172.21.15.46:0/998482394 shutdown_connections 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 --2- 172.21.15.46:0/998482394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb318102ef0 0x7fb31810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 --2- 172.21.15.46:0/998482394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 0x7fb3181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 --2- 172.21.15.46:0/998482394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318100e20 0x7fb318101200 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.894+0000 7fb31fff6640 1 -- 172.21.15.46:0/998482394 >> 172.21.15.46:0/998482394 conn(0x7fb3180fc7d0 msgr2=0x7fb3180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.895+0000 7fb31fff6640 1 -- 172.21.15.46:0/998482394 shutdown_connections 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.895+0000 7fb31fff6640 1 -- 172.21.15.46:0/998482394 wait complete. 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.895+0000 7fb31fff6640 1 Processor -- start 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.895+0000 7fb31fff6640 1 -- start start 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb318100e20 0x7fb318103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 0x7fb318103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 0x7fb3181041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:17.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb318110f80 con 0x7fb318102ef0 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb318110e00 con 0x7fb318102570 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb318111100 con 0x7fb318100e20 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 0x7fb3181041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 0x7fb3181041d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60202/0 (socket says 172.21.15.46:60202) 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 -- 172.21.15.46:0/423758161 learned_addr learned my addr 172.21.15.46:0/423758161 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31d591640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 0x7fb318103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31dd92640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb318100e20 0x7fb318103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 -- 172.21.15.46:0/423758161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb318100e20 msgr2=0x7fb318103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb318100e20 0x7fb318103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 -- 172.21.15.46:0/423758161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 msgr2=0x7fb318103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 0x7fb318103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:17.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 -- 172.21.15.46:0/423758161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3181a6a00 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31d591640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 0x7fb318103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31e593640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 0x7fb3181041d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb31000d950 tx=0x7fb31000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310017030 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3181a6cf0 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.896+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb310004020 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.897+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310003c00 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.897+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3181a71e0 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.898+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb318101200 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.899+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb31001a070 con 0x7fb318102ef0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.900+0000 7fb316ffd640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb3000a32d0 0x7fb3000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.900+0000 7fb31dd92640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb3000a32d0 0x7fb3000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:17.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.900+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fb3100cf540 con 0x7fb318102ef0 2024-09-19T09:17:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.900+0000 7fb31dd92640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb3000a32d0 0x7fb3000a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb308005fc0 tx=0x7fb308009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:17.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.906+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb31009c230 con 0x7fb318102ef0 2024-09-19T09:17:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.088+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb318104c80 con 0x7fb318102ef0 2024-09-19T09:17:18.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.088+0000 7fb316ffd640 1 -- 172.21.15.46:0/423758161 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb318104c80 con 0x7fb318102ef0 2024-09-19T09:17:18.089 INFO:teuthology.orchestra.run.smithi046.stdout:133143986236 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb3000a32d0 msgr2=0x7fb3000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb3000a32d0 0x7fb3000a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb308005fc0 tx=0x7fb308009360 comp rx=0 tx=0).stop 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 msgr2=0x7fb3181041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 0x7fb3181041d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb31000d950 tx=0x7fb31000de10 comp rx=0 tx=0).stop 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 shutdown_connections 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb3000a32d0 0x7fb3000a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318102ef0 0x7fb3181041d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb318102570 0x7fb318103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 --2- 172.21.15.46:0/423758161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb318100e20 0x7fb318103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 >> 172.21.15.46:0/423758161 conn(0x7fb3180fc7d0 msgr2=0x7fb31806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 shutdown_connections 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.091+0000 7fb31fff6640 1 -- 172.21.15.46:0/423758161 wait complete. 2024-09-19T09:17:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 -- 172.21.15.46:0/126823740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944103660 msgr2=0x7f794410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 --2- 172.21.15.46:0/126823740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944103660 0x7f794410bb50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7938009ca0 tx=0x7f793802a950 comp rx=0 tx=0).stop 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 -- 172.21.15.46:0/126823740 shutdown_connections 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 --2- 172.21.15.46:0/126823740 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7944103660 0x7f794410bb50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 --2- 172.21.15.46:0/126823740 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f794410c170 0x7f794410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 --2- 172.21.15.46:0/126823740 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7944102d40 0x7f7944103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 -- 172.21.15.46:0/126823740 >> 172.21.15.46:0/126823740 conn(0x7f79440fc7a0 msgr2=0x7f79440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 -- 172.21.15.46:0/126823740 shutdown_connections 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.198+0000 7f7949056640 1 -- 172.21.15.46:0/126823740 wait complete. 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.199+0000 7f7949056640 1 Processor -- start 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.199+0000 7f7949056640 1 -- start start 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.199+0000 7f7949056640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7944102d40 0x7f79441984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.199+0000 7f7949056640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944103660 0x7f79441989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f7949056640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 0x7f794419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f7949056640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7944111fc0 con 0x7f794410c170 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f7949056640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7944111e40 con 0x7f7944102d40 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f7949056640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7944112140 con 0x7f7944103660 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 0x7f794419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 0x7f794419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60162/0 (socket says 172.21.15.46:60162) 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 -- 172.21.15.46:0/2939101752 learned_addr learned my addr 172.21.15.46:0/2939101752 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794259c640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944103660 0x7f79441989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f7942d9d640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7944102d40 0x7f79441984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 -- 172.21.15.46:0/2939101752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944103660 msgr2=0x7f79441989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944103660 0x7f79441989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 -- 172.21.15.46:0/2939101752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7944102d40 msgr2=0x7f79441984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7944102d40 0x7f79441984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 -- 172.21.15.46:0/2939101752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794419d450 con 0x7f794410c170 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f794359e640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 0x7f794419cd70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c970 tx=0x7f793c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c007bb0 con 0x7f794410c170 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.200+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f793c007d50 con 0x7f794410c170 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.201+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794419d740 con 0x7f794410c170 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.201+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c00f450 con 0x7f794410c170 2024-09-19T09:17:18.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.201+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79441a5020 con 0x7f794410c170 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.201+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7944103120 con 0x7f794410c170 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.203+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f793c004f00 con 0x7f794410c170 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.203+0000 7f792bfff640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f792c0a3350 0x7f792c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.204+0000 7f7942d9d640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f792c0a3350 0x7f792c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stdout:154618822711 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.204+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f793c0cf8d0 con 0x7f794410c170 2024-09-19T09:17:18.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.204+0000 7f7942d9d640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f792c0a3350 0x7f792c0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f793400bbe0 tx=0x7f793400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.206+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f793c014030 con 0x7f794410c170 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.389+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7944106c50 con 0x7f794410c170 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.389+0000 7f792bfff640 1 -- 172.21.15.46:0/2939101752 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f793c09bf70 con 0x7f794410c170 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.391+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f792c0a3350 msgr2=0x7f792c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.391+0000 7f7949056640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f792c0a3350 0x7f792c0a5810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f793400bbe0 tx=0x7f793400b390 comp rx=0 tx=0).stop 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.391+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 msgr2=0x7f794419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.391+0000 7f7949056640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 0x7f794419cd70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c970 tx=0x7f793c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 shutdown_connections 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f792c0a3350 0x7f792c0a5810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f794410c170 0x7f794419cd70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7944103660 0x7f79441989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 --2- 172.21.15.46:0/2939101752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7944102d40 0x7f79441984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 >> 172.21.15.46:0/2939101752 conn(0x7f79440fc7a0 msgr2=0x7f79440fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:18.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 shutdown_connections 2024-09-19T09:17:18.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:16.392+0000 7f7949056640 1 -- 172.21.15.46:0/2939101752 wait complete. 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 -- 172.21.15.46:0/3593962920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe810c1a0 msgr2=0x7f6fe810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/3593962920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe810c1a0 0x7f6fe810e610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009ca0 tx=0x7f6fe002a950 comp rx=0 tx=0).stop 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 -- 172.21.15.46:0/3593962920 shutdown_connections 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/3593962920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe810c1a0 0x7f6fe810e610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/3593962920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fe8103720 0x7f6fe810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/3593962920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe8102e00 0x7f6fe81031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 -- 172.21.15.46:0/3593962920 >> 172.21.15.46:0/3593962920 conn(0x7f6fe80fc7a0 msgr2=0x7f6fe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.218+0000 7f6fed1b2640 1 -- 172.21.15.46:0/3593962920 shutdown_connections 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.219+0000 7f6fed1b2640 1 -- 172.21.15.46:0/3593962920 wait complete. 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 Processor -- start 2024-09-19T09:17:18.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 -- start start 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fe8102e00 0x7f6fe8100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 0x7f6fe8100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe810c1a0 0x7f6fe81014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8111f50 con 0x7f6fe8103720 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe8111dd0 con 0x7f6fe810c1a0 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fed1b2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe81120d0 con 0x7f6fe8102e00 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fe659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 0x7f6fe8100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fe659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 0x7f6fe8100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60218/0 (socket says 172.21.15.46:60218) 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fe659c640 1 -- 172.21.15.46:0/2364768500 learned_addr learned my addr 172.21.15.46:0/2364768500 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fe6d9d640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fe8102e00 0x7f6fe8100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fe759e640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe810c1a0 0x7f6fe81014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.220+0000 7f6fe659c640 1 -- 172.21.15.46:0/2364768500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fe8102e00 msgr2=0x7f6fe8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fe659c640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fe8102e00 0x7f6fe8100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fe659c640 1 -- 172.21.15.46:0/2364768500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe810c1a0 msgr2=0x7f6fe81014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fe659c640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe810c1a0 0x7f6fe81014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fe659c640 1 -- 172.21.15.46:0/2364768500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe81a68b0 con 0x7f6fe8103720 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fe759e640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe810c1a0 0x7f6fe81014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fe659c640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 0x7f6fe8100fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e9f0 tx=0x7f6fdc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00cd80 con 0x7f6fe8103720 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe81a6ba0 con 0x7f6fe8103720 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fdc005500 con 0x7f6fe8103720 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc010690 con 0x7f6fe8103720 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.221+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe81a7090 con 0x7f6fe8103720 2024-09-19T09:17:18.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.222+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe81031e0 con 0x7f6fe8103720 2024-09-19T09:17:18.682 INFO:teuthology.orchestra.run.smithi046.stdout:326417514520 2024-09-19T09:17:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.224+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6fdc0046c0 con 0x7f6fe8103720 2024-09-19T09:17:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.225+0000 7f6fcffff640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6fd00a32d0 0x7f6fd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.225+0000 7f6fe6d9d640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6fd00a32d0 0x7f6fd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.225+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f6fdc0cfed0 con 0x7f6fe8103720 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.225+0000 7f6fe6d9d640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6fd00a32d0 0x7f6fd00a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005d00 tx=0x7f6fd800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.228+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6fdc054210 con 0x7f6fe8103720 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.407+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6fe8101f90 con 0x7f6fe8103720 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.407+0000 7f6fcffff640 1 -- 172.21.15.46:0/2364768500 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6fe8101f90 con 0x7f6fe8103720 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6fd00a32d0 msgr2=0x7f6fd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6fd00a32d0 0x7f6fd00a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005d00 tx=0x7f6fd800b410 comp rx=0 tx=0).stop 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 msgr2=0x7f6fe8100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 0x7f6fe8100fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e9f0 tx=0x7f6fdc00edf0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 shutdown_connections 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6fd00a32d0 0x7f6fd00a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6fe8103720 0x7f6fe8100fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fe810c1a0 0x7f6fe81014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 --2- 172.21.15.46:0/2364768500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6fe8102e00 0x7f6fe8100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 >> 172.21.15.46:0/2364768500 conn(0x7f6fe80fc7a0 msgr2=0x7f6fe80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 shutdown_connections 2024-09-19T09:17:18.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:18.409+0000 7f6fed1b2640 1 -- 172.21.15.46:0/2364768500 wait complete. 2024-09-19T09:17:18.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:18 smithi115 ceph-mon[35055]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2152157704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:17:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/423758161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:17:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2364768500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:17:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:18 smithi046 ceph-mon[31203]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2152157704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:17:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/423758161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:17:18.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2364768500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:17:19.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:18 smithi099 ceph-mon[35256]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2152157704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:17:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/423758161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:17:19.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2364768500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 -- 172.21.15.46:0/1867547243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 msgr2=0x7f656c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 --2- 172.21.15.46:0/1867547243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c10d950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6564009cd0 tx=0x7f656402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 -- 172.21.15.46:0/1867547243 shutdown_connections 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 --2- 172.21.15.46:0/1867547243 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c10d950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 --2- 172.21.15.46:0/1867547243 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656c100a80 0x7f656c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 --2- 172.21.15.46:0/1867547243 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f656c106a80 0x7f656c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 -- 172.21.15.46:0/1867547243 >> 172.21.15.46:0/1867547243 conn(0x7f656c0fc7a0 msgr2=0x7f656c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 -- 172.21.15.46:0/1867547243 shutdown_connections 2024-09-19T09:17:19.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.261+0000 7f657104f640 1 -- 172.21.15.46:0/1867547243 wait complete. 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 Processor -- start 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 -- start start 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f656c100a80 0x7f656c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656c106a80 0x7f656c19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f656c110ed0 con 0x7f656c101420 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f656c110d50 con 0x7f656c100a80 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.262+0000 7f657104f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f656c111050 con 0x7f656c106a80 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c1977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40532/0 (socket says 172.21.15.46:40532) 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 -- 172.21.15.46:0/4283467632 learned_addr learned my addr 172.21.15.46:0/4283467632 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:19.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f656ad9d640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f656c100a80 0x7f656c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f656b59e640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656c106a80 0x7f656c19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 -- 172.21.15.46:0/4283467632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656c106a80 msgr2=0x7f656c19bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656c106a80 0x7f656c19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 -- 172.21.15.46:0/4283467632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f656c100a80 msgr2=0x7f656c197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f656c100a80 0x7f656c197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 -- 172.21.15.46:0/4283467632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656c19c220 con 0x7f656c101420 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6563fff640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c1977b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f655400c920 tx=0x7f655400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554007c70 con 0x7f656c101420 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6554007e10 con 0x7f656c101420 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554018890 con 0x7f656c101420 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656c19c510 con 0x7f656c101420 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.263+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f656c1a3df0 con 0x7f656c101420 2024-09-19T09:17:19.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.264+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f656c100ee0 con 0x7f656c101420 2024-09-19T09:17:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.266+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6554018a50 con 0x7f656c101420 2024-09-19T09:17:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.267+0000 7f6568d99640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65580a32d0 0x7f65580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.267+0000 7f656ad9d640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65580a32d0 0x7f65580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.267+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f65540cfcd0 con 0x7f656c101420 2024-09-19T09:17:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.268+0000 7f656ad9d640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65580a32d0 0x7f65580a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f655c00bb60 tx=0x7f655c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:19.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.270+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6554014030 con 0x7f656c101420 2024-09-19T09:17:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.450+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f656c1985d0 con 0x7f656c101420 2024-09-19T09:17:19.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.450+0000 7f6568d99640 1 -- 172.21.15.46:0/4283467632 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f656c1985d0 con 0x7f656c101420 2024-09-19T09:17:19.451 INFO:teuthology.orchestra.run.smithi046.stdout:103079215168 2024-09-19T09:17:19.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65580a32d0 msgr2=0x7f65580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65580a32d0 0x7f65580a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f655c00bb60 tx=0x7f655c00b390 comp rx=0 tx=0).stop 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 msgr2=0x7f656c1977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c1977b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f655400c920 tx=0x7f655400cde0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 shutdown_connections 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f65580a32d0 0x7f65580a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f656c101420 0x7f656c1977b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f656c106a80 0x7f656c19bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 --2- 172.21.15.46:0/4283467632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f656c100a80 0x7f656c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 >> 172.21.15.46:0/4283467632 conn(0x7f656c0fc7a0 msgr2=0x7f656c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:19.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 shutdown_connections 2024-09-19T09:17:19.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:19.453+0000 7f657104f640 1 -- 172.21.15.46:0/4283467632 wait complete. 2024-09-19T09:17:19.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:19 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4283467632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:17:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:19 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4283467632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:17:20.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:19 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4283467632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2245275673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14100e20 msgr2=0x7eff14101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2245275673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14100e20 0x7eff14101200 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009900 tx=0x7eff0c02a480 comp rx=0 tx=0).stop 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2245275673 shutdown_connections 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2245275673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14102ef0 0x7eff1410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2245275673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 0x7eff141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2245275673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14100e20 0x7eff14101200 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2245275673 >> 172.21.15.46:0/2245275673 conn(0x7eff140fc7d0 msgr2=0x7eff140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2245275673 shutdown_connections 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2245275673 wait complete. 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 Processor -- start 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.784+0000 7eff1c3a0640 1 -- start start 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14100e20 0x7eff141992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 0x7eff141997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 0x7eff141a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7eff14110f80 con 0x7eff14102ef0 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7eff14110e00 con 0x7eff14102570 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7eff14111100 con 0x7eff14100e20 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 0x7eff141a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 0x7eff141a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60194/0 (socket says 172.21.15.46:60194) 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 -- 172.21.15.46:0/2152157704 learned_addr learned my addr 172.21.15.46:0/2152157704 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi046.stdout:236223201320 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1993b640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 0x7eff141997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a13c640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14100e20 0x7eff141992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 -- 172.21.15.46:0/2152157704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14100e20 msgr2=0x7eff141992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14100e20 0x7eff141992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 -- 172.21.15.46:0/2152157704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 msgr2=0x7eff141997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 0x7eff141997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 -- 172.21.15.46:0/2152157704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff141a4870 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1993b640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 0x7eff141997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a13c640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14100e20 0x7eff141992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1a93d640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 0x7eff141a4330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff0400cad0 tx=0x7eff0400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0400ae20 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff04005020 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff141a4a40 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.785+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0400f6f0 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.786+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff141a4f80 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.787+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff14101200 con 0x7eff14102ef0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.788+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7eff040051d0 con 0x7eff14102ef0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.788+0000 7eff137fe640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efefc0a3350 0x7efefc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.789+0000 7eff1a13c640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efefc0a3350 0x7efefc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.789+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7eff040cfba0 con 0x7eff14102ef0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.789+0000 7eff1a13c640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efefc0a3350 0x7efefc0a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff0c005ab0 tx=0x7eff0c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.791+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7eff04014030 con 0x7eff14102ef0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.974+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7eff1406a560 con 0x7eff14102ef0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.974+0000 7eff137fe640 1 -- 172.21.15.46:0/2152157704 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7eff1406a560 con 0x7eff14102ef0 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.976+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efefc0a3350 msgr2=0x7efefc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.976+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efefc0a3350 0x7efefc0a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7eff0c005ab0 tx=0x7eff0c005a20 comp rx=0 tx=0).stop 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.976+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 msgr2=0x7eff141a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.976+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 0x7eff141a4330 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff0400cad0 tx=0x7eff0400cf90 comp rx=0 tx=0).stop 2024-09-19T09:17:20.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 shutdown_connections 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7efefc0a3350 0x7efefc0a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7eff14102ef0 0x7eff141a4330 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff14102570 0x7eff141997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 --2- 172.21.15.46:0/2152157704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff14100e20 0x7eff141992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 >> 172.21.15.46:0/2152157704 conn(0x7eff140fc7d0 msgr2=0x7eff14106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 shutdown_connections 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:17.977+0000 7eff1c3a0640 1 -- 172.21.15.46:0/2152157704 wait complete. 2024-09-19T09:17:20.725 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:20 smithi046 ceph-mon[31203]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:20.725 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:20 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:20.754 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430250 got 206158430252 for osd.7 2024-09-19T09:17:20.754 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:20.895 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:20 smithi115 ceph-mon[35055]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:20.895 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:20 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 -- 172.21.15.46:0/2508142177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 msgr2=0x7f2a04100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 --2- 172.21.15.46:0/2508142177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a04100ee0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009930 tx=0x7f29f802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 -- 172.21.15.46:0/2508142177 shutdown_connections 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 --2- 172.21.15.46:0/2508142177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a04100ee0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 --2- 172.21.15.46:0/2508142177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a04101420 0x7f2a0410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 --2- 172.21.15.46:0/2508142177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a04106a80 0x7f2a04106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 -- 172.21.15.46:0/2508142177 >> 172.21.15.46:0/2508142177 conn(0x7f2a040fc7a0 msgr2=0x7f2a040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 -- 172.21.15.46:0/2508142177 shutdown_connections 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.918+0000 7f2a08abf640 1 -- 172.21.15.46:0/2508142177 wait complete. 2024-09-19T09:17:20.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 Processor -- start 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 -- start start 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a041973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a04101420 0x7f2a04197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a04106a80 0x7f2a0419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04110e80 con 0x7f2a04100a80 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04110d00 con 0x7f2a04101420 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a08abf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2a04111000 con 0x7f2a04106a80 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a041973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a041973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40546/0 (socket says 172.21.15.46:40546) 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 -- 172.21.15.46:0/1590460265 learned_addr learned my addr 172.21.15.46:0/1590460265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:20.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a01d9b640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a04101420 0x7f2a04197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a02d9d640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a04106a80 0x7f2a0419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 -- 172.21.15.46:0/1590460265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a04106a80 msgr2=0x7f2a0419bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a04106a80 0x7f2a0419bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 -- 172.21.15.46:0/1590460265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a04101420 msgr2=0x7f2a04197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a04101420 0x7f2a04197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.919+0000 7f2a0259c640 1 -- 172.21.15.46:0/1590460265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0419c370 con 0x7f2a04100a80 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.920+0000 7f2a0259c640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a041973c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29f400d950 tx=0x7f29f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.920+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4017070 con 0x7f2a04100a80 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.920+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f4009c30 con 0x7f2a04100a80 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.920+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0419c660 con 0x7f2a04100a80 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.920+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f400f6b0 con 0x7f2a04100a80 2024-09-19T09:17:20.928 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.920+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a041a3f40 con 0x7f2a04100a80 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.921+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a04100ee0 con 0x7f2a04100a80 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.922+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f29f40109d0 con 0x7f2a04100a80 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.923+0000 7f29f37fe640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f29ec0a32d0 0x7f29ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.923+0000 7f2a01d9b640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f29ec0a32d0 0x7f29ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.923+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f29f40cf480 con 0x7f2a04100a80 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.923+0000 7f2a01d9b640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f29ec0a32d0 0x7f29ec0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009900 tx=0x7f29f80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:20.927+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29f4009de0 con 0x7f2a04100a80 2024-09-19T09:17:21.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:20 smithi099 ceph-mon[35256]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:21.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:20 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:17:21.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.108+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f2a04108ff0 con 0x7f2a04100a80 2024-09-19T09:17:21.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.108+0000 7f29f37fe640 1 -- 172.21.15.46:0/1590460265 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29f409c1f0 con 0x7f2a04100a80 2024-09-19T09:17:21.109 INFO:teuthology.orchestra.run.smithi046.stdout:270582939683 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f29ec0a32d0 msgr2=0x7f29ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f29ec0a32d0 0x7f29ec0a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009900 tx=0x7f29f80058d0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 msgr2=0x7f2a041973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a041973c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29f400d950 tx=0x7f29f400de10 comp rx=0 tx=0).stop 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 shutdown_connections 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f29ec0a32d0 0x7f29ec0a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a04106a80 0x7f2a0419bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a04101420 0x7f2a04197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 --2- 172.21.15.46:0/1590460265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a04100a80 0x7f2a041973c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 >> 172.21.15.46:0/1590460265 conn(0x7f2a040fc7a0 msgr2=0x7f2a040fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:21.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.110+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 shutdown_connections 2024-09-19T09:17:21.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:21.111+0000 7f2a08abf640 1 -- 172.21.15.46:0/1590460265 wait complete. 2024-09-19T09:17:21.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822708 got 154618822711 for osd.5 2024-09-19T09:17:21.326 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:21.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:21 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1590460265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:17:21.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.884 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:21 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.912 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986236 for osd.4 2024-09-19T09:17:21.912 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:21.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:21 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1590460265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:17:21.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:21.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:21 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:21 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1590460265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:17:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:21 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:22.317 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201318 got 236223201320 for osd.8 2024-09-19T09:17:22.317 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:22.905 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:22 smithi046 ceph-mon[31203]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:17:22.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:22 smithi115 ceph-mon[35055]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:17:23.001 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514518 got 326417514520 for osd.11 2024-09-19T09:17:23.001 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:23.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:22 smithi099 ceph-mon[35256]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:17:23.350 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215165 got 103079215168 for osd.3 2024-09-19T09:17:23.351 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3334609696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 msgr2=0x7f4cc0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3334609696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc0106e60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00099b0 tx=0x7f4cb002c650 comp rx=0 tx=0).stop 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3334609696 shutdown_connections 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3334609696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc0101420 0x7f4cc010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3334609696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0100a80 0x7f4cc0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3334609696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc0106e60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3334609696 >> 172.21.15.46:0/3334609696 conn(0x7f4cc00fc7a0 msgr2=0x7f4cc00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3334609696 shutdown_connections 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.514+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3334609696 wait complete. 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 Processor -- start 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 -- start start 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc0100a80 0x7f4cc0196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0101420 0x7f4cc0196790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc010fd70 con 0x7f4cc0106a80 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc010fbf0 con 0x7f4cc0101420 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cc5a4b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc010fef0 con 0x7f4cc0100a80 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cbf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cbf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40572/0 (socket says 172.21.15.46:40572) 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cbf7fe640 1 -- 172.21.15.46:0/3068975887 learned_addr learned my addr 172.21.15.46:0/3068975887 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.515+0000 7f4cbeffd640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc0100a80 0x7f4cc0196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbe7fc640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0101420 0x7f4cc0196790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbf7fe640 1 -- 172.21.15.46:0/3068975887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc0100a80 msgr2=0x7f4cc0196250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbf7fe640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc0100a80 0x7f4cc0196250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbf7fe640 1 -- 172.21.15.46:0/3068975887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0101420 msgr2=0x7f4cc0196790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbf7fe640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0101420 0x7f4cc0196790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbf7fe640 1 -- 172.21.15.46:0/3068975887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc019b200 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbe7fc640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0101420 0x7f4cc0196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cbf7fe640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc019ab20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800eaa0 tx=0x7f4cb800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800cdb0 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb8005020 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc019b4f0 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80116b0 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.516+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc01a2dd0 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.517+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc0100ee0 con 0x7f4cc0106a80 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.518+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4cb8005560 con 0x7f4cc0106a80 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.519+0000 7f4cc4a49640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ca80a3350 0x7f4ca80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.520+0000 7f4cbeffd640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ca80a3350 0x7f4ca80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.520+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f4cb80cfef0 con 0x7f4cc0106a80 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.520+0000 7f4cbeffd640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ca80a3350 0x7f4ca80a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009980 tx=0x7f4cb00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.523+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cb8016030 con 0x7f4cc0106a80 2024-09-19T09:17:23.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.700+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4cc01975b0 con 0x7f4cc0106a80 2024-09-19T09:17:23.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.700+0000 7f4cc4a49640 1 -- 172.21.15.46:0/3068975887 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cc01975b0 con 0x7f4cc0106a80 2024-09-19T09:17:23.702 INFO:teuthology.orchestra.run.smithi046.stdout:34359738448 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ca80a3350 msgr2=0x7f4ca80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ca80a3350 0x7f4ca80a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009980 tx=0x7f4cb00058d0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 msgr2=0x7f4cc019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc019ab20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800eaa0 tx=0x7f4cb800ef60 comp rx=0 tx=0).stop 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 shutdown_connections 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ca80a3350 0x7f4ca80a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4cc0106a80 0x7f4cc019ab20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4cc0101420 0x7f4cc0196790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 --2- 172.21.15.46:0/3068975887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4cc0100a80 0x7f4cc0196250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 >> 172.21.15.46:0/3068975887 conn(0x7f4cc00fc7a0 msgr2=0x7f4cc00fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 shutdown_connections 2024-09-19T09:17:23.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:23.702+0000 7f4cc5a4b640 1 -- 172.21.15.46:0/3068975887 wait complete. 2024-09-19T09:17:24.051 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939680 got 270582939683 for osd.9 2024-09-19T09:17:24.099 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:24.570 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:24.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:24 smithi115 ceph-mon[35055]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-19T09:17:24.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:24 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3068975887' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:17:24.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:24 smithi046 ceph-mon[31203]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-19T09:17:24.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:24 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3068975887' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:17:25.001 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738448 for osd.0 2024-09-19T09:17:25.001 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:25.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:24 smithi099 ceph-mon[35256]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-19T09:17:25.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:24 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3068975887' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:17:25.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/734983477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 msgr2=0x7f7d8410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/734983477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8410e610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009ca0 tx=0x7f7d7c02a950 comp rx=0 tx=0).stop 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/734983477 shutdown_connections 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/734983477 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8410e610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/734983477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84103660 0x7f7d8410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/734983477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d84102d40 0x7f7d84103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/734983477 >> 172.21.15.46:0/734983477 conn(0x7f7d840fc7a0 msgr2=0x7f7d840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/734983477 shutdown_connections 2024-09-19T09:17:25.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.500+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/734983477 wait complete. 2024-09-19T09:17:25.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.501+0000 7f7d8a2a4640 1 Processor -- start 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.501+0000 7f7d8a2a4640 1 -- start start 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d8a2a4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d84102d40 0x7f7d84198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d8a2a4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84103660 0x7f7d84198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d8a2a4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d8a2a4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84111f50 con 0x7f7d8410c170 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d8a2a4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84111dd0 con 0x7f7d84102d40 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d8a2a4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7d841120d0 con 0x7f7d84103660 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40584/0 (socket says 172.21.15.46:40584) 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 -- 172.21.15.46:0/2461366074 learned_addr learned my addr 172.21.15.46:0/2461366074 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d83fff640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d84102d40 0x7f7d84198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d837fe640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84103660 0x7f7d84198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 -- 172.21.15.46:0/2461366074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84103660 msgr2=0x7f7d84198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84103660 0x7f7d84198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 -- 172.21.15.46:0/2461366074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d84102d40 msgr2=0x7f7d84198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d84102d40 0x7f7d84198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 -- 172.21.15.46:0/2461366074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8419d3b0 con 0x7f7d8410c170 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.502+0000 7f7d88841640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8419ccd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c004af0 tx=0x7f7d7c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.503+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c034040 con 0x7f7d8410c170 2024-09-19T09:17:25.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.503+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d7c030920 con 0x7f7d8410c170 2024-09-19T09:17:25.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.503+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8419d640 con 0x7f7d8410c170 2024-09-19T09:17:25.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.503+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c0047b0 con 0x7f7d8410c170 2024-09-19T09:17:25.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.503+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d841a4f80 con 0x7f7d8410c170 2024-09-19T09:17:25.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.504+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d84103120 con 0x7f7d8410c170 2024-09-19T09:17:25.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.505+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7d7c037020 con 0x7f7d8410c170 2024-09-19T09:17:25.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.506+0000 7f7d817fa640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d6c0a3350 0x7f7d6c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.506+0000 7f7d83fff640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d6c0a3350 0x7f7d6c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.506+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7f7d7c0f05f0 con 0x7f7d8410c170 2024-09-19T09:17:25.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.506+0000 7f7d83fff640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d6c0a3350 0x7f7d6c0a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009bd0 tx=0x7f7d74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.510+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d7c0bd470 con 0x7f7d8410c170 2024-09-19T09:17:25.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.696+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7d841071e0 con 0x7f7d8410c170 2024-09-19T09:17:25.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.696+0000 7f7d817fa640 1 -- 172.21.15.46:0/2461366074 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7d7c0bcd70 con 0x7f7d8410c170 2024-09-19T09:17:25.698 INFO:teuthology.orchestra.run.smithi046.stdout:184683593778 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d6c0a3350 msgr2=0x7f7d6c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d6c0a3350 0x7f7d6c0a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009bd0 tx=0x7f7d74005f90 comp rx=0 tx=0).stop 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 msgr2=0x7f7d8419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8419ccd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c004af0 tx=0x7f7d7c02f5b0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 shutdown_connections 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7d6c0a3350 0x7f7d6c0a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7d8410c170 0x7f7d8419ccd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7d84103660 0x7f7d84198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 --2- 172.21.15.46:0/2461366074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d84102d40 0x7f7d84198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 >> 172.21.15.46:0/2461366074 conn(0x7f7d840fc7a0 msgr2=0x7f7d840fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 shutdown_connections 2024-09-19T09:17:25.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:25.698+0000 7f7d8a2a4640 1 -- 172.21.15.46:0/2461366074 wait complete. 2024-09-19T09:17:26.730 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:26 smithi046 ceph-mon[31203]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:17:26.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:26 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2461366074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:17:26.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:26 smithi115 ceph-mon[35055]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:17:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:26 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2461366074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:17:27.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:26 smithi099 ceph-mon[35256]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:17:27.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:26 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2461366074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:17:27.093 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593776 got 184683593778 for osd.6 2024-09-19T09:17:27.094 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:27.094 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:17:27.094 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:17:27.383 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:27.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 -- 172.21.15.46:0/3352490501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4100e20 msgr2=0x7fd2c4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 --2- 172.21.15.46:0/3352490501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4100e20 0x7fd2c4101200 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009900 tx=0x7fd2c002a480 comp rx=0 tx=0).stop 2024-09-19T09:17:27.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 -- 172.21.15.46:0/3352490501 shutdown_connections 2024-09-19T09:17:27.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 --2- 172.21.15.46:0/3352490501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c4102ef0 0x7fd2c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 --2- 172.21.15.46:0/3352490501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4102570 0x7fd2c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 --2- 172.21.15.46:0/3352490501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4100e20 0x7fd2c4101200 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 -- 172.21.15.46:0/3352490501 >> 172.21.15.46:0/3352490501 conn(0x7fd2c40fc7d0 msgr2=0x7fd2c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 -- 172.21.15.46:0/3352490501 shutdown_connections 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.849+0000 7fd2cc287640 1 -- 172.21.15.46:0/3352490501 wait complete. 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 Processor -- start 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 -- start start 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4100e20 0x7fd2c4197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 0x7fd2c4197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c4102ef0 0x7fd2c419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4110f80 con 0x7fd2c4102570 2024-09-19T09:17:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4110e00 con 0x7fd2c4102ef0 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2cc287640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c4111100 con 0x7fd2c4100e20 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 0x7fd2c4197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 0x7fd2c4197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40602/0 (socket says 172.21.15.46:40602) 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 -- 172.21.15.46:0/1353476118 learned_addr learned my addr 172.21.15.46:0/1353476118 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2ca023640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4100e20 0x7fd2c4197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2ca824640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c4102ef0 0x7fd2c419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 -- 172.21.15.46:0/1353476118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4100e20 msgr2=0x7fd2c4197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4100e20 0x7fd2c4197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 -- 172.21.15.46:0/1353476118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c4102ef0 msgr2=0x7fd2c419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c4102ef0 0x7fd2c419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 -- 172.21.15.46:0/1353476118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c419c3b0 con 0x7fd2c4102570 2024-09-19T09:17:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.850+0000 7fd2c9822640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 0x7fd2c4197940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800e9f0 tx=0x7fd2b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.851+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b800cd80 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.851+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2b8005500 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.851+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c419c6a0 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.851+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8010690 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.851+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c41a3f80 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.852+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c4101200 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.853+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd2b80046c0 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.853+0000 7fd2b77fe640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd2b00a32d0 0x7fd2b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.854+0000 7fd2ca023640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd2b00a32d0 0x7fd2b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.854+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fd2b80cfcd0 con 0x7fd2c4102570 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.854+0000 7fd2ca023640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd2b00a32d0 0x7fd2b00a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009230 tx=0x7fd2c00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:27.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:27.858+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2b809ca40 con 0x7fd2c4102570 2024-09-19T09:17:28.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.054+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2c4198760 con 0x7fd2b00a32d0 2024-09-19T09:17:28.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.061+0000 7fd2b77fe640 1 -- 172.21.15.46:0/1353476118 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258845 (secure 0 0 0) 0x7fd2c4198760 con 0x7fd2b00a32d0 2024-09-19T09:17:28.066 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:28.067 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:17:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd2b00a32d0 msgr2=0x7fd2b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd2b00a32d0 0x7fd2b00a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009230 tx=0x7fd2c00058d0 comp rx=0 tx=0).stop 2024-09-19T09:17:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 msgr2=0x7fd2c4197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:28.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 0x7fd2c4197940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800e9f0 tx=0x7fd2b800edf0 comp rx=0 tx=0).stop 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 shutdown_connections 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd2b00a32d0 0x7fd2b00a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd2c4102570 0x7fd2c4197940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2c4102ef0 0x7fd2c419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 --2- 172.21.15.46:0/1353476118 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2c4100e20 0x7fd2c4197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 >> 172.21.15.46:0/1353476118 conn(0x7fd2c40fc7d0 msgr2=0x7fd2c40fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 shutdown_connections 2024-09-19T09:17:28.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:28.064+0000 7fd2cc287640 1 -- 172.21.15.46:0/1353476118 wait complete. 2024-09-19T09:17:28.777 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-19T09:17:26.966951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659375,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":670,"num_read_kb":459,"num_write":427,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":347904,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593920,"statfs":{"total":1151940427776,"available":1151584174080,"internally_reserved":0,"allocated":11403264,"data_stored":7132005,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":74,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002970"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983469+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:16:24.983469+0000","last_peered":"2024-09-19T09:16:24.983469+0000","last_clean":"2024-09-19T09:16:24.983469+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:16:24.983469+0000","last_undegraded":"2024-09-19T09:16:24.983469+0000","last_fullsized":"2024-09-19T09:16:24.983469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997247+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:16:24.997247+0000","last_peered":"2024-09-19T09:16:24.997247+0000","last_clean":"2024-09-19T09:16:24.997247+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:16:24.997247+0000","last_undegraded":"2024-09-19T09:16:24.997247+0000","last_fullsized":"2024-09-19T09:16:24.997247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997082+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:16:24.997082+0000","last_peered":"2024-09-19T09:16:24.997082+0000","last_clean":"2024-09-19T09:16:24.997082+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.997082+0000","last_undegraded":"2024-09-19T09:16:24.997082+0000","last_fullsized":"2024-09-19T09:16:24.997082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994665+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:16:24.994665+0000","last_peered":"2024-09-19T09:16:24.994665+0000","last_clean":"2024-09-19T09:16:24.994665+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:16:24.994665+0000","last_undegraded":"2024-09-19T09:16:24.994665+0000","last_fullsized":"2024-09-19T09:16:24.994665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999452+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:16:24.999452+0000","last_peered":"2024-09-19T09:16:24.999452+0000","last_clean":"2024-09-19T09:16:24.999452+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:16:24.999452+0000","last_undegraded":"2024-09-19T09:16:24.999452+0000","last_fullsized":"2024-09-19T09:16:24.999452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983035+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:16:24.983035+0000","last_peered":"2024-09-19T09:16:24.983035+0000","last_clean":"2024-09-19T09:16:24.983035+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:16:24.983035+0000","last_undegraded":"2024-09-19T09:16:24.983035+0000","last_fullsized":"2024-09-19T09:16:24.983035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997278+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:16:24.997278+0000","last_peered":"2024-09-19T09:16:24.997278+0000","last_clean":"2024-09-19T09:16:24.997278+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:16:24.997278+0000","last_undegraded":"2024-09-19T09:16:24.997278+0000","last_fullsized":"2024-09-19T09:16:24.997278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993833+0000","last_change":"2024-09-19T09:16:23.990830+0000","last_active":"2024-09-19T09:16:24.993833+0000","last_peered":"2024-09-19T09:16:24.993833+0000","last_clean":"2024-09-19T09:16:24.993833+0000","last_became_active":"2024-09-19T09:16:23.990551+0000","last_became_peered":"2024-09-19T09:16:23.990551+0000","last_unstale":"2024-09-19T09:16:24.993833+0000","last_undegraded":"2024-09-19T09:16:24.993833+0000","last_fullsized":"2024-09-19T09:16:24.993833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:06.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995195+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:16:24.995195+0000","last_peered":"2024-09-19T09:16:24.995195+0000","last_clean":"2024-09-19T09:16:24.995195+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:16:24.995195+0000","last_undegraded":"2024-09-19T09:16:24.995195+0000","last_fullsized":"2024-09-19T09:16:24.995195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983440+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:16:24.983440+0000","last_peered":"2024-09-19T09:16:24.983440+0000","last_clean":"2024-09-19T09:16:24.983440+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:16:24.983440+0000","last_undegraded":"2024-09-19T09:16:24.983440+0000","last_fullsized":"2024-09-19T09:16:24.983440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998697+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:16:24.998697+0000","last_peered":"2024-09-19T09:16:24.998697+0000","last_clean":"2024-09-19T09:16:24.998697+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:16:24.998697+0000","last_undegraded":"2024-09-19T09:16:24.998697+0000","last_fullsized":"2024-09-19T09:16:24.998697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994817+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:16:24.994817+0000","last_peered":"2024-09-19T09:16:24.994817+0000","last_clean":"2024-09-19T09:16:24.994817+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:16:24.994817+0000","last_undegraded":"2024-09-19T09:16:24.994817+0000","last_fullsized":"2024-09-19T09:16:24.994817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982364+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:16:24.982364+0000","last_peered":"2024-09-19T09:16:24.982364+0000","last_clean":"2024-09-19T09:16:24.982364+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:16:24.982364+0000","last_undegraded":"2024-09-19T09:16:24.982364+0000","last_fullsized":"2024-09-19T09:16:24.982364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997004+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:16:24.997004+0000","last_peered":"2024-09-19T09:16:24.997004+0000","last_clean":"2024-09-19T09:16:24.997004+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:16:24.997004+0000","last_undegraded":"2024-09-19T09:16:24.997004+0000","last_fullsized":"2024-09-19T09:16:24.997004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996593+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:16:24.996593+0000","last_peered":"2024-09-19T09:16:24.996593+0000","last_clean":"2024-09-19T09:16:24.996593+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:16:24.996593+0000","last_undegraded":"2024-09-19T09:16:24.996593+0000","last_fullsized":"2024-09-19T09:16:24.996593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994114+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:16:24.994114+0000","last_peered":"2024-09-19T09:16:24.994114+0000","last_clean":"2024-09-19T09:16:24.994114+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:16:24.994114+0000","last_undegraded":"2024-09-19T09:16:24.994114+0000","last_fullsized":"2024-09-19T09:16:24.994114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983416+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:16:24.983416+0000","last_peered":"2024-09-19T09:16:24.983416+0000","last_clean":"2024-09-19T09:16:24.983416+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:16:24.983416+0000","last_undegraded":"2024-09-19T09:16:24.983416+0000","last_fullsized":"2024-09-19T09:16:24.983416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994115+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:16:24.994115+0000","last_peered":"2024-09-19T09:16:24.994115+0000","last_clean":"2024-09-19T09:16:24.994115+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:16:24.994115+0000","last_undegraded":"2024-09-19T09:16:24.994115+0000","last_fullsized":"2024-09-19T09:16:24.994115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998941+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:16:24.998941+0000","last_peered":"2024-09-19T09:16:24.998941+0000","last_clean":"2024-09-19T09:16:24.998941+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:16:24.998941+0000","last_undegraded":"2024-09-19T09:16:24.998941+0000","last_fullsized":"2024-09-19T09:16:24.998941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983110+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:16:24.983110+0000","last_peered":"2024-09-19T09:16:24.983110+0000","last_clean":"2024-09-19T09:16:24.983110+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:16:24.983110+0000","last_undegraded":"2024-09-19T09:16:24.983110+0000","last_fullsized":"2024-09-19T09:16:24.983110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982389+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:16:24.982389+0000","last_peered":"2024-09-19T09:16:24.982389+0000","last_clean":"2024-09-19T09:16:24.982389+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:16:24.982389+0000","last_undegraded":"2024-09-19T09:16:24.982389+0000","last_fullsized":"2024-09-19T09:16:24.982389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994839+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:16:24.994839+0000","last_peered":"2024-09-19T09:16:24.994839+0000","last_clean":"2024-09-19T09:16:24.994839+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:16:24.994839+0000","last_undegraded":"2024-09-19T09:16:24.994839+0000","last_fullsized":"2024-09-19T09:16:24.994839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994841+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:16:24.994841+0000","last_peered":"2024-09-19T09:16:24.994841+0000","last_clean":"2024-09-19T09:16:24.994841+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:16:24.994841+0000","last_undegraded":"2024-09-19T09:16:24.994841+0000","last_fullsized":"2024-09-19T09:16:24.994841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994171+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:16:24.994171+0000","last_peered":"2024-09-19T09:16:24.994171+0000","last_clean":"2024-09-19T09:16:24.994171+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:16:24.994171+0000","last_undegraded":"2024-09-19T09:16:24.994171+0000","last_fullsized":"2024-09-19T09:16:24.994171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994413+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:16:24.994413+0000","last_peered":"2024-09-19T09:16:24.994413+0000","last_clean":"2024-09-19T09:16:24.994413+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:16:24.994413+0000","last_undegraded":"2024-09-19T09:16:24.994413+0000","last_fullsized":"2024-09-19T09:16:24.994413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997932+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:16:24.997932+0000","last_peered":"2024-09-19T09:16:24.997932+0000","last_clean":"2024-09-19T09:16:24.997932+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:16:24.997932+0000","last_undegraded":"2024-09-19T09:16:24.997932+0000","last_fullsized":"2024-09-19T09:16:24.997932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983394+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:16:24.983394+0000","last_peered":"2024-09-19T09:16:24.983394+0000","last_clean":"2024-09-19T09:16:24.983394+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:16:24.983394+0000","last_undegraded":"2024-09-19T09:16:24.983394+0000","last_fullsized":"2024-09-19T09:16:24.983394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982293+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:16:24.982293+0000","last_peered":"2024-09-19T09:16:24.982293+0000","last_clean":"2024-09-19T09:16:24.982293+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:16:24.982293+0000","last_undegraded":"2024-09-19T09:16:24.982293+0000","last_fullsized":"2024-09-19T09:16:24.982293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996897+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:16:24.996897+0000","last_peered":"2024-09-19T09:16:24.996897+0000","last_clean":"2024-09-19T09:16:24.996897+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:16:24.996897+0000","last_undegraded":"2024-09-19T09:16:24.996897+0000","last_fullsized":"2024-09-19T09:16:24.996897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998367+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:16:24.998367+0000","last_peered":"2024-09-19T09:16:24.998367+0000","last_clean":"2024-09-19T09:16:24.998367+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:16:24.998367+0000","last_undegraded":"2024-09-19T09:16:24.998367+0000","last_fullsized":"2024-09-19T09:16:24.998367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999424+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:16:24.999424+0000","last_peered":"2024-09-19T09:16:24.999424+0000","last_clean":"2024-09-19T09:16:24.999424+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:16:24.999424+0000","last_undegraded":"2024-09-19T09:16:24.999424+0000","last_fullsized":"2024-09-19T09:16:24.999424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983090+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:16:24.983090+0000","last_peered":"2024-09-19T09:16:24.983090+0000","last_clean":"2024-09-19T09:16:24.983090+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:16:24.983090+0000","last_undegraded":"2024-09-19T09:16:24.983090+0000","last_fullsized":"2024-09-19T09:16:24.983090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994599+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:16:24.994599+0000","last_peered":"2024-09-19T09:16:24.994599+0000","last_clean":"2024-09-19T09:16:24.994599+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:16:24.994599+0000","last_undegraded":"2024-09-19T09:16:24.994599+0000","last_fullsized":"2024-09-19T09:16:24.994599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:23.122177+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:17:23.122177+0000","last_peered":"2024-09-19T09:17:23.122177+0000","last_clean":"2024-09-19T09:17:23.122177+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:17:23.122177+0000","last_undegraded":"2024-09-19T09:17:23.122177+0000","last_fullsized":"2024-09-19T09:17:23.122177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994055+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:16:24.994055+0000","last_peered":"2024-09-19T09:16:24.994055+0000","last_clean":"2024-09-19T09:16:24.994055+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:16:24.994055+0000","last_undegraded":"2024-09-19T09:16:24.994055+0000","last_fullsized":"2024-09-19T09:16:24.994055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046259+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:16:34.046259+0000","last_peered":"2024-09-19T09:16:34.046259+0000","last_clean":"2024-09-19T09:16:34.046259+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:16:34.046259+0000","last_undegraded":"2024-09-19T09:16:34.046259+0000","last_fullsized":"2024-09-19T09:16:34.046259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.038532+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:16:33.038532+0000","last_peered":"2024-09-19T09:16:33.038532+0000","last_clean":"2024-09-19T09:16:33.038532+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:16:33.038532+0000","last_undegraded":"2024-09-19T09:16:33.038532+0000","last_fullsized":"2024-09-19T09:16:33.038532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993874+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:16:24.993874+0000","last_peered":"2024-09-19T09:16:24.993874+0000","last_clean":"2024-09-19T09:16:24.993874+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:16:24.993874+0000","last_undegraded":"2024-09-19T09:16:24.993874+0000","last_fullsized":"2024-09-19T09:16:24.993874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054421+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:16:35.054421+0000","last_peered":"2024-09-19T09:16:35.054421+0000","last_clean":"2024-09-19T09:16:35.054421+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:16:35.054421+0000","last_undegraded":"2024-09-19T09:16:35.054421+0000","last_fullsized":"2024-09-19T09:16:35.054421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993648+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:16:24.993648+0000","last_peered":"2024-09-19T09:16:24.993648+0000","last_clean":"2024-09-19T09:16:24.993648+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:16:24.993648+0000","last_undegraded":"2024-09-19T09:16:24.993648+0000","last_fullsized":"2024-09-19T09:16:24.993648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:26.125869+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:17:26.125869+0000","last_peered":"2024-09-19T09:17:26.125869+0000","last_clean":"2024-09-19T09:17:26.125869+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:17:26.125869+0000","last_undegraded":"2024-09-19T09:17:26.125869+0000","last_fullsized":"2024-09-19T09:17:26.125869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994939+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:16:24.994939+0000","last_peered":"2024-09-19T09:16:24.994939+0000","last_clean":"2024-09-19T09:16:24.994939+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:16:24.994939+0000","last_undegraded":"2024-09-19T09:16:24.994939+0000","last_fullsized":"2024-09-19T09:16:24.994939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052926+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:16:35.052926+0000","last_peered":"2024-09-19T09:16:35.052926+0000","last_clean":"2024-09-19T09:16:35.052926+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:16:35.052926+0000","last_undegraded":"2024-09-19T09:16:35.052926+0000","last_fullsized":"2024-09-19T09:16:35.052926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997081+0000","last_change":"2024-09-19T09:16:23.987959+0000","last_active":"2024-09-19T09:16:24.997081+0000","last_peered":"2024-09-19T09:16:24.997081+0000","last_clean":"2024-09-19T09:16:24.997081+0000","last_became_active":"2024-09-19T09:16:23.987676+0000","last_became_peered":"2024-09-19T09:16:23.987676+0000","last_unstale":"2024-09-19T09:16:24.997081+0000","last_undegraded":"2024-09-19T09:16:24.997081+0000","last_fullsized":"2024-09-19T09:16:24.997081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:15.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046182+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:16:34.046182+0000","last_peered":"2024-09-19T09:16:34.046182+0000","last_clean":"2024-09-19T09:16:34.046182+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:16:34.046182+0000","last_undegraded":"2024-09-19T09:16:34.046182+0000","last_fullsized":"2024-09-19T09:16:34.046182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994911+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:16:24.994911+0000","last_peered":"2024-09-19T09:16:24.994911+0000","last_clean":"2024-09-19T09:16:24.994911+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:16:24.994911+0000","last_undegraded":"2024-09-19T09:16:24.994911+0000","last_fullsized":"2024-09-19T09:16:24.994911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":160,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:26.125604+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:17:26.125604+0000","last_peered":"2024-09-19T09:17:26.125604+0000","last_clean":"2024-09-19T09:17:26.125604+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:17:26.125604+0000","last_undegraded":"2024-09-19T09:17:26.125604+0000","last_fullsized":"2024-09-19T09:17:26.125604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61172,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":114,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994231+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:16:24.994231+0000","last_peered":"2024-09-19T09:16:24.994231+0000","last_clean":"2024-09-19T09:16:24.994231+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:16:24.994231+0000","last_undegraded":"2024-09-19T09:16:24.994231+0000","last_fullsized":"2024-09-19T09:16:24.994231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056195+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:16:36.056195+0000","last_peered":"2024-09-19T09:16:36.056195+0000","last_clean":"2024-09-19T09:16:36.056195+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:16:36.056195+0000","last_undegraded":"2024-09-19T09:16:36.056195+0000","last_fullsized":"2024-09-19T09:16:36.056195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982097+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:16:24.982097+0000","last_peered":"2024-09-19T09:16:24.982097+0000","last_clean":"2024-09-19T09:16:24.982097+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:16:24.982097+0000","last_undegraded":"2024-09-19T09:16:24.982097+0000","last_fullsized":"2024-09-19T09:16:24.982097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054355+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:16:35.054355+0000","last_peered":"2024-09-19T09:16:35.054355+0000","last_clean":"2024-09-19T09:16:35.054355+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:16:35.054355+0000","last_undegraded":"2024-09-19T09:16:35.054355+0000","last_fullsized":"2024-09-19T09:16:35.054355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997417+0000","last_change":"2024-09-19T09:16:23.991471+0000","last_active":"2024-09-19T09:16:24.997417+0000","last_peered":"2024-09-19T09:16:24.997417+0000","last_clean":"2024-09-19T09:16:24.997417+0000","last_became_active":"2024-09-19T09:16:23.991110+0000","last_became_peered":"2024-09-19T09:16:23.991110+0000","last_unstale":"2024-09-19T09:16:24.997417+0000","last_undegraded":"2024-09-19T09:16:24.997417+0000","last_fullsized":"2024-09-19T09:16:24.997417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:59.954737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:23.121448+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:17:23.121448+0000","last_peered":"2024-09-19T09:17:23.121448+0000","last_clean":"2024-09-19T09:17:23.121448+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:17:23.121448+0000","last_undegraded":"2024-09-19T09:17:23.121448+0000","last_fullsized":"2024-09-19T09:17:23.121448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997018+0000","last_change":"2024-09-19T09:16:23.991777+0000","last_active":"2024-09-19T09:16:24.997018+0000","last_peered":"2024-09-19T09:16:24.997018+0000","last_clean":"2024-09-19T09:16:24.997018+0000","last_became_active":"2024-09-19T09:16:23.991294+0000","last_became_peered":"2024-09-19T09:16:23.991294+0000","last_unstale":"2024-09-19T09:16:24.997018+0000","last_undegraded":"2024-09-19T09:16:24.997018+0000","last_fullsized":"2024-09-19T09:16:24.997018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:39.740855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052584+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:16:35.052584+0000","last_peered":"2024-09-19T09:16:35.052584+0000","last_clean":"2024-09-19T09:16:35.052584+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:16:35.052584+0000","last_undegraded":"2024-09-19T09:16:35.052584+0000","last_fullsized":"2024-09-19T09:16:35.052584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996749+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:16:24.996749+0000","last_peered":"2024-09-19T09:16:24.996749+0000","last_clean":"2024-09-19T09:16:24.996749+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:16:24.996749+0000","last_undegraded":"2024-09-19T09:16:24.996749+0000","last_fullsized":"2024-09-19T09:16:24.996749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.034597+0000","last_change":"2024-09-19T09:16:21.958901+0000","last_active":"2024-09-19T09:16:34.034597+0000","last_peered":"2024-09-19T09:16:34.034597+0000","last_clean":"2024-09-19T09:16:34.034597+0000","last_became_active":"2024-09-19T09:16:21.958453+0000","last_became_peered":"2024-09-19T09:16:21.958453+0000","last_unstale":"2024-09-19T09:16:34.034597+0000","last_undegraded":"2024-09-19T09:16:34.034597+0000","last_fullsized":"2024-09-19T09:16:34.034597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:34.681594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983304+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:16:24.983304+0000","last_peered":"2024-09-19T09:16:24.983304+0000","last_clean":"2024-09-19T09:16:24.983304+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:16:24.983304+0000","last_undegraded":"2024-09-19T09:16:24.983304+0000","last_fullsized":"2024-09-19T09:16:24.983304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.050741+0000","last_change":"2024-09-19T09:16:21.961069+0000","last_active":"2024-09-19T09:16:35.050741+0000","last_peered":"2024-09-19T09:16:35.050741+0000","last_clean":"2024-09-19T09:16:35.050741+0000","last_became_active":"2024-09-19T09:16:21.960766+0000","last_became_peered":"2024-09-19T09:16:21.960766+0000","last_unstale":"2024-09-19T09:16:35.050741+0000","last_undegraded":"2024-09-19T09:16:35.050741+0000","last_fullsized":"2024-09-19T09:16:35.050741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:43.410794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998719+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:16:24.998719+0000","last_peered":"2024-09-19T09:16:24.998719+0000","last_clean":"2024-09-19T09:16:24.998719+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:16:24.998719+0000","last_undegraded":"2024-09-19T09:16:24.998719+0000","last_fullsized":"2024-09-19T09:16:24.998719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053894+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:16:35.053894+0000","last_peered":"2024-09-19T09:16:35.053894+0000","last_clean":"2024-09-19T09:16:35.053894+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:16:35.053894+0000","last_undegraded":"2024-09-19T09:16:35.053894+0000","last_fullsized":"2024-09-19T09:16:35.053894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.702748+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:16:25.702748+0000","last_peered":"2024-09-19T09:16:25.702748+0000","last_clean":"2024-09-19T09:16:25.702748+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:16:25.702748+0000","last_undegraded":"2024-09-19T09:16:25.702748+0000","last_fullsized":"2024-09-19T09:16:25.702748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:23.122102+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:17:23.122102+0000","last_peered":"2024-09-19T09:17:23.122102+0000","last_clean":"2024-09-19T09:17:23.122102+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:17:23.122102+0000","last_undegraded":"2024-09-19T09:17:23.122102+0000","last_fullsized":"2024-09-19T09:17:23.122102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998903+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:16:24.998903+0000","last_peered":"2024-09-19T09:16:24.998903+0000","last_clean":"2024-09-19T09:16:24.998903+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:16:24.998903+0000","last_undegraded":"2024-09-19T09:16:24.998903+0000","last_fullsized":"2024-09-19T09:16:24.998903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997504+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:16:24.997504+0000","last_peered":"2024-09-19T09:16:24.997504+0000","last_clean":"2024-09-19T09:16:24.997504+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:16:24.997504+0000","last_undegraded":"2024-09-19T09:16:24.997504+0000","last_fullsized":"2024-09-19T09:16:24.997504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056230+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:16:36.056230+0000","last_peered":"2024-09-19T09:16:36.056230+0000","last_clean":"2024-09-19T09:16:36.056230+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:16:36.056230+0000","last_undegraded":"2024-09-19T09:16:36.056230+0000","last_fullsized":"2024-09-19T09:16:36.056230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994708+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:16:24.994708+0000","last_peered":"2024-09-19T09:16:24.994708+0000","last_clean":"2024-09-19T09:16:24.994708+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:16:24.994708+0000","last_undegraded":"2024-09-19T09:16:24.994708+0000","last_fullsized":"2024-09-19T09:16:24.994708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.037803+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:16:33.037803+0000","last_peered":"2024-09-19T09:16:33.037803+0000","last_clean":"2024-09-19T09:16:33.037803+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:16:33.037803+0000","last_undegraded":"2024-09-19T09:16:33.037803+0000","last_fullsized":"2024-09-19T09:16:33.037803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.981964+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:16:24.981964+0000","last_peered":"2024-09-19T09:16:24.981964+0000","last_clean":"2024-09-19T09:16:24.981964+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.981964+0000","last_undegraded":"2024-09-19T09:16:24.981964+0000","last_fullsized":"2024-09-19T09:16:24.981964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.122197+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:17:24.122197+0000","last_peered":"2024-09-19T09:17:24.122197+0000","last_clean":"2024-09-19T09:17:24.122197+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:17:24.122197+0000","last_undegraded":"2024-09-19T09:17:24.122197+0000","last_fullsized":"2024-09-19T09:17:24.122197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994334+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:16:24.994334+0000","last_peered":"2024-09-19T09:16:24.994334+0000","last_clean":"2024-09-19T09:16:24.994334+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:16:24.994334+0000","last_undegraded":"2024-09-19T09:16:24.994334+0000","last_fullsized":"2024-09-19T09:16:24.994334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.122768+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:17:24.122768+0000","last_peered":"2024-09-19T09:17:24.122768+0000","last_clean":"2024-09-19T09:17:24.122768+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:17:24.122768+0000","last_undegraded":"2024-09-19T09:17:24.122768+0000","last_fullsized":"2024-09-19T09:17:24.122768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983250+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:16:24.983250+0000","last_peered":"2024-09-19T09:16:24.983250+0000","last_clean":"2024-09-19T09:16:24.983250+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:16:24.983250+0000","last_undegraded":"2024-09-19T09:16:24.983250+0000","last_fullsized":"2024-09-19T09:16:24.983250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993764+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:16:24.993764+0000","last_peered":"2024-09-19T09:16:24.993764+0000","last_clean":"2024-09-19T09:16:24.993764+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:16:24.993764+0000","last_undegraded":"2024-09-19T09:16:24.993764+0000","last_fullsized":"2024-09-19T09:16:24.993764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:26.765577+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:16:26.765577+0000","last_peered":"2024-09-19T09:16:26.765577+0000","last_clean":"2024-09-19T09:16:26.765577+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:16:26.765577+0000","last_undegraded":"2024-09-19T09:16:26.765577+0000","last_fullsized":"2024-09-19T09:16:26.765577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052268+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:16:35.052268+0000","last_peered":"2024-09-19T09:16:35.052268+0000","last_clean":"2024-09-19T09:16:35.052268+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:16:35.052268+0000","last_undegraded":"2024-09-19T09:16:35.052268+0000","last_fullsized":"2024-09-19T09:16:35.052268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982441+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:16:24.982441+0000","last_peered":"2024-09-19T09:16:24.982441+0000","last_clean":"2024-09-19T09:16:24.982441+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:16:24.982441+0000","last_undegraded":"2024-09-19T09:16:24.982441+0000","last_fullsized":"2024-09-19T09:16:24.982441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:47.995056+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:16:47.995056+0000","last_peered":"2024-09-19T09:16:47.995056+0000","last_clean":"2024-09-19T09:16:47.995056+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:16:47.995056+0000","last_undegraded":"2024-09-19T09:16:47.995056+0000","last_fullsized":"2024-09-19T09:16:47.995056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994595+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:16:24.994595+0000","last_peered":"2024-09-19T09:16:24.994595+0000","last_clean":"2024-09-19T09:16:24.994595+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:16:24.994595+0000","last_undegraded":"2024-09-19T09:16:24.994595+0000","last_fullsized":"2024-09-19T09:16:24.994595+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052464+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:16:35.052464+0000","last_peered":"2024-09-19T09:16:35.052464+0000","last_clean":"2024-09-19T09:16:35.052464+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:16:35.052464+0000","last_undegraded":"2024-09-19T09:16:35.052464+0000","last_fullsized":"2024-09-19T09:16:35.052464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997305+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:16:24.997305+0000","last_peered":"2024-09-19T09:16:24.997305+0000","last_clean":"2024-09-19T09:16:24.997305+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:16:24.997305+0000","last_undegraded":"2024-09-19T09:16:24.997305+0000","last_fullsized":"2024-09-19T09:16:24.997305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032076+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:16:32.032076+0000","last_peered":"2024-09-19T09:16:32.032076+0000","last_clean":"2024-09-19T09:16:32.032076+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:16:32.032076+0000","last_undegraded":"2024-09-19T09:16:32.032076+0000","last_fullsized":"2024-09-19T09:16:32.032076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993788+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:16:24.993788+0000","last_peered":"2024-09-19T09:16:24.993788+0000","last_clean":"2024-09-19T09:16:24.993788+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:16:24.993788+0000","last_undegraded":"2024-09-19T09:16:24.993788+0000","last_fullsized":"2024-09-19T09:16:24.993788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054341+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:16:35.054341+0000","last_peered":"2024-09-19T09:16:35.054341+0000","last_clean":"2024-09-19T09:16:35.054341+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:16:35.054341+0000","last_undegraded":"2024-09-19T09:16:35.054341+0000","last_fullsized":"2024-09-19T09:16:35.054341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983173+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:16:24.983173+0000","last_peered":"2024-09-19T09:16:24.983173+0000","last_clean":"2024-09-19T09:16:24.983173+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:16:24.983173+0000","last_undegraded":"2024-09-19T09:16:24.983173+0000","last_fullsized":"2024-09-19T09:16:24.983173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046840+0000","last_change":"2024-09-19T09:16:21.963989+0000","last_active":"2024-09-19T09:16:34.046840+0000","last_peered":"2024-09-19T09:16:34.046840+0000","last_clean":"2024-09-19T09:16:34.046840+0000","last_became_active":"2024-09-19T09:16:21.962268+0000","last_became_peered":"2024-09-19T09:16:21.962268+0000","last_unstale":"2024-09-19T09:16:34.046840+0000","last_undegraded":"2024-09-19T09:16:34.046840+0000","last_fullsized":"2024-09-19T09:16:34.046840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:39.004909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994241+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:16:24.994241+0000","last_peered":"2024-09-19T09:16:24.994241+0000","last_clean":"2024-09-19T09:16:24.994241+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:16:24.994241+0000","last_undegraded":"2024-09-19T09:16:24.994241+0000","last_fullsized":"2024-09-19T09:16:24.994241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032039+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:16:32.032039+0000","last_peered":"2024-09-19T09:16:32.032039+0000","last_clean":"2024-09-19T09:16:32.032039+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:16:32.032039+0000","last_undegraded":"2024-09-19T09:16:32.032039+0000","last_fullsized":"2024-09-19T09:16:32.032039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997481+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:16:24.997481+0000","last_peered":"2024-09-19T09:16:24.997481+0000","last_clean":"2024-09-19T09:16:24.997481+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:16:24.997481+0000","last_undegraded":"2024-09-19T09:16:24.997481+0000","last_fullsized":"2024-09-19T09:16:24.997481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995288+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:16:24.995288+0000","last_peered":"2024-09-19T09:16:24.995288+0000","last_clean":"2024-09-19T09:16:24.995288+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:16:24.995288+0000","last_undegraded":"2024-09-19T09:16:24.995288+0000","last_fullsized":"2024-09-19T09:16:24.995288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053092+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:16:35.053092+0000","last_peered":"2024-09-19T09:16:35.053092+0000","last_clean":"2024-09-19T09:16:35.053092+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:16:35.053092+0000","last_undegraded":"2024-09-19T09:16:35.053092+0000","last_fullsized":"2024-09-19T09:16:35.053092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994626+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:16:24.994626+0000","last_peered":"2024-09-19T09:16:24.994626+0000","last_clean":"2024-09-19T09:16:24.994626+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:16:24.994626+0000","last_undegraded":"2024-09-19T09:16:24.994626+0000","last_fullsized":"2024-09-19T09:16:24.994626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.055951+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:16:36.055951+0000","last_peered":"2024-09-19T09:16:36.055951+0000","last_clean":"2024-09-19T09:16:36.055951+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:16:36.055951+0000","last_undegraded":"2024-09-19T09:16:36.055951+0000","last_fullsized":"2024-09-19T09:16:36.055951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996920+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:16:24.996920+0000","last_peered":"2024-09-19T09:16:24.996920+0000","last_clean":"2024-09-19T09:16:24.996920+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:16:24.996920+0000","last_undegraded":"2024-09-19T09:16:24.996920+0000","last_fullsized":"2024-09-19T09:16:24.996920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.000171+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:16:25.000171+0000","last_peered":"2024-09-19T09:16:25.000171+0000","last_clean":"2024-09-19T09:16:25.000171+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:16:25.000171+0000","last_undegraded":"2024-09-19T09:16:25.000171+0000","last_fullsized":"2024-09-19T09:16:25.000171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994481+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:16:24.994481+0000","last_peered":"2024-09-19T09:16:24.994481+0000","last_clean":"2024-09-19T09:16:24.994481+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:16:24.994481+0000","last_undegraded":"2024-09-19T09:16:24.994481+0000","last_fullsized":"2024-09-19T09:16:24.994481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:25.123741+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:17:25.123741+0000","last_peered":"2024-09-19T09:17:25.123741+0000","last_clean":"2024-09-19T09:17:25.123741+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:17:25.123741+0000","last_undegraded":"2024-09-19T09:17:25.123741+0000","last_fullsized":"2024-09-19T09:17:25.123741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68773,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":544,"num_read_kb":350,"num_write":244,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514522,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":431075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1082883,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1023903,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":430722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1023188,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":430190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":493420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":492807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":432061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:17:28.782 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:17:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:28 smithi115 ceph-mon[35055]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:28 smithi046 ceph-mon[31203]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:28.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:29.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:28 smithi099 ceph-mon[35256]: pgmap v311: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:29.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:29.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:29.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:17:29.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:17:29.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:17:29.061 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 -- 172.21.15.46:0/1840400422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 msgr2=0x7fdf5010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 --2- 172.21.15.46:0/1840400422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5010e610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009ca0 tx=0x7fdf4802a950 comp rx=0 tx=0).stop 2024-09-19T09:17:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 -- 172.21.15.46:0/1840400422 shutdown_connections 2024-09-19T09:17:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 --2- 172.21.15.46:0/1840400422 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5010e610 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 --2- 172.21.15.46:0/1840400422 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf50103660 0x7fdf5010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 --2- 172.21.15.46:0/1840400422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf50102d40 0x7fdf50103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 -- 172.21.15.46:0/1840400422 >> 172.21.15.46:0/1840400422 conn(0x7fdf500fc7a0 msgr2=0x7fdf500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 -- 172.21.15.46:0/1840400422 shutdown_connections 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 -- 172.21.15.46:0/1840400422 wait complete. 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.525+0000 7fdf558d5640 1 Processor -- start 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 -- start start 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf50102d40 0x7fdf50198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf50103660 0x7fdf50198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf50111f30 con 0x7fdf5010c170 2024-09-19T09:17:29.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdf50111db0 con 0x7fdf50103660 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf558d5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdf501120b0 con 0x7fdf50102d40 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57252/0 (socket says 172.21.15.46:57252) 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 -- 172.21.15.46:0/595136224 learned_addr learned my addr 172.21.15.46:0/595136224 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4e7fc640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf50103660 0x7fdf50198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4effd640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf50102d40 0x7fdf50198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 -- 172.21.15.46:0/595136224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf50102d40 msgr2=0x7fdf50198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf50102d40 0x7fdf50198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 -- 172.21.15.46:0/595136224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf50103660 msgr2=0x7fdf50198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:29.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf50103660 0x7fdf50198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.526+0000 7fdf4f7fe640 1 -- 172.21.15.46:0/595136224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5019d3f0 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.527+0000 7fdf4f7fe640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5019cd10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdf4802ae70 tx=0x7fdf4802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.527+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48034040 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.527+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5019d680 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.527+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf48030920 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.527+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48045480 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.527+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf501a4fc0 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.528+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf50103120 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.529+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdf48037020 con 0x7fdf5010c170 2024-09-19T09:17:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.530+0000 7fdf548d3640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf380a32d0 0x7fdf380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:29.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.530+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7979+0+0 (secure 0 0 0) 0x7fdf480f0750 con 0x7fdf5010c170 2024-09-19T09:17:29.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.530+0000 7fdf4effd640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf380a32d0 0x7fdf380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:29.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.530+0000 7fdf4effd640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf380a32d0 0x7fdf380a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000bbe0 tx=0x7fdf4000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:29.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.534+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf480bd4d0 con 0x7fdf5010c170 2024-09-19T09:17:29.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.713+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf50062630 con 0x7fdf380a32d0 2024-09-19T09:17:29.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.719+0000 7fdf548d3640 1 -- 172.21.15.46:0/595136224 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258845 (secure 0 0 0) 0x7fdf50062630 con 0x7fdf380a32d0 2024-09-19T09:17:29.723 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:29.724 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:17:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf380a32d0 msgr2=0x7fdf380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf380a32d0 0x7fdf380a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000bbe0 tx=0x7fdf4000b390 comp rx=0 tx=0).stop 2024-09-19T09:17:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 msgr2=0x7fdf5019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:29.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5019cd10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdf4802ae70 tx=0x7fdf4802f5b0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 shutdown_connections 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf380a32d0 0x7fdf380a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf5010c170 0x7fdf5019cd10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf50103660 0x7fdf50198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 --2- 172.21.15.46:0/595136224 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf50102d40 0x7fdf50198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 >> 172.21.15.46:0/595136224 conn(0x7fdf500fc7a0 msgr2=0x7fdf500fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:29.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 shutdown_connections 2024-09-19T09:17:29.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:29.722+0000 7fdf558d5640 1 -- 172.21.15.46:0/595136224 wait complete. 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T09:17:29.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:17:29.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T09:17:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T09:17:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T09:17:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-19T09:17:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T09:17:29.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T09:17:30.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-09-19T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]: dispatch 2024-09-19T09:17:30.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-09-19T09:17:30.014 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-19T09:17:30.369 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-19T09:17:29.697381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659375,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":670,"num_read_kb":459,"num_write":427,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":347904,"kb_used_data":11136,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593920,"statfs":{"total":1151940427776,"available":1151584174080,"internally_reserved":0,"allocated":11403264,"data_stored":7132005,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.732407"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983469+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:16:24.983469+0000","last_peered":"2024-09-19T09:16:24.983469+0000","last_clean":"2024-09-19T09:16:24.983469+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:16:24.983469+0000","last_undegraded":"2024-09-19T09:16:24.983469+0000","last_fullsized":"2024-09-19T09:16:24.983469+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997247+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:16:24.997247+0000","last_peered":"2024-09-19T09:16:24.997247+0000","last_clean":"2024-09-19T09:16:24.997247+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:16:24.997247+0000","last_undegraded":"2024-09-19T09:16:24.997247+0000","last_fullsized":"2024-09-19T09:16:24.997247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997082+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:16:24.997082+0000","last_peered":"2024-09-19T09:16:24.997082+0000","last_clean":"2024-09-19T09:16:24.997082+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.997082+0000","last_undegraded":"2024-09-19T09:16:24.997082+0000","last_fullsized":"2024-09-19T09:16:24.997082+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994665+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:16:24.994665+0000","last_peered":"2024-09-19T09:16:24.994665+0000","last_clean":"2024-09-19T09:16:24.994665+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:16:24.994665+0000","last_undegraded":"2024-09-19T09:16:24.994665+0000","last_fullsized":"2024-09-19T09:16:24.994665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999452+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:16:24.999452+0000","last_peered":"2024-09-19T09:16:24.999452+0000","last_clean":"2024-09-19T09:16:24.999452+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:16:24.999452+0000","last_undegraded":"2024-09-19T09:16:24.999452+0000","last_fullsized":"2024-09-19T09:16:24.999452+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983035+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:16:24.983035+0000","last_peered":"2024-09-19T09:16:24.983035+0000","last_clean":"2024-09-19T09:16:24.983035+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:16:24.983035+0000","last_undegraded":"2024-09-19T09:16:24.983035+0000","last_fullsized":"2024-09-19T09:16:24.983035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997278+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:16:24.997278+0000","last_peered":"2024-09-19T09:16:24.997278+0000","last_clean":"2024-09-19T09:16:24.997278+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:16:24.997278+0000","last_undegraded":"2024-09-19T09:16:24.997278+0000","last_fullsized":"2024-09-19T09:16:24.997278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993833+0000","last_change":"2024-09-19T09:16:23.990830+0000","last_active":"2024-09-19T09:16:24.993833+0000","last_peered":"2024-09-19T09:16:24.993833+0000","last_clean":"2024-09-19T09:16:24.993833+0000","last_became_active":"2024-09-19T09:16:23.990551+0000","last_became_peered":"2024-09-19T09:16:23.990551+0000","last_unstale":"2024-09-19T09:16:24.993833+0000","last_undegraded":"2024-09-19T09:16:24.993833+0000","last_fullsized":"2024-09-19T09:16:24.993833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:06.420267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995195+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:16:24.995195+0000","last_peered":"2024-09-19T09:16:24.995195+0000","last_clean":"2024-09-19T09:16:24.995195+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:16:24.995195+0000","last_undegraded":"2024-09-19T09:16:24.995195+0000","last_fullsized":"2024-09-19T09:16:24.995195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983440+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:16:24.983440+0000","last_peered":"2024-09-19T09:16:24.983440+0000","last_clean":"2024-09-19T09:16:24.983440+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:16:24.983440+0000","last_undegraded":"2024-09-19T09:16:24.983440+0000","last_fullsized":"2024-09-19T09:16:24.983440+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998697+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:16:24.998697+0000","last_peered":"2024-09-19T09:16:24.998697+0000","last_clean":"2024-09-19T09:16:24.998697+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:16:24.998697+0000","last_undegraded":"2024-09-19T09:16:24.998697+0000","last_fullsized":"2024-09-19T09:16:24.998697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994817+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:16:24.994817+0000","last_peered":"2024-09-19T09:16:24.994817+0000","last_clean":"2024-09-19T09:16:24.994817+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:16:24.994817+0000","last_undegraded":"2024-09-19T09:16:24.994817+0000","last_fullsized":"2024-09-19T09:16:24.994817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982364+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:16:24.982364+0000","last_peered":"2024-09-19T09:16:24.982364+0000","last_clean":"2024-09-19T09:16:24.982364+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:16:24.982364+0000","last_undegraded":"2024-09-19T09:16:24.982364+0000","last_fullsized":"2024-09-19T09:16:24.982364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997004+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:16:24.997004+0000","last_peered":"2024-09-19T09:16:24.997004+0000","last_clean":"2024-09-19T09:16:24.997004+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:16:24.997004+0000","last_undegraded":"2024-09-19T09:16:24.997004+0000","last_fullsized":"2024-09-19T09:16:24.997004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996593+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:16:24.996593+0000","last_peered":"2024-09-19T09:16:24.996593+0000","last_clean":"2024-09-19T09:16:24.996593+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:16:24.996593+0000","last_undegraded":"2024-09-19T09:16:24.996593+0000","last_fullsized":"2024-09-19T09:16:24.996593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994114+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:16:24.994114+0000","last_peered":"2024-09-19T09:16:24.994114+0000","last_clean":"2024-09-19T09:16:24.994114+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:16:24.994114+0000","last_undegraded":"2024-09-19T09:16:24.994114+0000","last_fullsized":"2024-09-19T09:16:24.994114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983416+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:16:24.983416+0000","last_peered":"2024-09-19T09:16:24.983416+0000","last_clean":"2024-09-19T09:16:24.983416+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:16:24.983416+0000","last_undegraded":"2024-09-19T09:16:24.983416+0000","last_fullsized":"2024-09-19T09:16:24.983416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994115+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:16:24.994115+0000","last_peered":"2024-09-19T09:16:24.994115+0000","last_clean":"2024-09-19T09:16:24.994115+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:16:24.994115+0000","last_undegraded":"2024-09-19T09:16:24.994115+0000","last_fullsized":"2024-09-19T09:16:24.994115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998941+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:16:24.998941+0000","last_peered":"2024-09-19T09:16:24.998941+0000","last_clean":"2024-09-19T09:16:24.998941+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:16:24.998941+0000","last_undegraded":"2024-09-19T09:16:24.998941+0000","last_fullsized":"2024-09-19T09:16:24.998941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983110+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:16:24.983110+0000","last_peered":"2024-09-19T09:16:24.983110+0000","last_clean":"2024-09-19T09:16:24.983110+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:16:24.983110+0000","last_undegraded":"2024-09-19T09:16:24.983110+0000","last_fullsized":"2024-09-19T09:16:24.983110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982389+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:16:24.982389+0000","last_peered":"2024-09-19T09:16:24.982389+0000","last_clean":"2024-09-19T09:16:24.982389+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:16:24.982389+0000","last_undegraded":"2024-09-19T09:16:24.982389+0000","last_fullsized":"2024-09-19T09:16:24.982389+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994839+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:16:24.994839+0000","last_peered":"2024-09-19T09:16:24.994839+0000","last_clean":"2024-09-19T09:16:24.994839+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:16:24.994839+0000","last_undegraded":"2024-09-19T09:16:24.994839+0000","last_fullsized":"2024-09-19T09:16:24.994839+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994841+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:16:24.994841+0000","last_peered":"2024-09-19T09:16:24.994841+0000","last_clean":"2024-09-19T09:16:24.994841+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:16:24.994841+0000","last_undegraded":"2024-09-19T09:16:24.994841+0000","last_fullsized":"2024-09-19T09:16:24.994841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994171+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:16:24.994171+0000","last_peered":"2024-09-19T09:16:24.994171+0000","last_clean":"2024-09-19T09:16:24.994171+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:16:24.994171+0000","last_undegraded":"2024-09-19T09:16:24.994171+0000","last_fullsized":"2024-09-19T09:16:24.994171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994413+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:16:24.994413+0000","last_peered":"2024-09-19T09:16:24.994413+0000","last_clean":"2024-09-19T09:16:24.994413+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:16:24.994413+0000","last_undegraded":"2024-09-19T09:16:24.994413+0000","last_fullsized":"2024-09-19T09:16:24.994413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997932+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:16:24.997932+0000","last_peered":"2024-09-19T09:16:24.997932+0000","last_clean":"2024-09-19T09:16:24.997932+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:16:24.997932+0000","last_undegraded":"2024-09-19T09:16:24.997932+0000","last_fullsized":"2024-09-19T09:16:24.997932+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983394+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:16:24.983394+0000","last_peered":"2024-09-19T09:16:24.983394+0000","last_clean":"2024-09-19T09:16:24.983394+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:16:24.983394+0000","last_undegraded":"2024-09-19T09:16:24.983394+0000","last_fullsized":"2024-09-19T09:16:24.983394+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982293+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:16:24.982293+0000","last_peered":"2024-09-19T09:16:24.982293+0000","last_clean":"2024-09-19T09:16:24.982293+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:16:24.982293+0000","last_undegraded":"2024-09-19T09:16:24.982293+0000","last_fullsized":"2024-09-19T09:16:24.982293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996897+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:16:24.996897+0000","last_peered":"2024-09-19T09:16:24.996897+0000","last_clean":"2024-09-19T09:16:24.996897+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:16:24.996897+0000","last_undegraded":"2024-09-19T09:16:24.996897+0000","last_fullsized":"2024-09-19T09:16:24.996897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998367+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:16:24.998367+0000","last_peered":"2024-09-19T09:16:24.998367+0000","last_clean":"2024-09-19T09:16:24.998367+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:16:24.998367+0000","last_undegraded":"2024-09-19T09:16:24.998367+0000","last_fullsized":"2024-09-19T09:16:24.998367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.999424+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:16:24.999424+0000","last_peered":"2024-09-19T09:16:24.999424+0000","last_clean":"2024-09-19T09:16:24.999424+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:16:24.999424+0000","last_undegraded":"2024-09-19T09:16:24.999424+0000","last_fullsized":"2024-09-19T09:16:24.999424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983090+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:16:24.983090+0000","last_peered":"2024-09-19T09:16:24.983090+0000","last_clean":"2024-09-19T09:16:24.983090+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:16:24.983090+0000","last_undegraded":"2024-09-19T09:16:24.983090+0000","last_fullsized":"2024-09-19T09:16:24.983090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994599+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:16:24.994599+0000","last_peered":"2024-09-19T09:16:24.994599+0000","last_clean":"2024-09-19T09:16:24.994599+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:16:24.994599+0000","last_undegraded":"2024-09-19T09:16:24.994599+0000","last_fullsized":"2024-09-19T09:16:24.994599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:23.122177+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:17:23.122177+0000","last_peered":"2024-09-19T09:17:23.122177+0000","last_clean":"2024-09-19T09:17:23.122177+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:17:23.122177+0000","last_undegraded":"2024-09-19T09:17:23.122177+0000","last_fullsized":"2024-09-19T09:17:23.122177+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994055+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:16:24.994055+0000","last_peered":"2024-09-19T09:16:24.994055+0000","last_clean":"2024-09-19T09:16:24.994055+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:16:24.994055+0000","last_undegraded":"2024-09-19T09:16:24.994055+0000","last_fullsized":"2024-09-19T09:16:24.994055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046259+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:16:34.046259+0000","last_peered":"2024-09-19T09:16:34.046259+0000","last_clean":"2024-09-19T09:16:34.046259+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:16:34.046259+0000","last_undegraded":"2024-09-19T09:16:34.046259+0000","last_fullsized":"2024-09-19T09:16:34.046259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.038532+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:16:33.038532+0000","last_peered":"2024-09-19T09:16:33.038532+0000","last_clean":"2024-09-19T09:16:33.038532+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:16:33.038532+0000","last_undegraded":"2024-09-19T09:16:33.038532+0000","last_fullsized":"2024-09-19T09:16:33.038532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993874+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:16:24.993874+0000","last_peered":"2024-09-19T09:16:24.993874+0000","last_clean":"2024-09-19T09:16:24.993874+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:16:24.993874+0000","last_undegraded":"2024-09-19T09:16:24.993874+0000","last_fullsized":"2024-09-19T09:16:24.993874+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054421+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:16:35.054421+0000","last_peered":"2024-09-19T09:16:35.054421+0000","last_clean":"2024-09-19T09:16:35.054421+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:16:35.054421+0000","last_undegraded":"2024-09-19T09:16:35.054421+0000","last_fullsized":"2024-09-19T09:16:35.054421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993648+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:16:24.993648+0000","last_peered":"2024-09-19T09:16:24.993648+0000","last_clean":"2024-09-19T09:16:24.993648+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:16:24.993648+0000","last_undegraded":"2024-09-19T09:16:24.993648+0000","last_fullsized":"2024-09-19T09:16:24.993648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:26.125869+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:17:26.125869+0000","last_peered":"2024-09-19T09:17:26.125869+0000","last_clean":"2024-09-19T09:17:26.125869+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:17:26.125869+0000","last_undegraded":"2024-09-19T09:17:26.125869+0000","last_fullsized":"2024-09-19T09:17:26.125869+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994939+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:16:24.994939+0000","last_peered":"2024-09-19T09:16:24.994939+0000","last_clean":"2024-09-19T09:16:24.994939+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:16:24.994939+0000","last_undegraded":"2024-09-19T09:16:24.994939+0000","last_fullsized":"2024-09-19T09:16:24.994939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052926+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:16:35.052926+0000","last_peered":"2024-09-19T09:16:35.052926+0000","last_clean":"2024-09-19T09:16:35.052926+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:16:35.052926+0000","last_undegraded":"2024-09-19T09:16:35.052926+0000","last_fullsized":"2024-09-19T09:16:35.052926+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997081+0000","last_change":"2024-09-19T09:16:23.987959+0000","last_active":"2024-09-19T09:16:24.997081+0000","last_peered":"2024-09-19T09:16:24.997081+0000","last_clean":"2024-09-19T09:16:24.997081+0000","last_became_active":"2024-09-19T09:16:23.987676+0000","last_became_peered":"2024-09-19T09:16:23.987676+0000","last_unstale":"2024-09-19T09:16:24.997081+0000","last_undegraded":"2024-09-19T09:16:24.997081+0000","last_fullsized":"2024-09-19T09:16:24.997081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:15.057290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046182+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:16:34.046182+0000","last_peered":"2024-09-19T09:16:34.046182+0000","last_clean":"2024-09-19T09:16:34.046182+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:16:34.046182+0000","last_undegraded":"2024-09-19T09:16:34.046182+0000","last_fullsized":"2024-09-19T09:16:34.046182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994911+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:16:24.994911+0000","last_peered":"2024-09-19T09:16:24.994911+0000","last_clean":"2024-09-19T09:16:24.994911+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:16:24.994911+0000","last_undegraded":"2024-09-19T09:16:24.994911+0000","last_fullsized":"2024-09-19T09:16:24.994911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'31","reported_seq":160,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:26.125604+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:17:26.125604+0000","last_peered":"2024-09-19T09:17:26.125604+0000","last_clean":"2024-09-19T09:17:26.125604+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:17:26.125604+0000","last_undegraded":"2024-09-19T09:17:26.125604+0000","last_fullsized":"2024-09-19T09:17:26.125604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61172,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":114,"num_write":33,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994231+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:16:24.994231+0000","last_peered":"2024-09-19T09:16:24.994231+0000","last_clean":"2024-09-19T09:16:24.994231+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:16:24.994231+0000","last_undegraded":"2024-09-19T09:16:24.994231+0000","last_fullsized":"2024-09-19T09:16:24.994231+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056195+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:16:36.056195+0000","last_peered":"2024-09-19T09:16:36.056195+0000","last_clean":"2024-09-19T09:16:36.056195+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:16:36.056195+0000","last_undegraded":"2024-09-19T09:16:36.056195+0000","last_fullsized":"2024-09-19T09:16:36.056195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982097+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:16:24.982097+0000","last_peered":"2024-09-19T09:16:24.982097+0000","last_clean":"2024-09-19T09:16:24.982097+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:16:24.982097+0000","last_undegraded":"2024-09-19T09:16:24.982097+0000","last_fullsized":"2024-09-19T09:16:24.982097+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054355+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:16:35.054355+0000","last_peered":"2024-09-19T09:16:35.054355+0000","last_clean":"2024-09-19T09:16:35.054355+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:16:35.054355+0000","last_undegraded":"2024-09-19T09:16:35.054355+0000","last_fullsized":"2024-09-19T09:16:35.054355+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997417+0000","last_change":"2024-09-19T09:16:23.991471+0000","last_active":"2024-09-19T09:16:24.997417+0000","last_peered":"2024-09-19T09:16:24.997417+0000","last_clean":"2024-09-19T09:16:24.997417+0000","last_became_active":"2024-09-19T09:16:23.991110+0000","last_became_peered":"2024-09-19T09:16:23.991110+0000","last_unstale":"2024-09-19T09:16:24.997417+0000","last_undegraded":"2024-09-19T09:16:24.997417+0000","last_fullsized":"2024-09-19T09:16:24.997417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:59.954737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:23.121448+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:17:23.121448+0000","last_peered":"2024-09-19T09:17:23.121448+0000","last_clean":"2024-09-19T09:17:23.121448+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:17:23.121448+0000","last_undegraded":"2024-09-19T09:17:23.121448+0000","last_fullsized":"2024-09-19T09:17:23.121448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997018+0000","last_change":"2024-09-19T09:16:23.991777+0000","last_active":"2024-09-19T09:16:24.997018+0000","last_peered":"2024-09-19T09:16:24.997018+0000","last_clean":"2024-09-19T09:16:24.997018+0000","last_became_active":"2024-09-19T09:16:23.991294+0000","last_became_peered":"2024-09-19T09:16:23.991294+0000","last_unstale":"2024-09-19T09:16:24.997018+0000","last_undegraded":"2024-09-19T09:16:24.997018+0000","last_fullsized":"2024-09-19T09:16:24.997018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:39.740855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052584+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:16:35.052584+0000","last_peered":"2024-09-19T09:16:35.052584+0000","last_clean":"2024-09-19T09:16:35.052584+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:16:35.052584+0000","last_undegraded":"2024-09-19T09:16:35.052584+0000","last_fullsized":"2024-09-19T09:16:35.052584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996749+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:16:24.996749+0000","last_peered":"2024-09-19T09:16:24.996749+0000","last_clean":"2024-09-19T09:16:24.996749+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:16:24.996749+0000","last_undegraded":"2024-09-19T09:16:24.996749+0000","last_fullsized":"2024-09-19T09:16:24.996749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.034597+0000","last_change":"2024-09-19T09:16:21.958901+0000","last_active":"2024-09-19T09:16:34.034597+0000","last_peered":"2024-09-19T09:16:34.034597+0000","last_clean":"2024-09-19T09:16:34.034597+0000","last_became_active":"2024-09-19T09:16:21.958453+0000","last_became_peered":"2024-09-19T09:16:21.958453+0000","last_unstale":"2024-09-19T09:16:34.034597+0000","last_undegraded":"2024-09-19T09:16:34.034597+0000","last_fullsized":"2024-09-19T09:16:34.034597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:34.681594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983304+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:16:24.983304+0000","last_peered":"2024-09-19T09:16:24.983304+0000","last_clean":"2024-09-19T09:16:24.983304+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:16:24.983304+0000","last_undegraded":"2024-09-19T09:16:24.983304+0000","last_fullsized":"2024-09-19T09:16:24.983304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.050741+0000","last_change":"2024-09-19T09:16:21.961069+0000","last_active":"2024-09-19T09:16:35.050741+0000","last_peered":"2024-09-19T09:16:35.050741+0000","last_clean":"2024-09-19T09:16:35.050741+0000","last_became_active":"2024-09-19T09:16:21.960766+0000","last_became_peered":"2024-09-19T09:16:21.960766+0000","last_unstale":"2024-09-19T09:16:35.050741+0000","last_undegraded":"2024-09-19T09:16:35.050741+0000","last_fullsized":"2024-09-19T09:16:35.050741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:43.410794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998719+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:16:24.998719+0000","last_peered":"2024-09-19T09:16:24.998719+0000","last_clean":"2024-09-19T09:16:24.998719+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:16:24.998719+0000","last_undegraded":"2024-09-19T09:16:24.998719+0000","last_fullsized":"2024-09-19T09:16:24.998719+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053894+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:16:35.053894+0000","last_peered":"2024-09-19T09:16:35.053894+0000","last_clean":"2024-09-19T09:16:35.053894+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:16:35.053894+0000","last_undegraded":"2024-09-19T09:16:35.053894+0000","last_fullsized":"2024-09-19T09:16:35.053894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.702748+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:16:25.702748+0000","last_peered":"2024-09-19T09:16:25.702748+0000","last_clean":"2024-09-19T09:16:25.702748+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:16:25.702748+0000","last_undegraded":"2024-09-19T09:16:25.702748+0000","last_fullsized":"2024-09-19T09:16:25.702748+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:23.122102+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:17:23.122102+0000","last_peered":"2024-09-19T09:17:23.122102+0000","last_clean":"2024-09-19T09:17:23.122102+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:17:23.122102+0000","last_undegraded":"2024-09-19T09:17:23.122102+0000","last_fullsized":"2024-09-19T09:17:23.122102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.998903+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:16:24.998903+0000","last_peered":"2024-09-19T09:16:24.998903+0000","last_clean":"2024-09-19T09:16:24.998903+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:16:24.998903+0000","last_undegraded":"2024-09-19T09:16:24.998903+0000","last_fullsized":"2024-09-19T09:16:24.998903+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":333,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997504+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:16:24.997504+0000","last_peered":"2024-09-19T09:16:24.997504+0000","last_clean":"2024-09-19T09:16:24.997504+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:16:24.997504+0000","last_undegraded":"2024-09-19T09:16:24.997504+0000","last_fullsized":"2024-09-19T09:16:24.997504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.056230+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:16:36.056230+0000","last_peered":"2024-09-19T09:16:36.056230+0000","last_clean":"2024-09-19T09:16:36.056230+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:16:36.056230+0000","last_undegraded":"2024-09-19T09:16:36.056230+0000","last_fullsized":"2024-09-19T09:16:36.056230+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994708+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:16:24.994708+0000","last_peered":"2024-09-19T09:16:24.994708+0000","last_clean":"2024-09-19T09:16:24.994708+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:16:24.994708+0000","last_undegraded":"2024-09-19T09:16:24.994708+0000","last_fullsized":"2024-09-19T09:16:24.994708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:33.037803+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:16:33.037803+0000","last_peered":"2024-09-19T09:16:33.037803+0000","last_clean":"2024-09-19T09:16:33.037803+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:16:33.037803+0000","last_undegraded":"2024-09-19T09:16:33.037803+0000","last_fullsized":"2024-09-19T09:16:33.037803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.981964+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:16:24.981964+0000","last_peered":"2024-09-19T09:16:24.981964+0000","last_clean":"2024-09-19T09:16:24.981964+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:16:24.981964+0000","last_undegraded":"2024-09-19T09:16:24.981964+0000","last_fullsized":"2024-09-19T09:16:24.981964+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":74,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.122197+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:17:24.122197+0000","last_peered":"2024-09-19T09:17:24.122197+0000","last_clean":"2024-09-19T09:17:24.122197+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:17:24.122197+0000","last_undegraded":"2024-09-19T09:17:24.122197+0000","last_fullsized":"2024-09-19T09:17:24.122197+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994334+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:16:24.994334+0000","last_peered":"2024-09-19T09:16:24.994334+0000","last_clean":"2024-09-19T09:16:24.994334+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:16:24.994334+0000","last_undegraded":"2024-09-19T09:16:24.994334+0000","last_fullsized":"2024-09-19T09:16:24.994334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":76,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.122768+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:17:24.122768+0000","last_peered":"2024-09-19T09:17:24.122768+0000","last_clean":"2024-09-19T09:17:24.122768+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:17:24.122768+0000","last_undegraded":"2024-09-19T09:17:24.122768+0000","last_fullsized":"2024-09-19T09:17:24.122768+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983250+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:16:24.983250+0000","last_peered":"2024-09-19T09:16:24.983250+0000","last_clean":"2024-09-19T09:16:24.983250+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:16:24.983250+0000","last_undegraded":"2024-09-19T09:16:24.983250+0000","last_fullsized":"2024-09-19T09:16:24.983250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993764+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:16:24.993764+0000","last_peered":"2024-09-19T09:16:24.993764+0000","last_clean":"2024-09-19T09:16:24.993764+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:16:24.993764+0000","last_undegraded":"2024-09-19T09:16:24.993764+0000","last_fullsized":"2024-09-19T09:16:24.993764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:26.765577+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:16:26.765577+0000","last_peered":"2024-09-19T09:16:26.765577+0000","last_clean":"2024-09-19T09:16:26.765577+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:16:26.765577+0000","last_undegraded":"2024-09-19T09:16:26.765577+0000","last_fullsized":"2024-09-19T09:16:26.765577+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052268+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:16:35.052268+0000","last_peered":"2024-09-19T09:16:35.052268+0000","last_clean":"2024-09-19T09:16:35.052268+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:16:35.052268+0000","last_undegraded":"2024-09-19T09:16:35.052268+0000","last_fullsized":"2024-09-19T09:16:35.052268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.982441+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:16:24.982441+0000","last_peered":"2024-09-19T09:16:24.982441+0000","last_clean":"2024-09-19T09:16:24.982441+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:16:24.982441+0000","last_undegraded":"2024-09-19T09:16:24.982441+0000","last_fullsized":"2024-09-19T09:16:24.982441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'14","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:47.995056+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:16:47.995056+0000","last_peered":"2024-09-19T09:16:47.995056+0000","last_clean":"2024-09-19T09:16:47.995056+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:16:47.995056+0000","last_undegraded":"2024-09-19T09:16:47.995056+0000","last_fullsized":"2024-09-19T09:16:47.995056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994595+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:16:24.994595+0000","last_peered":"2024-09-19T09:16:24.994595+0000","last_clean":"2024-09-19T09:16:24.994595+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:16:24.994595+0000","last_undegraded":"2024-09-19T09:16:24.994595+0000","last_fullsized":"2024-09-19T09:16:24.994595+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.052464+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:16:35.052464+0000","last_peered":"2024-09-19T09:16:35.052464+0000","last_clean":"2024-09-19T09:16:35.052464+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:16:35.052464+0000","last_undegraded":"2024-09-19T09:16:35.052464+0000","last_fullsized":"2024-09-19T09:16:35.052464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997305+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:16:24.997305+0000","last_peered":"2024-09-19T09:16:24.997305+0000","last_clean":"2024-09-19T09:16:24.997305+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:16:24.997305+0000","last_undegraded":"2024-09-19T09:16:24.997305+0000","last_fullsized":"2024-09-19T09:16:24.997305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032076+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:16:32.032076+0000","last_peered":"2024-09-19T09:16:32.032076+0000","last_clean":"2024-09-19T09:16:32.032076+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:16:32.032076+0000","last_undegraded":"2024-09-19T09:16:32.032076+0000","last_fullsized":"2024-09-19T09:16:32.032076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.993788+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:16:24.993788+0000","last_peered":"2024-09-19T09:16:24.993788+0000","last_clean":"2024-09-19T09:16:24.993788+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:16:24.993788+0000","last_undegraded":"2024-09-19T09:16:24.993788+0000","last_fullsized":"2024-09-19T09:16:24.993788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.054341+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:16:35.054341+0000","last_peered":"2024-09-19T09:16:35.054341+0000","last_clean":"2024-09-19T09:16:35.054341+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:16:35.054341+0000","last_undegraded":"2024-09-19T09:16:35.054341+0000","last_fullsized":"2024-09-19T09:16:35.054341+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.983173+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:16:24.983173+0000","last_peered":"2024-09-19T09:16:24.983173+0000","last_clean":"2024-09-19T09:16:24.983173+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:16:24.983173+0000","last_undegraded":"2024-09-19T09:16:24.983173+0000","last_fullsized":"2024-09-19T09:16:24.983173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:34.046840+0000","last_change":"2024-09-19T09:16:21.963989+0000","last_active":"2024-09-19T09:16:34.046840+0000","last_peered":"2024-09-19T09:16:34.046840+0000","last_clean":"2024-09-19T09:16:34.046840+0000","last_became_active":"2024-09-19T09:16:21.962268+0000","last_became_peered":"2024-09-19T09:16:21.962268+0000","last_unstale":"2024-09-19T09:16:34.046840+0000","last_undegraded":"2024-09-19T09:16:34.046840+0000","last_fullsized":"2024-09-19T09:16:34.046840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:39.004909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994241+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:16:24.994241+0000","last_peered":"2024-09-19T09:16:24.994241+0000","last_clean":"2024-09-19T09:16:24.994241+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:16:24.994241+0000","last_undegraded":"2024-09-19T09:16:24.994241+0000","last_fullsized":"2024-09-19T09:16:24.994241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:32.032039+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:16:32.032039+0000","last_peered":"2024-09-19T09:16:32.032039+0000","last_clean":"2024-09-19T09:16:32.032039+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:16:32.032039+0000","last_undegraded":"2024-09-19T09:16:32.032039+0000","last_fullsized":"2024-09-19T09:16:32.032039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.997481+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:16:24.997481+0000","last_peered":"2024-09-19T09:16:24.997481+0000","last_clean":"2024-09-19T09:16:24.997481+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:16:24.997481+0000","last_undegraded":"2024-09-19T09:16:24.997481+0000","last_fullsized":"2024-09-19T09:16:24.997481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.995288+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:16:24.995288+0000","last_peered":"2024-09-19T09:16:24.995288+0000","last_clean":"2024-09-19T09:16:24.995288+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:16:24.995288+0000","last_undegraded":"2024-09-19T09:16:24.995288+0000","last_fullsized":"2024-09-19T09:16:24.995288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:35.053092+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:16:35.053092+0000","last_peered":"2024-09-19T09:16:35.053092+0000","last_clean":"2024-09-19T09:16:35.053092+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:16:35.053092+0000","last_undegraded":"2024-09-19T09:16:35.053092+0000","last_fullsized":"2024-09-19T09:16:35.053092+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994626+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:16:24.994626+0000","last_peered":"2024-09-19T09:16:24.994626+0000","last_clean":"2024-09-19T09:16:24.994626+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:16:24.994626+0000","last_undegraded":"2024-09-19T09:16:24.994626+0000","last_fullsized":"2024-09-19T09:16:24.994626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:36.055951+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:16:36.055951+0000","last_peered":"2024-09-19T09:16:36.055951+0000","last_clean":"2024-09-19T09:16:36.055951+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:16:36.055951+0000","last_undegraded":"2024-09-19T09:16:36.055951+0000","last_fullsized":"2024-09-19T09:16:36.055951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.996920+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:16:24.996920+0000","last_peered":"2024-09-19T09:16:24.996920+0000","last_clean":"2024-09-19T09:16:24.996920+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:16:24.996920+0000","last_undegraded":"2024-09-19T09:16:24.996920+0000","last_fullsized":"2024-09-19T09:16:24.996920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:25.000171+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:16:25.000171+0000","last_peered":"2024-09-19T09:16:25.000171+0000","last_clean":"2024-09-19T09:16:25.000171+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:16:25.000171+0000","last_undegraded":"2024-09-19T09:16:25.000171+0000","last_fullsized":"2024-09-19T09:16:25.000171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:16:24.994481+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:16:24.994481+0000","last_peered":"2024-09-19T09:16:24.994481+0000","last_clean":"2024-09-19T09:16:24.994481+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:16:24.994481+0000","last_undegraded":"2024-09-19T09:16:24.994481+0000","last_fullsized":"2024-09-19T09:16:24.994481+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":83,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:17:25.123741+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:17:25.123741+0000","last_peered":"2024-09-19T09:17:25.123741+0000","last_clean":"2024-09-19T09:17:25.123741+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:17:25.123741+0000","last_undegraded":"2024-09-19T09:17:25.123741+0000","last_fullsized":"2024-09-19T09:17:25.123741+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68773,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":544,"num_read_kb":350,"num_write":244,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514523,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":431075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":1082883,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":430990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":1023903,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593779,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":430722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1023188,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":430190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":430154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":493420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":492807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":432061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":63930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:17:30.373 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:17:30.373 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:17:30.374 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:17:30.374 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:17:30.635 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:17:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:30 smithi115 ceph-mon[35055]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-19T09:17:30.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T09:17:30.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T09:17:30.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:17:30.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:30 smithi046 ceph-mon[31203]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:17:31.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:17:31.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:30 smithi099 ceph-mon[35256]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1958113053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 msgr2=0x7fd8b4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1958113053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b4103120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4009900 tx=0x7fd8a402a480 comp rx=0 tx=0).stop 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1958113053 shutdown_connections 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1958113053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b410c170 0x7fd8b410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1958113053 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b4103660 0x7fd8b410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1958113053 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b4103120 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1958113053 >> 172.21.15.46:0/1958113053 conn(0x7fd8b40fc7a0 msgr2=0x7fd8b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:31.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1958113053 shutdown_connections 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1958113053 wait complete. 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.109+0000 7fd8ba5cf640 1 Processor -- start 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 -- start start 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b4103660 0x7fd8b4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b410c170 0x7fd8b4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b4111f70 con 0x7fd8b4102d40 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b4111df0 con 0x7fd8b4103660 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8ba5cf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b41120f0 con 0x7fd8b410c170 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57280/0 (socket says 172.21.15.46:57280) 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 -- 172.21.15.46:0/1563133310 learned_addr learned my addr 172.21.15.46:0/1563133310 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b37fe640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b4103660 0x7fd8b4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b8b6c640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b410c170 0x7fd8b4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 -- 172.21.15.46:0/1563133310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b410c170 msgr2=0x7fd8b4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b410c170 0x7fd8b4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 -- 172.21.15.46:0/1563133310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b4103660 msgr2=0x7fd8b4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b4103660 0x7fd8b4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b3fff640 1 -- 172.21.15.46:0/1563133310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b41a6930 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.110+0000 7fd8b37fe640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b4103660 0x7fd8b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.111+0000 7fd8b3fff640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b41009a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4006010 tx=0x7fd8a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.111+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a403f030 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.111+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8a4003ce0 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.111+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4035070 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.111+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b41a6bc0 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.111+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b41a70f0 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.112+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b4103120 con 0x7fd8b4102d40 2024-09-19T09:17:31.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.113+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd8a4042030 con 0x7fd8b4102d40 2024-09-19T09:17:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.114+0000 7fd8b17fa640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd89c0a3350 0x7fd89c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.114+0000 7fd8b37fe640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd89c0a3350 0x7fd89c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.114+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd8a40f0040 con 0x7fd8b4102d40 2024-09-19T09:17:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.114+0000 7fd8b37fe640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd89c0a3350 0x7fd89c0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8005fd0 tx=0x7fd8a8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:31.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.118+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8a40bcc90 con 0x7fd8b4102d40 2024-09-19T09:17:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.331+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8b41071e0 con 0x7fd8b4102d40 2024-09-19T09:17:31.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.332+0000 7fd8b17fa640 1 -- 172.21.15.46:0/1563133310 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd8a40bc590 con 0x7fd8b4102d40 2024-09-19T09:17:31.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:31.345 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:17:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd89c0a3350 msgr2=0x7fd89c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd89c0a3350 0x7fd89c0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8005fd0 tx=0x7fd8a8005850 comp rx=0 tx=0).stop 2024-09-19T09:17:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 msgr2=0x7fd8b41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b41009a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4006010 tx=0x7fd8a40042f0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 shutdown_connections 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd89c0a3350 0x7fd89c0a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8b410c170 0x7fd8b4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8b4103660 0x7fd8b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 --2- 172.21.15.46:0/1563133310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8b4102d40 0x7fd8b41009a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 >> 172.21.15.46:0/1563133310 conn(0x7fd8b40fc7a0 msgr2=0x7fd8b40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 shutdown_connections 2024-09-19T09:17:31.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:31.334+0000 7fd8ba5cf640 1 -- 172.21.15.46:0/1563133310 wait complete. 2024-09-19T09:17:31.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:31 smithi046 ceph-mon[31203]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:17:31.902 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:31 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1563133310' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:17:31.930 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:17:31.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:31.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:31 smithi115 ceph-mon[35055]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:17:31.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:31 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1563133310' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:17:32.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:31 smithi099 ceph-mon[35256]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:17:32.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:31 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1563133310' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:17:32.189 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.687+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2578602507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec102d90 msgr2=0x7fdaec103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.687+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2578602507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec102d90 0x7fdaec103170 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009930 tx=0x7fdae002a420 comp rx=0 tx=0).stop 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2578602507 shutdown_connections 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2578602507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 0x7fdaec10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2578602507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec103740 0x7fdaec107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2578602507 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec102d90 0x7fdaec103170 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2578602507 >> 172.21.15.46:0/2578602507 conn(0x7fdaec0fc7d0 msgr2=0x7fdaec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2578602507 shutdown_connections 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2578602507 wait complete. 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 Processor -- start 2024-09-19T09:17:32.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 -- start start 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.688+0000 7fdaf2d01640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec102d90 0x7fdaec1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf2d01640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 0x7fdaec198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf2d01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 0x7fdaec19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf2d01640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec1120d0 con 0x7fdaec103740 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf2d01640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec111f50 con 0x7fdaec102d90 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf2d01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdaec112250 con 0x7fdaec108290 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 0x7fdaec198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 0x7fdaec198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57296/0 (socket says 172.21.15.46:57296) 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 -- 172.21.15.46:0/2249256245 learned_addr learned my addr 172.21.15.46:0/2249256245 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf0a9d640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec102d90 0x7fdaec1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf129e640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 0x7fdaec19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 -- 172.21.15.46:0/2249256245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 msgr2=0x7fdaec19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 0x7fdaec19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 -- 172.21.15.46:0/2249256245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec102d90 msgr2=0x7fdaec1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec102d90 0x7fdaec1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 -- 172.21.15.46:0/2249256245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaec19d580 con 0x7fdaec103740 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf129e640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 0x7fdaec19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf0a9d640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec102d90 0x7fdaec1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:32.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaebfff640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 0x7fdaec198b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c970 tx=0x7fdad800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8007bb0 con 0x7fdaec103740 2024-09-19T09:17:32.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad8007d50 con 0x7fdaec103740 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaec19d870 con 0x7fdaec103740 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.689+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad800f450 con 0x7fdaec103740 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.690+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaec1a5150 con 0x7fdaec103740 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.691+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaec06a7f0 con 0x7fdaec103740 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.692+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdad80046c0 con 0x7fdaec103740 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.693+0000 7fdae9ffb640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdadc0a32d0 0x7fdadc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.693+0000 7fdaf0a9d640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdadc0a32d0 0x7fdadc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.693+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdad80cfbb0 con 0x7fdaec103740 2024-09-19T09:17:32.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.693+0000 7fdaf0a9d640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdadc0a32d0 0x7fdadc0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdae0000c00 tx=0x7fdae0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.696+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdad8014030 con 0x7fdaec103740 2024-09-19T09:17:32.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.908+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdaec103170 con 0x7fdaec103740 2024-09-19T09:17:32.910 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:32 smithi046 ceph-mon[31203]: pgmap v315: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-19T09:17:32.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.909+0000 7fdae9ffb640 1 -- 172.21.15.46:0/2249256245 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7fdaec103170 con 0x7fdaec103740 2024-09-19T09:17:32.911 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:32.911 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-19T09:16:36:049593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:16:36.049570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:17:32.911 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdadc0a32d0 msgr2=0x7fdadc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdadc0a32d0 0x7fdadc0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdae0000c00 tx=0x7fdae0005a20 comp rx=0 tx=0).stop 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 msgr2=0x7fdaec198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 0x7fdaec198b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c970 tx=0x7fdad800ce30 comp rx=0 tx=0).stop 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 shutdown_connections 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdadc0a32d0 0x7fdadc0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaec103740 0x7fdaec198b10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdaec108290 0x7fdaec19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 --2- 172.21.15.46:0/2249256245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaec102d90 0x7fdaec1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 >> 172.21.15.46:0/2249256245 conn(0x7fdaec0fc7d0 msgr2=0x7fdaec105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 shutdown_connections 2024-09-19T09:17:32.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:32.911+0000 7fdaf2d01640 1 -- 172.21.15.46:0/2249256245 wait complete. 2024-09-19T09:17:33.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:32 smithi099 ceph-mon[35256]: pgmap v315: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-19T09:17:33.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:32 smithi115 ceph-mon[35055]: pgmap v315: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-09-19T09:17:33.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:33.875 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:33 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2249256245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:34.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:33 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2249256245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:33 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2249256245' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 -- 172.21.15.46:0/2673752275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102ef0 msgr2=0x7fd6a410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 --2- 172.21.15.46:0/2673752275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102ef0 0x7fd6a410da40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009ca0 tx=0x7fd69c02a950 comp rx=0 tx=0).stop 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 -- 172.21.15.46:0/2673752275 shutdown_connections 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 --2- 172.21.15.46:0/2673752275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102ef0 0x7fd6a410da40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 --2- 172.21.15.46:0/2673752275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a4102570 0x7fd6a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 --2- 172.21.15.46:0/2673752275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6a4100e20 0x7fd6a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 -- 172.21.15.46:0/2673752275 >> 172.21.15.46:0/2673752275 conn(0x7fd6a40fc7d0 msgr2=0x7fd6a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 -- 172.21.15.46:0/2673752275 shutdown_connections 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.346+0000 7fd6ac652640 1 -- 172.21.15.46:0/2673752275 wait complete. 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 Processor -- start 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 -- start start 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6a4100e20 0x7fd6a41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 0x7fd6a4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a4102ef0 0x7fd6a419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4112120 con 0x7fd6a4102570 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a4111fa0 con 0x7fd6a4102ef0 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6ac652640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a41122a0 con 0x7fd6a4100e20 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6a9bed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 0x7fd6a4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6aabef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a4102ef0 0x7fd6a419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6a9bed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 0x7fd6a4198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57312/0 (socket says 172.21.15.46:57312) 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6a9bed640 1 -- 172.21.15.46:0/3473578945 learned_addr learned my addr 172.21.15.46:0/3473578945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.347+0000 7fd6aa3ee640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6a4100e20 0x7fd6a41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6a9bed640 1 -- 172.21.15.46:0/3473578945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6a4100e20 msgr2=0x7fd6a41985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6a9bed640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6a4100e20 0x7fd6a41985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6a9bed640 1 -- 172.21.15.46:0/3473578945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a4102ef0 msgr2=0x7fd6a419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6a9bed640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a4102ef0 0x7fd6a419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6a9bed640 1 -- 172.21.15.46:0/3473578945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a419d590 con 0x7fd6a4102570 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6a9bed640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 0x7fd6a4198b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd69400b4a0 tx=0x7fd69400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694015020 con 0x7fd6a4102570 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd694011d10 con 0x7fd6a4102570 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a419d880 con 0x7fd6a4102570 2024-09-19T09:17:34.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69400f2e0 con 0x7fd6a4102570 2024-09-19T09:17:34.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.348+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a41a5160 con 0x7fd6a4102570 2024-09-19T09:17:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.349+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a4101280 con 0x7fd6a4102570 2024-09-19T09:17:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.350+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd694018020 con 0x7fd6a4102570 2024-09-19T09:17:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.351+0000 7fd69b7fe640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd6900a3350 0x7fd6900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.351+0000 7fd6aa3ee640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd6900a3350 0x7fd6900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.351+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd6940cf190 con 0x7fd6a4102570 2024-09-19T09:17:34.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.351+0000 7fd6aa3ee640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd6900a3350 0x7fd6900a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009990 tx=0x7fd6a0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:34.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.355+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd69401f020 con 0x7fd6a4102570 2024-09-19T09:17:34.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.568+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6a4109090 con 0x7fd6a4102570 2024-09-19T09:17:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.569+0000 7fd69b7fe640 1 -- 172.21.15.46:0/3473578945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7fd69409be30 con 0x7fd6a4102570 2024-09-19T09:17:34.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:34.571 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-19T09:16:36:049593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:16:36.049570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:17:34.571 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:17:34.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd6900a3350 msgr2=0x7fd6900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd6900a3350 0x7fd6900a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009990 tx=0x7fd6a0009110 comp rx=0 tx=0).stop 2024-09-19T09:17:34.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 msgr2=0x7fd6a4198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 0x7fd6a4198b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd69400b4a0 tx=0x7fd69400b8a0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 shutdown_connections 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd6900a3350 0x7fd6900a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd6a4102570 0x7fd6a4198b20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a4102ef0 0x7fd6a419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 --2- 172.21.15.46:0/3473578945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6a4100e20 0x7fd6a41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 >> 172.21.15.46:0/3473578945 conn(0x7fd6a40fc7d0 msgr2=0x7fd6a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 shutdown_connections 2024-09-19T09:17:34.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:34.571+0000 7fd6ac652640 1 -- 172.21.15.46:0/3473578945 wait complete. 2024-09-19T09:17:34.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:34 smithi046 ceph-mon[31203]: pgmap v316: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:34.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:34 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3473578945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:35.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:34 smithi099 ceph-mon[35256]: pgmap v316: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:35.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:34 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3473578945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:35.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:34 smithi115 ceph-mon[35055]: pgmap v316: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:35.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:34 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3473578945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:35.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:17:35.485 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 -- 172.21.15.46:0/607318054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102ef0 msgr2=0x7fda2010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 --2- 172.21.15.46:0/607318054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102ef0 0x7fda2010da40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda18009900 tx=0x7fda1802a480 comp rx=0 tx=0).stop 2024-09-19T09:17:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 -- 172.21.15.46:0/607318054 shutdown_connections 2024-09-19T09:17:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 --2- 172.21.15.46:0/607318054 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102ef0 0x7fda2010da40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 --2- 172.21.15.46:0/607318054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102570 0x7fda201029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:35.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 --2- 172.21.15.46:0/607318054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda20100e20 0x7fda20101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.921+0000 7fda2522c640 1 -- 172.21.15.46:0/607318054 >> 172.21.15.46:0/607318054 conn(0x7fda200fc7d0 msgr2=0x7fda200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.922+0000 7fda2522c640 1 -- 172.21.15.46:0/607318054 shutdown_connections 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.922+0000 7fda2522c640 1 -- 172.21.15.46:0/607318054 wait complete. 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.922+0000 7fda2522c640 1 Processor -- start 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 -- start start 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda20100e20 0x7fda201993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 0x7fda201998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102ef0 0x7fda201a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fda20110fa0 con 0x7fda20102570 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda20110e20 con 0x7fda20100e20 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda2522c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda20111120 con 0x7fda20102ef0 2024-09-19T09:17:35.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 0x7fda201998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 0x7fda201998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57322/0 (socket says 172.21.15.46:57322) 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 -- 172.21.15.46:0/2568988354 learned_addr learned my addr 172.21.15.46:0/2568988354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1ed9d640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda20100e20 0x7fda201993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1f59e640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102ef0 0x7fda201a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 -- 172.21.15.46:0/2568988354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102ef0 msgr2=0x7fda201a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102ef0 0x7fda201a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 -- 172.21.15.46:0/2568988354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda20100e20 msgr2=0x7fda201993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda20100e20 0x7fda201993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1e59c640 1 -- 172.21.15.46:0/2568988354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda201a4970 con 0x7fda20102570 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.923+0000 7fda1f59e640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102ef0 0x7fda201a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.924+0000 7fda1e59c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 0x7fda201998f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c890 tx=0x7fda1400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:35.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.924+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14004220 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.924+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda140043c0 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.924+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda201a4b40 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.924+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140049e0 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.924+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda201a5050 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.925+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda20101200 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.926+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fda140079b0 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.927+0000 7fda07fff640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fda080a32d0 0x7fda080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.927+0000 7fda1ed9d640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fda080a32d0 0x7fda080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.927+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fda140cfad0 con 0x7fda20102570 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.927+0000 7fda1ed9d640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fda080a32d0 0x7fda080a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda1000a400 tx=0x7fda1000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:35.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:35.930+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda14014030 con 0x7fda20102570 2024-09-19T09:17:36.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.112+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda2006a560 con 0x7fda20102570 2024-09-19T09:17:36.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.114+0000 7fda07fff640 1 -- 172.21.15.46:0/2568988354 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22631 (secure 0 0 0) 0x7fda2006a560 con 0x7fda20102570 2024-09-19T09:17:36.115 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:36.116 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:17:30.696589+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fda080a32d0 msgr2=0x7fda080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fda080a32d0 0x7fda080a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda1000a400 tx=0x7fda1000d040 comp rx=0 tx=0).stop 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 msgr2=0x7fda201998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 0x7fda201998f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c890 tx=0x7fda1400cd50 comp rx=0 tx=0).stop 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 shutdown_connections 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fda080a32d0 0x7fda080a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda20102570 0x7fda201998f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda20102ef0 0x7fda201a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 --2- 172.21.15.46:0/2568988354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda20100e20 0x7fda201993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:36.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 >> 172.21.15.46:0/2568988354 conn(0x7fda200fc7d0 msgr2=0x7fda20106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:36.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 shutdown_connections 2024-09-19T09:17:36.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:36.116+0000 7fda2522c640 1 -- 172.21.15.46:0/2568988354 wait complete. 2024-09-19T09:17:36.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:36 smithi046 ceph-mon[31203]: pgmap v317: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:36 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2568988354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:17:37.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:36 smithi099 ceph-mon[35256]: pgmap v317: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:37.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:36 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2568988354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:17:37.083 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:37.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:36 smithi115 ceph-mon[35055]: pgmap v317: 97 pgs: 1 activating, 1 peering, 95 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:37.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:36 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2568988354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:17:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.549+0000 7f3329cd6640 1 -- 172.21.15.46:0/3806005494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f332410c170 msgr2=0x7f332410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.549+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3806005494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f332410c170 0x7f332410e610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f331c009ca0 tx=0x7f331c02a950 comp rx=0 tx=0).stop 2024-09-19T09:17:37.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 -- 172.21.15.46:0/3806005494 shutdown_connections 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3806005494 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f332410c170 0x7f332410e610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3806005494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3324103660 0x7f332410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3806005494 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3324102d40 0x7f3324103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 -- 172.21.15.46:0/3806005494 >> 172.21.15.46:0/3806005494 conn(0x7f33240fc7a0 msgr2=0x7f33240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 -- 172.21.15.46:0/3806005494 shutdown_connections 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 -- 172.21.15.46:0/3806005494 wait complete. 2024-09-19T09:17:37.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 Processor -- start 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.550+0000 7f3329cd6640 1 -- start start 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3329cd6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 0x7f3324198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3329cd6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3324103660 0x7f3324198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3329cd6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f332410c170 0x7f332419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3329cd6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3324111f30 con 0x7f3324102d40 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3329cd6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3324111db0 con 0x7f3324103660 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3329cd6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f33241120b0 con 0x7f332410c170 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 0x7f3324198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 0x7f3324198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57332/0 (socket says 172.21.15.46:57332) 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 -- 172.21.15.46:0/3226965138 learned_addr learned my addr 172.21.15.46:0/3226965138 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:37.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3323fff640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f332410c170 0x7f332419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3322ffd640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3324103660 0x7f3324198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 -- 172.21.15.46:0/3226965138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f332410c170 msgr2=0x7f332419cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f332410c170 0x7f332419cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 -- 172.21.15.46:0/3226965138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3324103660 msgr2=0x7f3324198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3324103660 0x7f3324198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 -- 172.21.15.46:0/3226965138 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332419d2e0 con 0x7f3324102d40 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3323fff640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f332410c170 0x7f332419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f33237fe640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 0x7f3324198330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f331400c920 tx=0x7f331400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:37.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.551+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314007c70 con 0x7f3324102d40 2024-09-19T09:17:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.552+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3314007e10 con 0x7f3324102d40 2024-09-19T09:17:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.552+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332419d5d0 con 0x7f3324102d40 2024-09-19T09:17:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.552+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3314018890 con 0x7f3324102d40 2024-09-19T09:17:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.552+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33241a4eb0 con 0x7f3324102d40 2024-09-19T09:17:37.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.553+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3324103120 con 0x7f3324102d40 2024-09-19T09:17:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.554+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3314018a70 con 0x7f3324102d40 2024-09-19T09:17:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.554+0000 7f3320ff9640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f330c0a3350 0x7f330c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.555+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f33140cfc30 con 0x7f3324102d40 2024-09-19T09:17:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.555+0000 7f3322ffd640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f330c0a3350 0x7f330c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:37.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.555+0000 7f3322ffd640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f330c0a3350 0x7f330c0a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3318005fd0 tx=0x7f3318005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:37.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.559+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3314014030 con 0x7f3324102d40 2024-09-19T09:17:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.774+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3324199690 con 0x7f3324102d40 2024-09-19T09:17:37.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.775+0000 7f3320ff9640 1 -- 172.21.15.46:0/3226965138 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f331409c7c0 con 0x7f3324102d40 2024-09-19T09:17:37.777 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:37.777 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-19T09:16:36:049593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:16:36.049570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:17:37.777 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:17:37.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f330c0a3350 msgr2=0x7f330c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:37.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f330c0a3350 0x7f330c0a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3318005fd0 tx=0x7f3318005f60 comp rx=0 tx=0).stop 2024-09-19T09:17:37.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 msgr2=0x7f3324198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 0x7f3324198330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f331400c920 tx=0x7f331400cde0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 shutdown_connections 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f330c0a3350 0x7f330c0a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f332410c170 0x7f332419cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3324103660 0x7f3324198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 --2- 172.21.15.46:0/3226965138 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3324102d40 0x7f3324198330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 >> 172.21.15.46:0/3226965138 conn(0x7f33240fc7a0 msgr2=0x7f33240fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 shutdown_connections 2024-09-19T09:17:37.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:37.777+0000 7f3329cd6640 1 -- 172.21.15.46:0/3226965138 wait complete. 2024-09-19T09:17:38.438 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:16:24.646046+0000', 'modified': '2024-09-19T09:16:36.049570+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24472, 'mds_2': 24463, 'mds_3': 24451, 'mds_4': 24446}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14589': {'gid': 14589, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/1918563776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1918563776}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1918563776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6841/321773391', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6840', 'nonce': 321773391}, {'type': 'v1', 'addr': '172.21.15.46:6841', 'nonce': 321773391}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6833/51140188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 51140188}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 51140188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6833/2187922257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6832', 'nonce': 2187922257}, {'type': 'v1', 'addr': '172.21.15.115:6833', 'nonce': 2187922257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6835/1791811881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 1791811881}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 1791811881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.99:6837/58768930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 58768930}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 58768930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.115:6835/3610194671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3610194671}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3610194671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6837/1753777056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 1753777056}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1753777056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.115:6839/1737720182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1737720182}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1737720182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/718433968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 718433968}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 718433968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24476, 24463, 24451, 24472, 24446]} 2024-09-19T09:17:38.439 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:17:38.439 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:17:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:38.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:38 smithi046 ceph-mon[31203]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:38.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:38 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3226965138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:39.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:38 smithi099 ceph-mon[35256]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:39.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:38 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3226965138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 -- 172.21.15.46:0/3434518660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 msgr2=0x7f044c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 --2- 172.21.15.46:0/3434518660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c1067e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0440009900 tx=0x7f044002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 -- 172.21.15.46:0/3434518660 shutdown_connections 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 --2- 172.21.15.46:0/3434518660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c1067e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 --2- 172.21.15.46:0/3434518660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c106f10 0x7f044c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 --2- 172.21.15.46:0/3434518660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f044c101de0 0x7f044c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 -- 172.21.15.46:0/3434518660 >> 172.21.15.46:0/3434518660 conn(0x7f044c0fd8c0 msgr2=0x7f044c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:39.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 -- 172.21.15.46:0/3434518660 shutdown_connections 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.168+0000 7f04520e8640 1 -- 172.21.15.46:0/3434518660 wait complete. 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 Processor -- start 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 -- start start 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c101de0 0x7f044c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f044c106f10 0x7f044c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f044c111f70 con 0x7f044c102790 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f044c111df0 con 0x7f044c101de0 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f04520e8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1120f0 con 0x7f044c106f10 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f044affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f044affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50162/0 (socket says 172.21.15.46:50162) 2024-09-19T09:17:39.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f044affd640 1 -- 172.21.15.46:0/2449252021 learned_addr learned my addr 172.21.15.46:0/2449252021 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.169+0000 7f044affd640 1 -- 172.21.15.46:0/2449252021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f044c106f10 msgr2=0x7f044c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f044affd640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f044c106f10 0x7f044c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f044b7fe640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c101de0 0x7f044c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f044affd640 1 -- 172.21.15.46:0/2449252021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c101de0 msgr2=0x7f044c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f044affd640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c101de0 0x7f044c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f044affd640 1 -- 172.21.15.46:0/2449252021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c1a6950 con 0x7f044c102790 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f044affd640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c074a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0440006010 tx=0x7f04400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f0448ff9640 1 -- 172.21.15.46:0/2449252021 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044003f030 con 0x7f044c102790 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f0448ff9640 1 -- 172.21.15.46:0/2449252021 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0440003ce0 con 0x7f044c102790 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c1a6be0 con 0x7f044c102790 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f0448ff9640 1 -- 172.21.15.46:0/2449252021 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440035070 con 0x7f044c102790 2024-09-19T09:17:39.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.170+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c1a7110 con 0x7f044c102790 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.172+0000 7f0448ff9640 1 -- 172.21.15.46:0/2449252021 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0440042030 con 0x7f044c102790 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.172+0000 7f04544c1740 1 Processor -- start 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 -- start start 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bac9d0 0x5573a5bacdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bb7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5573a5b13090 con 0x5573a5bb7bb0 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5573a5abaa70 con 0x5573a5bad2f0 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f04544c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5573a5b0f050 con 0x5573a5bac9d0 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50172/0 (socket says 172.21.15.46:50172) 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 -- 172.21.15.46:0/1237068206 learned_addr learned my addr 172.21.15.46:0/1237068206 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:39.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044bfff640 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bac9d0 0x5573a5bacdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044b7fe640 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bb7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f0448ff9640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04340a3350 0x7f04340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044bfff640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04340a3350 0x7f04340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 -- 172.21.15.46:0/1237068206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bac9d0 msgr2=0x5573a5bacdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bac9d0 0x5573a5bacdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 -- 172.21.15.46:0/1237068206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 msgr2=0x5573a5bb7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bb7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f044affd640 1 -- 172.21.15.46:0/1237068206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573a5ac7130 con 0x5573a5bb7bb0 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.173+0000 7f0448ff9640 1 -- 172.21.15.46:0/2449252021 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f04400effe0 con 0x7f044c102790 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f044affd640 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb9fa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04400ed900 tx=0x7f044004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ea2b66f1e8fc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f044bfff640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04340a3350 0x7f04340a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0444005c40 tx=0x7f0444005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:39.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f0431ffb640 1 -- 172.21.15.46:0/1237068206 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400bbef0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f0431ffb640 1 -- 172.21.15.46:0/1237068206 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f044003b580 con 0x5573a5bb7bb0 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f0431ffb640 1 -- 172.21.15.46:0/1237068206 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04400044e0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f04544c1740 1 -- 172.21.15.46:0/1237068206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 msgr2=0x5573a5bb9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.174+0000 7f04544c1740 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb9fa0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04400ed900 tx=0x7f044004b000 comp rx=0 tx=0).stop 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 -- 172.21.15.46:0/1237068206 shutdown_connections 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb9fa0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bb7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 --2- 172.21.15.46:0/1237068206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bac9d0 0x5573a5bacdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 -- 172.21.15.46:0/1237068206 >> 172.21.15.46:0/1237068206 conn(0x5573a5ba8f60 msgr2=0x5573a5ba9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 -- 172.21.15.46:0/1237068206 shutdown_connections 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 -- 172.21.15.46:0/1237068206 wait complete. 2024-09-19T09:17:39.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 -- start start 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.175+0000 7f04544c1740 1 Processor -- start 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bb73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bb4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bba540 con 0x5573a5bb7bb0 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5573a5acdf20 con 0x5573a5bac9d0 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bba6c0 con 0x5573a5bad2f0 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f04544c1740 10 client.0 _ll_register_callbacks cb 0x5573a5a97030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50176/0 (socket says 172.21.15.46:50176) 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 -- 172.21.15.46:0/3470884227 learned_addr learned my addr 172.21.15.46:0/3470884227 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044b7fe640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bb73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044affd640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bb4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 -- 172.21.15.46:0/3470884227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 msgr2=0x5573a5bb4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bb4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 -- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 msgr2=0x5573a5bb73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bb73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 -- 172.21.15.46:0/3470884227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573a58842b0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f044bfff640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb4c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0444014490 tx=0x7f0444004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc99ded461848949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f042affd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.176+0000 7f042affd640 1 -- 172.21.15.46:0/3470884227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444023020 con 0x5573a5bb7bb0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f042affd640 1 -- 172.21.15.46:0/3470884227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0444003d80 con 0x5573a5bb7bb0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5573a5b20600 con 0x5573a5bb7bb0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f042affd640 1 -- 172.21.15.46:0/3470884227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0444004050 con 0x5573a5bb7bb0 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 10 client.14958 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:39.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573a5bc5dc0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f042affd640 1 -- 172.21.15.46:0/3470884227 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5573a5b20600 con 0x5573a5bb7bb0 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f042affd640 1 -- 172.21.15.46:0/3470884227 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0444010050 con 0x5573a5bb7bb0 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 10 client.14958 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 10 client.14958 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 20 client.14958 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5bc8450 0x5573a5bc98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 4 client.14958 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.177+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573a5b1ab10 con 0x5573a5bc8450 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.178+0000 7f044b7fe640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5bc8450 0x5573a5bc98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.178+0000 7f042affd640 10 client.14958 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.178+0000 7f044b7fe640 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5bc8450 0x5573a5bc98c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ce20b8b2d3fc60ab server_cookie=4c264f031d82b493 in_seq=0 out_seq=0 2024-09-19T09:17:39.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f042affd640 1 -- 172.21.15.46:0/3470884227 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573a5b1ab10 con 0x5573a5bc8450 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f042affd640 10 client.14958 handle_command_reply: tid=0 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 client.14958 shutdown 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 msgr2=0x5573a5bb4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb4c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0444014490 tx=0x7f0444004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 shutdown_connections 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bb4c60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5bc8450 0x5573a5bc98c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bb4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 --2- 172.21.15.46:0/3470884227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bb73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 >> 172.21.15.46:0/3470884227 conn(0x5573a5ba8f60 msgr2=0x5573a5baec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f042affd640 0 client.14958 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 shutdown_connections 2024-09-19T09:17:39.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 1 -- 172.21.15.46:0/3470884227 wait complete. 2024-09-19T09:17:39.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.179+0000 7f04544c1740 20 client.14958 trim_cache size 0 max 16384 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.197+0000 7f04544c1740 1 Processor -- start 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.197+0000 7f04544c1740 1 -- start start 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04544c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 0x5573a5bc8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04544c1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bc3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04544c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bb7bb0 0x5573a5bd1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04544c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bc7c00 con 0x5573a5bac9d0 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04544c1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bc82d0 con 0x5573a5bad2f0 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04544c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bc89a0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 0x5573a5bc8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 0x5573a5bc8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50180/0 (socket says 172.21.15.46:50180) 2024-09-19T09:17:39.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 -- 172.21.15.46:0/1286667557 learned_addr learned my addr 172.21.15.46:0/1286667557 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:39.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044affd640 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bc3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 -- 172.21.15.46:0/1286667557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bb7bb0 msgr2=0x5573a5bd1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bb7bb0 0x5573a5bd1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 -- 172.21.15.46:0/1286667557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 msgr2=0x5573a5bc3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bc3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 -- 172.21.15.46:0/1286667557 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573a5ba8d90 con 0x5573a5bac9d0 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044affd640 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bc3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f044b7fe640 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 0x5573a5bc8450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f043c009e90 tx=0x7f043c014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c914e405d2fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04317fa640 1 -- 172.21.15.46:0/1286667557 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c014190 con 0x5573a5bac9d0 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04317fa640 1 -- 172.21.15.46:0/1286667557 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c0035f0 con 0x5573a5bac9d0 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.198+0000 7f04317fa640 1 -- 172.21.15.46:0/1286667557 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c0126b0 con 0x5573a5bac9d0 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 -- 172.21.15.46:0/1286667557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 msgr2=0x5573a5bc8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 0x5573a5bc8450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f043c009e90 tx=0x7f043c014840 comp rx=0 tx=0).stop 2024-09-19T09:17:39.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 -- 172.21.15.46:0/1286667557 shutdown_connections 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bb7bb0 0x5573a5bd1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bad2f0 0x5573a5bc3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 --2- 172.21.15.46:0/1286667557 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bac9d0 0x5573a5bc8450 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 -- 172.21.15.46:0/1286667557 >> 172.21.15.46:0/1286667557 conn(0x5573a5ba8f60 msgr2=0x5573a5bb2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 -- 172.21.15.46:0/1286667557 shutdown_connections 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 -- 172.21.15.46:0/1286667557 wait complete. 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.199+0000 7f04544c1740 1 -- start start 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 Processor -- start 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bd1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bd2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bcb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bc9740 con 0x5573a5bb7bb0 2024-09-19T09:17:39.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bc9070 con 0x5573a5bac9d0 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5573a5bc9e10 con 0x5573a5bad2f0 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f04544c1740 10 client.0 _ll_register_callbacks cb 0x7f0444009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bcb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bcb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50182/0 (socket says 172.21.15.46:50182) 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 -- 172.21.15.46:0/3073584574 learned_addr learned my addr 172.21.15.46:0/3073584574 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044b7fe640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bd1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044affd640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bd2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 -- 172.21.15.46:0/3073584574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 msgr2=0x5573a5bd2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bd2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 -- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 msgr2=0x5573a5bd1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bd1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044bfff640 1 -- 172.21.15.46:0/3073584574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573a5bcb870 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.200+0000 7f044affd640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bd2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f044bfff640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bcb040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f044401fd50 tx=0x7f044401f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced6a69a21505b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f042affd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f042affd640 1 -- 172.21.15.46:0/3073584574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444023040 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f042affd640 1 -- 172.21.15.46:0/3073584574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f04440043f0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043c0035f0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f042affd640 1 -- 172.21.15.46:0/3073584574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0444043070 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 10 client.14964 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573a5bd0170 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f042affd640 1 -- 172.21.15.46:0/3073584574 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c0035f0 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f042affd640 1 -- 172.21.15.46:0/3073584574 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0444034910 con 0x5573a5bb7bb0 2024-09-19T09:17:39.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 10 client.14964 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 10 client.14964 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 20 client.14964 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5c37040 0x5573a5c35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 4 client.14964 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.201+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "status"}) -- 0x5573a5a970e0 con 0x5573a5c37040 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f044b7fe640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5c37040 0x5573a5c35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:39.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f044b7fe640 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5c37040 0x5573a5c35d50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b7f7d74d00d36d27 server_cookie=1fad5819dc3127a9 in_seq=0 out_seq=0 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f042affd640 10 client.14964 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f042affd640 1 -- 172.21.15.46:0/3073584574 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5573a5a970e0 con 0x5573a5c37040 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f042affd640 10 client.14964 handle_command_reply: tid=0 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f04544c1740 1 client.14964 shutdown 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 msgr2=0x5573a5bcb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.202+0000 7f04544c1740 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bcb040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f044401fd50 tx=0x7f044401f6d0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 shutdown_connections 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5573a5bb7bb0 0x5573a5bcb040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5573a5c37040 0x5573a5c35d50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5573a5bad2f0 0x5573a5bd2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 --2- 172.21.15.46:0/3073584574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5573a5bac9d0 0x5573a5bd1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 >> 172.21.15.46:0/3073584574 conn(0x5573a5ba8f60 msgr2=0x5573a5bafde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f042affd640 0 client.14964 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 shutdown_connections 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 1 -- 172.21.15.46:0/3073584574 wait complete. 2024-09-19T09:17:39.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04544c1740 20 client.14964 trim_cache size 0 max 16384 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24446, 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 64.159357377000006, 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:17:39.212 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 97.052708502000002 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04340a3350 msgr2=0x7f04340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04340a3350 0x7f04340a5810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0444005c40 tx=0x7f0444005bd0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 msgr2=0x7f044c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c074a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0440006010 tx=0x7f04400042f0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 shutdown_connections 2024-09-19T09:17:39.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04340a3350 0x7f04340a5810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f044c102790 0x7f044c074a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f044c106f10 0x7f044c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 --2- 172.21.15.46:0/2449252021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f044c101de0 0x7f044c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.203+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 >> 172.21.15.46:0/2449252021 conn(0x7f044c0fd8c0 msgr2=0x7f044c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.204+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 shutdown_connections 2024-09-19T09:17:39.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:39.204+0000 7f04520e8640 1 -- 172.21.15.46:0/2449252021 wait complete. 2024-09-19T09:17:39.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:38 smithi115 ceph-mon[35055]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:39.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:38 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3226965138' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:40.026 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T09:17:40.288 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 -- 172.21.15.46:0/2017934934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4103660 msgr2=0x7f10a410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 --2- 172.21.15.46:0/2017934934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4103660 0x7f10a410bb50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1098009900 tx=0x7f109802a480 comp rx=0 tx=0).stop 2024-09-19T09:17:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 -- 172.21.15.46:0/2017934934 shutdown_connections 2024-09-19T09:17:40.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 --2- 172.21.15.46:0/2017934934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4103660 0x7f10a410bb50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 --2- 172.21.15.46:0/2017934934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 0x7f10a410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 --2- 172.21.15.46:0/2017934934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4102d40 0x7f10a4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 -- 172.21.15.46:0/2017934934 >> 172.21.15.46:0/2017934934 conn(0x7f10a40fc7a0 msgr2=0x7f10a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 -- 172.21.15.46:0/2017934934 shutdown_connections 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.736+0000 7f10a8816640 1 -- 172.21.15.46:0/2017934934 wait complete. 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.737+0000 7f10a8816640 1 Processor -- start 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.737+0000 7f10a8816640 1 -- start start 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.737+0000 7f10a8816640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 0x7f10a41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4103660 0x7f10a4198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 0x7f10a419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4112030 con 0x7f10a4102d40 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4111eb0 con 0x7f10a410c170 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f10a41121b0 con 0x7f10a4103660 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 0x7f10a41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 0x7f10a41985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50204/0 (socket says 172.21.15.46:50204) 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 -- 172.21.15.46:0/3044337011 learned_addr learned my addr 172.21.15.46:0/3044337011 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4103660 0x7f10a4198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 0x7f10a419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 -- 172.21.15.46:0/3044337011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4103660 msgr2=0x7f10a4198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4103660 0x7f10a4198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 -- 172.21.15.46:0/3044337011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 msgr2=0x7f10a419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 0x7f10a419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 -- 172.21.15.46:0/3044337011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a419d580 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4103660 0x7f10a4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 0x7f10a419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a259c640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 0x7f10a41985d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f109400b4a0 tx=0x7f109400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10937fe640 1 -- 172.21.15.46:0/3044337011 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094014070 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10937fe640 1 -- 172.21.15.46:0/3044337011 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1094010af0 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a419d870 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10937fe640 1 -- 172.21.15.46:0/3044337011 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094017d10 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.738+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41a5150 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10937fe640 1 -- 172.21.15.46:0/3044337011 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1094017070 con 0x7f10a4102d40 2024-09-19T09:17:40.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 Processor -- start 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 -- start start 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10937fe640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f108c0a32d0 0x7f108c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c432adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 0x55b4c4335670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c4337fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4291090 con 0x55b4c432b2f0 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4238a70 con 0x55b4c4335bb0 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.741+0000 7f10aabef740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b4c428d050 con 0x55b4c432a9d0 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f108c0a32d0 0x7f108c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10937fe640 1 -- 172.21.15.46:0/3044337011 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f10940ceeb0 con 0x7f10a4102d40 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 0x55b4c4335670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 0x55b4c4335670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50214/0 (socket says 172.21.15.46:50214) 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 -- 172.21.15.46:0/1731542178 learned_addr learned my addr 172.21.15.46:0/1731542178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a259c640 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c432adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 -- 172.21.15.46:0/1731542178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 msgr2=0x55b4c432adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c432adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 -- 172.21.15.46:0/1731542178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 msgr2=0x55b4c4337fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c4337fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 -- 172.21.15.46:0/1731542178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c4245130 con 0x55b4c432b2f0 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f108c0a32d0 0x7f108c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f109c007ea0 tx=0x7f109c00c690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:40.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 0x55b4c4335670 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1098005ab0 tx=0x7f1098009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30901935c68ea0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f1090ff9640 1 -- 172.21.15.46:0/1731542178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109803f070 con 0x55b4c432b2f0 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f1090ff9640 1 -- 172.21.15.46:0/1731542178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1098032e40 con 0x55b4c432b2f0 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.742+0000 7f1090ff9640 1 -- 172.21.15.46:0/1731542178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098035070 con 0x55b4c432b2f0 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 -- 172.21.15.46:0/1731542178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 msgr2=0x55b4c4335670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 0x55b4c4335670 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1098005ab0 tx=0x7f1098009680 comp rx=0 tx=0).stop 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 -- 172.21.15.46:0/1731542178 shutdown_connections 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432b2f0 0x55b4c4335670 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c4337fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 --2- 172.21.15.46:0/1731542178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c432adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 -- 172.21.15.46:0/1731542178 >> 172.21.15.46:0/1731542178 conn(0x55b4c4326f60 msgr2=0x55b4c4327340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:40.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 -- 172.21.15.46:0/1731542178 shutdown_connections 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.743+0000 7f10aabef740 1 -- 172.21.15.46:0/1731542178 wait complete. 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 -- start start 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 Processor -- start 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c43353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 0x55b4c4332c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4338780 con 0x55b4c4335bb0 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b4c424bf20 con 0x55b4c432b2f0 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4338900 con 0x55b4c432a9d0 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10aabef740 10 client.0 _ll_register_callbacks cb 0x55b4c4215030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 0x55b4c4332c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 0x55b4c4332c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50220/0 (socket says 172.21.15.46:50220) 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 -- 172.21.15.46:0/4226032531 learned_addr learned my addr 172.21.15.46:0/4226032531 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a259c640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c43353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 -- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 msgr2=0x55b4c43353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c43353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 -- 172.21.15.46:0/4226032531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 msgr2=0x55b4c4332740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.744+0000 7f10a2d9d640 1 -- 172.21.15.46:0/4226032531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c40022b0 con 0x55b4c4335bb0 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 0x55b4c4332c80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f109c007090 tx=0x7f109c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b023b6cf30e51dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:40.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f1089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f1089ffb640 1 -- 172.21.15.46:0/4226032531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c01e630 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f1089ffb640 1 -- 172.21.15.46:0/4226032531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f109c01e7d0 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4c429e600 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f1089ffb640 1 -- 172.21.15.46:0/4226032531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f109c01e9d0 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 10 client.14976 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b4c43440a0 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f1089ffb640 1 -- 172.21.15.46:0/4226032531 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b4c429e600 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f1089ffb640 1 -- 172.21.15.46:0/4226032531 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f109c01dc50 con 0x55b4c4335bb0 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 10 client.14976 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 10 client.14976 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:17:40.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 20 client.14976 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:40.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.745+0000 7f10aabef740 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c4346720 0x55b4c4347b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.746+0000 7f10aabef740 4 client.14976 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:17:40.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.746+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4c4298b10 con 0x55b4c4346720 2024-09-19T09:17:40.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.746+0000 7f10a259c640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c4346720 0x55b4c4347b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.746+0000 7f10a259c640 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c4346720 0x55b4c4347b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=773c912c75cd7eea server_cookie=5f6881130e43b29a in_seq=0 out_seq=0 2024-09-19T09:17:40.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.746+0000 7f1089ffb640 10 client.14976 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f1089ffb640 1 -- 172.21.15.46:0/4226032531 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4c4298b10 con 0x55b4c4346720 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f1089ffb640 10 client.14976 handle_command_reply: tid=0 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 client.14976 shutdown 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 msgr2=0x55b4c4332c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 0x55b4c4332c80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f109c007090 tx=0x7f109c004b50 comp rx=0 tx=0).stop 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 shutdown_connections 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c4346720 0x55b4c4347b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c4335bb0 0x55b4c4332c80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 --2- 172.21.15.46:0/4226032531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432a9d0 0x55b4c43353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f1089ffb640 0 client.14976 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 >> 172.21.15.46:0/4226032531 conn(0x55b4c4326f60 msgr2=0x55b4c432cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 shutdown_connections 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.747+0000 7f10aabef740 1 -- 172.21.15.46:0/4226032531 wait complete. 2024-09-19T09:17:40.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.748+0000 7f10aabef740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 Processor -- start 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 -- start start 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c4347b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c4335bb0 0x55b4c4331010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4345ed0 con 0x55b4c432a9d0 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b4c43465a0 con 0x55b4c432b2f0 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.765+0000 7f10aabef740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4346c70 con 0x55b4c4335bb0 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c4347b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c4347b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50226/0 (socket says 172.21.15.46:50226) 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 -- 172.21.15.46:0/221752580 learned_addr learned my addr 172.21.15.46:0/221752580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 -- 172.21.15.46:0/221752580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c4335bb0 msgr2=0x55b4c4331010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c4335bb0 0x55b4c4331010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c4335bb0 0x55b4c4331010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 -- 172.21.15.46:0/221752580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 msgr2=0x55b4c4332000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 -- 172.21.15.46:0/221752580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4c432b120 con 0x55b4c432a9d0 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:40.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c4335bb0 0x55b4c4331010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f10a259c640 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c4347b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f10940cc970 tx=0x7f1094017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0291519d1aed758 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f108bfff640 1 -- 172.21.15.46:0/221752580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109401e040 con 0x55b4c432a9d0 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f108bfff640 1 -- 172.21.15.46:0/221752580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109409f800 con 0x55b4c432a9d0 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.766+0000 7f108bfff640 1 -- 172.21.15.46:0/221752580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940af040 con 0x55b4c432a9d0 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 -- 172.21.15.46:0/221752580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 msgr2=0x55b4c4347b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c4347b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f10940cc970 tx=0x7f1094017730 comp rx=0 tx=0).stop 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 -- 172.21.15.46:0/221752580 shutdown_connections 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c4335bb0 0x55b4c4331010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c432b2f0 0x55b4c4332000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 --2- 172.21.15.46:0/221752580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c4347b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 -- 172.21.15.46:0/221752580 >> 172.21.15.46:0/221752580 conn(0x55b4c4326f60 msgr2=0x55b4c4327340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:40.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 -- 172.21.15.46:0/221752580 shutdown_connections 2024-09-19T09:17:40.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 -- 172.21.15.46:0/221752580 wait complete. 2024-09-19T09:17:40.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 -- start start 2024-09-19T09:17:40.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.767+0000 7f10aabef740 1 Processor -- start 2024-09-19T09:17:40.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c434b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432b2f0 0x55b4c434b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c43aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4347a10 con 0x55b4c432a9d0 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b4c4347340 con 0x55b4c4335bb0 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b4c43480e0 con 0x55b4c432b2f0 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10aabef740 10 client.0 _ll_register_callbacks cb 0x7f109c00ce40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c434b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c434b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50236/0 (socket says 172.21.15.46:50236) 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 -- 172.21.15.46:0/4038242658 learned_addr learned my addr 172.21.15.46:0/4038242658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432b2f0 0x55b4c434b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a2d9d640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c43aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 -- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432b2f0 msgr2=0x55b4c434b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432b2f0 0x55b4c434b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 -- 172.21.15.46:0/4038242658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 msgr2=0x55b4c43aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c43aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 -- 172.21.15.46:0/4038242658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4c43af360 con 0x55b4c432a9d0 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f10a259c640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c434b2d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10940aff80 tx=0x7f10940cc900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d62e503da06520 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f1089ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.768+0000 7f1089ffb640 1 -- 172.21.15.46:0/4038242658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109401e070 con 0x55b4c432a9d0 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f1089ffb640 1 -- 172.21.15.46:0/4038242658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1094097ac0 con 0x55b4c432a9d0 2024-09-19T09:17:40.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f109409f800 con 0x55b4c432a9d0 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f1089ffb640 1 -- 172.21.15.46:0/4038242658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f10940af050 con 0x55b4c432a9d0 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 10 client.14982 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b4c43b05b0 con 0x55b4c432a9d0 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f1089ffb640 1 -- 172.21.15.46:0/4038242658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109409f800 con 0x55b4c432a9d0 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f1089ffb640 1 -- 172.21.15.46:0/4038242658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f10940af1f0 con 0x55b4c432a9d0 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 10 client.14982 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 10 client.14982 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 20 client.14982 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c43b4b30 0x55b4c43b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 4 client.14982 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:17:40.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "status"}) -- 0x55b4c42150e0 con 0x55b4c43b4b30 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.769+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c43b4b30 0x55b4c43b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10a1d9b640 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c43b4b30 0x55b4c43b3840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=28e15cf723b7f1a1 server_cookie=34c5a64765396099 in_seq=0 out_seq=0 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f1089ffb640 10 client.14982 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f1089ffb640 1 -- 172.21.15.46:0/4038242658 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b4c42150e0 con 0x55b4c43b4b30 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f1089ffb640 10 client.14982 handle_command_reply: tid=0 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 client.14982 shutdown 2024-09-19T09:17:40.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 msgr2=0x55b4c434b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c434b2d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10940aff80 tx=0x7f10940cc900 comp rx=0 tx=0).stop 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 shutdown_connections 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b4c43b4b30 0x55b4c43b3840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b4c4335bb0 0x55b4c43aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b4c432b2f0 0x55b4c434b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 --2- 172.21.15.46:0/4038242658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b4c432a9d0 0x55b4c434b2d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 >> 172.21.15.46:0/4038242658 conn(0x55b4c4326f60 msgr2=0x55b4c4331eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f1089ffb640 0 client.14982 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:17:40.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 shutdown_connections 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 1 -- 172.21.15.46:0/4038242658 wait complete. 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.770+0000 7f10aabef740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24451, 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:17:40.781 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 66.734516138999993, 2024-09-19T09:17:40.782 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:17:40.782 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:17:40.782 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:17:40.782 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 103.878588729 2024-09-19T09:17:40.782 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:17:40.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f108c0a32d0 msgr2=0x7f108c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f108c0a32d0 0x7f108c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f109c007ea0 tx=0x7f109c00c690 comp rx=0 tx=0).stop 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 msgr2=0x7f10a41985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 0x7f10a41985d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f109400b4a0 tx=0x7f109400b960 comp rx=0 tx=0).stop 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 shutdown_connections 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f108c0a32d0 0x7f108c0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10a410c170 0x7f10a419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a4103660 0x7f10a4198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 --2- 172.21.15.46:0/3044337011 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f10a4102d40 0x7f10a41985d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 >> 172.21.15.46:0/3044337011 conn(0x7f10a40fc7a0 msgr2=0x7f10a40fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 shutdown_connections 2024-09-19T09:17:40.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:40.771+0000 7f10a8816640 1 -- 172.21.15.46:0/3044337011 wait complete. 2024-09-19T09:17:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:40 smithi046 ceph-mon[31203]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:41.012 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:40 smithi115 ceph-mon[35055]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:41.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:40 smithi099 ceph-mon[35256]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:41.410 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:17:41.670 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 -- 172.21.15.46:0/230516034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 msgr2=0x7febec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 --2- 172.21.15.46:0/230516034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1067e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7febe0009900 tx=0x7febe002a410 comp rx=0 tx=0).stop 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 -- 172.21.15.46:0/230516034 shutdown_connections 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 --2- 172.21.15.46:0/230516034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1067e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 --2- 172.21.15.46:0/230516034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febec106f10 0x7febec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 --2- 172.21.15.46:0/230516034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febec101de0 0x7febec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 -- 172.21.15.46:0/230516034 >> 172.21.15.46:0/230516034 conn(0x7febec0fd8c0 msgr2=0x7febec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 -- 172.21.15.46:0/230516034 shutdown_connections 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 -- 172.21.15.46:0/230516034 wait complete. 2024-09-19T09:17:42.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.138+0000 7febf4683640 1 Processor -- start 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 -- start start 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febec101de0 0x7febec1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febec106f10 0x7febec19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7febec111f70 con 0x7febec102790 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7febec111df0 con 0x7febec106f10 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf4683640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7febec1120f0 con 0x7febec101de0 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50252/0 (socket says 172.21.15.46:50252) 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf2c20640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febec106f10 0x7febec19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 -- 172.21.15.46:0/1305797420 learned_addr learned my addr 172.21.15.46:0/1305797420 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:42.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf241f640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febec101de0 0x7febec1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 -- 172.21.15.46:0/1305797420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febec101de0 msgr2=0x7febec1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febec101de0 0x7febec1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 -- 172.21.15.46:0/1305797420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febec106f10 msgr2=0x7febec19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febec106f10 0x7febec19cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 -- 172.21.15.46:0/1305797420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febec19d460 con 0x7febec102790 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.139+0000 7febf1c1e640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1989f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7febe0006010 tx=0x7febe00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:42.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.140+0000 7febeb7fe640 1 -- 172.21.15.46:0/1305797420 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe003f030 con 0x7febec102790 2024-09-19T09:17:42.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.140+0000 7febeb7fe640 1 -- 172.21.15.46:0/1305797420 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe0003ce0 con 0x7febec102790 2024-09-19T09:17:42.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.140+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febec19d6f0 con 0x7febec102790 2024-09-19T09:17:42.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.140+0000 7febeb7fe640 1 -- 172.21.15.46:0/1305797420 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0035070 con 0x7febec102790 2024-09-19T09:17:42.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.140+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febec1a5030 con 0x7febec102790 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febeb7fe640 1 -- 172.21.15.46:0/1305797420 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7febe0042030 con 0x7febec102790 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 Processor -- start 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 -- start start 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e09770db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e0977b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e0977dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564e096d7090 con 0x564e097712f0 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564e0967ea70 con 0x564e097709d0 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.143+0000 7febf6a5c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564e096d3050 con 0x564e0977bbb0 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e09770db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf241f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e0977b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e09770db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52680/0 (socket says 172.21.15.46:52680) 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf241f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e0977b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50264/0 (socket says 172.21.15.46:50264) 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 -- 172.21.15.46:0/371816630 learned_addr learned my addr 172.21.15.46:0/371816630 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf1c1e640 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e0977dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 -- 172.21.15.46:0/371816630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 msgr2=0x564e0977dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e0977dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 -- 172.21.15.46:0/371816630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 msgr2=0x564e0977b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e0977b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 -- 172.21.15.46:0/371816630 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0968b130 con 0x564e097709d0 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf241f640 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e0977b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febeb7fe640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7febd40a3350 0x7febd40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf2c20640 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e09770db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febe4004620 tx=0x7febe400bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd07ac0011848a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febf241f640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7febd40a3350 0x7febd40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febeb7fe640 1 -- 172.21.15.46:0/1305797420 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7febe00eff70 con 0x7febec102790 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febe8ff9640 1 -- 172.21.15.46:0/371816630 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4003ba0 con 0x564e097709d0 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febe8ff9640 1 -- 172.21.15.46:0/371816630 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe4015070 con 0x564e097709d0 2024-09-19T09:17:42.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.144+0000 7febe8ff9640 1 -- 172.21.15.46:0/371816630 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe4011640 con 0x564e097709d0 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 -- 172.21.15.46:0/371816630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 msgr2=0x564e09770db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf241f640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7febd40a3350 0x7febd40a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x564e0976ddc0 tx=0x7febdc009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e09770db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febe4004620 tx=0x7febe400bb10 comp rx=0 tx=0).stop 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 -- 172.21.15.46:0/371816630 shutdown_connections 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e0977b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e0977dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 --2- 172.21.15.46:0/371816630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e09770db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 -- 172.21.15.46:0/371816630 >> 172.21.15.46:0/371816630 conn(0x564e0976cf60 msgr2=0x564e0976d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:42.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 -- 172.21.15.46:0/371816630 shutdown_connections 2024-09-19T09:17:42.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.145+0000 7febf6a5c740 1 -- 172.21.15.46:0/371816630 wait complete. 2024-09-19T09:17:42.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 -- start start 2024-09-19T09:17:42.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 Processor -- start 2024-09-19T09:17:42.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 0x564e0977b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097712f0 0x564e097787a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e09778ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564e0977e780 con 0x564e097709d0 2024-09-19T09:17:42.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564e09691f20 con 0x564e097712f0 2024-09-19T09:17:42.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564e0977e900 con 0x564e0977bbb0 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf6a5c740 10 client.0 _ll_register_callbacks cb 0x564e0965b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf241f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 0x564e0977b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf241f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 0x564e0977b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50272/0 (socket says 172.21.15.46:50272) 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf241f640 1 -- 172.21.15.46:0/3764573495 learned_addr learned my addr 172.21.15.46:0/3764573495 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf2c20640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e09778ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.146+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097712f0 0x564e097787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf241f640 1 -- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 msgr2=0x564e09778ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf241f640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e09778ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf241f640 1 -- 172.21.15.46:0/3764573495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097712f0 msgr2=0x564e097787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf241f640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097712f0 0x564e097787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf241f640 1 -- 172.21.15.46:0/3764573495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e094482b0 con 0x564e097709d0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097712f0 0x564e097787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf241f640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 0x564e0977b450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7febdc009550 tx=0x7febdc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c189a3cb6326df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febd1ffb640 1 -- 172.21.15.46:0/3764573495 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc011650 con 0x564e097709d0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febd1ffb640 1 -- 172.21.15.46:0/3764573495 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7febdc0117f0 con 0x564e097709d0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febe4015070 con 0x564e097709d0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febd1ffb640 1 -- 172.21.15.46:0/3764573495 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7febdc0119f0 con 0x564e097709d0 2024-09-19T09:17:42.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf6a5c740 10 client.14994 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e0978a100 con 0x564e097709d0 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.147+0000 7febd1ffb640 1 -- 172.21.15.46:0/3764573495 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe4015070 con 0x564e097709d0 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febd1ffb640 1 -- 172.21.15.46:0/3764573495 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7febdc026070 con 0x564e097709d0 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf6a5c740 10 client.14994 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf6a5c740 10 client.14994 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf6a5c740 20 client.14994 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e0978c760 0x564e0978dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf6a5c740 4 client.14994 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e096e4600 con 0x564e0978c760 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e0978c760 0x564e0978dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e0978c760 0x564e0978dbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d37638651f0b6597 server_cookie=3ca8abd658b13106 in_seq=0 out_seq=0 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.148+0000 7febd1ffb640 10 client.14994 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:17:42.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febd1ffb640 1 -- 172.21.15.46:0/3764573495 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e096e4600 con 0x564e0978c760 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febd1ffb640 10 client.14994 handle_command_reply: tid=0 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 client.14994 shutdown 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 msgr2=0x564e0977b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 0x564e0977b450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7febdc009550 tx=0x7febdc004ab0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 shutdown_connections 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e0978c760 0x564e0978dbd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e09778ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097712f0 0x564e097787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febd1ffb640 0 client.14994 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3764573495 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097709d0 0x564e0977b450 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 >> 172.21.15.46:0/3764573495 conn(0x564e0976cf60 msgr2=0x564e09772c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:42.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 shutdown_connections 2024-09-19T09:17:42.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 1 -- 172.21.15.46:0/3764573495 wait complete. 2024-09-19T09:17:42.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.149+0000 7febf6a5c740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 Processor -- start 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 -- start start 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e0978dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09795eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e097963f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564e0978bf10 con 0x564e097712f0 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564e0978c5e0 con 0x564e097709d0 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf6a5c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564e0978ccb0 con 0x564e0977bbb0 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf1c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09795eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf1c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09795eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50280/0 (socket says 172.21.15.46:50280) 2024-09-19T09:17:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf1c1e640 1 -- 172.21.15.46:0/1179169201 learned_addr learned my addr 172.21.15.46:0/1179169201 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.167+0000 7febf2c20640 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e097963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf241f640 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e0978dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf1c1e640 1 -- 172.21.15.46:0/1179169201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 msgr2=0x564e097963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf1c1e640 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e097963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf1c1e640 1 -- 172.21.15.46:0/1179169201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 msgr2=0x564e0978dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf1c1e640 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e0978dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf1c1e640 1 -- 172.21.15.46:0/1179169201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e097883c0 con 0x564e097712f0 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf241f640 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e0978dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febf1c1e640 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09795eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7febe0004650 tx=0x7febe0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a783122280c401 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febd3fff640 1 -- 172.21.15.46:0/1179169201 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0049040 con 0x564e097712f0 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febd3fff640 1 -- 172.21.15.46:0/1179169201 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febe003b580 con 0x564e097712f0 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.168+0000 7febd3fff640 1 -- 172.21.15.46:0/1179169201 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe00c5190 con 0x564e097712f0 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- 172.21.15.46:0/1179169201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 msgr2=0x564e09795eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09795eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7febe0004650 tx=0x7febe0003f90 comp rx=0 tx=0).stop 2024-09-19T09:17:42.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- 172.21.15.46:0/1179169201 shutdown_connections 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09795eb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e0977bbb0 0x564e097963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- 172.21.15.46:0/1179169201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e097709d0 0x564e0978dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- 172.21.15.46:0/1179169201 >> 172.21.15.46:0/1179169201 conn(0x564e0976cf60 msgr2=0x564e09777070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- 172.21.15.46:0/1179169201 shutdown_connections 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- 172.21.15.46:0/1179169201 wait complete. 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- start start 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 Processor -- start 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e097709d0 0x564e09791320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09791860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e0977bbb0 0x564e097f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564e0978da50 con 0x564e097712f0 2024-09-19T09:17:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564e0978d380 con 0x564e0977bbb0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.169+0000 7febf6a5c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564e0978e120 con 0x564e097709d0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf6a5c740 10 client.0 _ll_register_callbacks cb 0x7febdc003f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09791860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09791860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50286/0 (socket says 172.21.15.46:50286) 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 -- 172.21.15.46:0/3672164965 learned_addr learned my addr 172.21.15.46:0/3672164965 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf241f640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e097709d0 0x564e09791320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf2c20640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e0977bbb0 0x564e097f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 -- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e097709d0 msgr2=0x564e09791320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e097709d0 0x564e09791320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 -- 172.21.15.46:0/3672164965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e0977bbb0 msgr2=0x564e097f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e0977bbb0 0x564e097f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 -- 172.21.15.46:0/3672164965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e097f53a0 con 0x564e097712f0 2024-09-19T09:17:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf1c1e640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09791860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7febe0005ab0 tx=0x7febe00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8045822ca9812 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febd1ffb640 1 -- 172.21.15.46:0/3672164965 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe00d9020 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febd1ffb640 1 -- 172.21.15.46:0/3672164965 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7febe00b8c40 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e096deb10 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febd1ffb640 1 -- 172.21.15.46:0/3672164965 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7febe0049040 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf6a5c740 10 client.15000 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.170+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e097fa9c0 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febd1ffb640 1 -- 172.21.15.46:0/3672164965 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564e096deb10 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febd1ffb640 1 -- 172.21.15.46:0/3672164965 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7febe00bc830 con 0x564e097712f0 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf6a5c740 10 client.15000 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf6a5c740 10 client.15000 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf6a5c740 20 client.15000 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:42.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e097ff3e0 0x564e097fe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:42.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf6a5c740 4 client.15000 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:17:42.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "status"}) -- 0x564e0965b0e0 con 0x564e097ff3e0 2024-09-19T09:17:42.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf241f640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e097ff3e0 0x564e097fe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:42.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febd1ffb640 10 client.15000 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:17:42.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.171+0000 7febf241f640 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e097ff3e0 0x564e097fe0f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41acc151e2dde005 server_cookie=230efac14ca5e60c in_seq=0 out_seq=0 2024-09-19T09:17:42.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febd1ffb640 1 -- 172.21.15.46:0/3672164965 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564e0965b0e0 con 0x564e097ff3e0 2024-09-19T09:17:42.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febd1ffb640 10 client.15000 handle_command_reply: tid=0 2024-09-19T09:17:42.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 client.15000 shutdown 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 msgr2=0x564e09791860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09791860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7febe0005ab0 tx=0x7febe00057c0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 shutdown_connections 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x564e097ff3e0 0x564e097fe0f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564e097712f0 0x564e09791860 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e0977bbb0 0x564e097f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 --2- 172.21.15.46:0/3672164965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564e097709d0 0x564e09791320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 >> 172.21.15.46:0/3672164965 conn(0x564e0976cf60 msgr2=0x564e0976b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febd1ffb640 0 client.15000 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 shutdown_connections 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 1 -- 172.21.15.46:0/3672164965 wait complete. 2024-09-19T09:17:42.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.172+0000 7febf6a5c740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24463, 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 69.143348020999994, 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:17:42.183 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:17:42.184 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:17:42.184 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 102.65102067399999 2024-09-19T09:17:42.184 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:17:42.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7febd40a3350 msgr2=0x7febd40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7febd40a3350 0x7febd40a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x564e0976ddc0 tx=0x7febdc009760 comp rx=0 tx=0).stop 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 msgr2=0x7febec1989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1989f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7febe0006010 tx=0x7febe00042f0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 shutdown_connections 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7febd40a3350 0x7febd40a5810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febec102790 0x7febec1989f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febec106f10 0x7febec19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 --2- 172.21.15.46:0/1305797420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febec101de0 0x7febec1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 >> 172.21.15.46:0/1305797420 conn(0x7febec0fd8c0 msgr2=0x7febec0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 shutdown_connections 2024-09-19T09:17:42.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:42.173+0000 7febf4683640 1 -- 172.21.15.46:0/1305797420 wait complete. 2024-09-19T09:17:42.828 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:42 smithi046 ceph-mon[31203]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:42.859 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:17:43.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:42 smithi099 ceph-mon[35256]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:43.118 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:42 smithi115 ceph-mon[35055]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T09:17:43.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.597+0000 7f830f1ca640 1 -- 172.21.15.46:0/3818737249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308106f10 msgr2=0x7f830810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.597+0000 7f830f1ca640 1 --2- 172.21.15.46:0/3818737249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308106f10 0x7f830810ea90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8300009ca0 tx=0x7f830002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.597+0000 7f830f1ca640 1 -- 172.21.15.46:0/3818737249 shutdown_connections 2024-09-19T09:17:43.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.597+0000 7f830f1ca640 1 --2- 172.21.15.46:0/3818737249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308106f10 0x7f830810ea90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.597+0000 7f830f1ca640 1 --2- 172.21.15.46:0/3818737249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8308102790 0x7f83081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.597+0000 7f830f1ca640 1 --2- 172.21.15.46:0/3818737249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8308101de0 0x7f83081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 -- 172.21.15.46:0/3818737249 >> 172.21.15.46:0/3818737249 conn(0x7f83080fd8c0 msgr2=0x7f83080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:43.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 -- 172.21.15.46:0/3818737249 shutdown_connections 2024-09-19T09:17:43.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 -- 172.21.15.46:0/3818737249 wait complete. 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 Processor -- start 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 -- start start 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8308101de0 0x7f83080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 0x7f8308074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8308106f10 0x7f8308074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8308111f90 con 0x7f8308102790 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.598+0000 7f830f1ca640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8308111e10 con 0x7f8308101de0 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f830f1ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8308112110 con 0x7f8308106f10 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 0x7f8308074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 0x7f8308074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50312/0 (socket says 172.21.15.46:50312) 2024-09-19T09:17:43.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 -- 172.21.15.46:0/2208474701 learned_addr learned my addr 172.21.15.46:0/2208474701 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f830cf66640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8308101de0 0x7f83080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f830d767640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8308106f10 0x7f8308074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 -- 172.21.15.46:0/2208474701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8308106f10 msgr2=0x7f8308074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8308106f10 0x7f8308074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 -- 172.21.15.46:0/2208474701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8308101de0 msgr2=0x7f83080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8308101de0 0x7f83080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 -- 172.21.15.46:0/2208474701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83081a6910 con 0x7f8308102790 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8307fff640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 0x7f8308074a30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c890 tx=0x7f82fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8305ffb640 1 -- 172.21.15.46:0/2208474701 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc004220 con 0x7f8308102790 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8305ffb640 1 -- 172.21.15.46:0/2208474701 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82fc0043c0 con 0x7f8308102790 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83081a6c00 con 0x7f8308102790 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.599+0000 7f8305ffb640 1 -- 172.21.15.46:0/2208474701 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0049e0 con 0x7f8308102790 2024-09-19T09:17:43.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.600+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83081a7140 con 0x7f8308102790 2024-09-19T09:17:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.602+0000 7f8305ffb640 1 -- 172.21.15.46:0/2208474701 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f82fc0079b0 con 0x7f8308102790 2024-09-19T09:17:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.602+0000 7f83115a3740 1 Processor -- start 2024-09-19T09:17:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.602+0000 7f83115a3740 1 -- start start 2024-09-19T09:17:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f8305ffb640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f82f00a32d0 0x7f82f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f83115a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 0x55f95ac20db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f83115a3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac212f0 0x55f95ac2b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f83115a3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 0x55f95ac2dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f83115a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f95ab87090 con 0x55f95ac209d0 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f83115a3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f95ab2ea70 con 0x55f95ac2bbb0 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f83115a3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f95ab83050 con 0x55f95ac212f0 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f8305ffb640 1 -- 172.21.15.46:0/2208474701 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f82fc0cfbe0 con 0x7f8308102790 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 0x55f95ac20db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830d767640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f82f00a32d0 0x7f82f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 0x55f95ac20db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50316/0 (socket says 172.21.15.46:50316) 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 -- 172.21.15.46:0/1466911572 learned_addr learned my addr 172.21.15.46:0/1466911572 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f8307fff640 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac212f0 0x55f95ac2b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 -- 172.21.15.46:0/1466911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac212f0 msgr2=0x55f95ac2b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac212f0 0x55f95ac2b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 -- 172.21.15.46:0/1466911572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 msgr2=0x55f95ac2dfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 0x55f95ac2dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 -- 172.21.15.46:0/1466911572 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95ab3b130 con 0x55f95ac209d0 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830cf66640 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 0x55f95ac20db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b820 tx=0x7f82f800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9a829e1583abf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.603+0000 7f830d767640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f82f00a32d0 0x7f82f00a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8300006010 tx=0x7f83000093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f82eeffd640 1 -- 172.21.15.46:0/1466911572 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f800d950 con 0x55f95ac209d0 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f82eeffd640 1 -- 172.21.15.46:0/1466911572 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f8019070 con 0x55f95ac209d0 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f82eeffd640 1 -- 172.21.15.46:0/1466911572 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80123e0 con 0x55f95ac209d0 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 -- 172.21.15.46:0/1466911572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 msgr2=0x55f95ac20db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 0x55f95ac20db0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b820 tx=0x7f82f800bce0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 -- 172.21.15.46:0/1466911572 shutdown_connections 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 0x55f95ac2dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac212f0 0x55f95ac2b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 --2- 172.21.15.46:0/1466911572 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac209d0 0x55f95ac20db0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 -- 172.21.15.46:0/1466911572 >> 172.21.15.46:0/1466911572 conn(0x55f95ac1cf60 msgr2=0x55f95ac1d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 -- 172.21.15.46:0/1466911572 shutdown_connections 2024-09-19T09:17:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.604+0000 7f83115a3740 1 -- 172.21.15.46:0/1466911572 wait complete. 2024-09-19T09:17:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 -- start start 2024-09-19T09:17:43.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 Processor -- start 2024-09-19T09:17:43.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac2e780 con 0x55f95ac212f0 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f95ab41f20 con 0x55f95ac209d0 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac2e900 con 0x55f95ac2bbb0 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f83115a3740 10 client.0 _ll_register_callbacks cb 0x55f95ab0b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac286a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50332/0 (socket says 172.21.15.46:50332) 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.605+0000 7f8307fff640 1 -- 172.21.15.46:0/3181436990 learned_addr learned my addr 172.21.15.46:0/3181436990 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f830cf66640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f8307fff640 1 -- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 msgr2=0x55f95ac28be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f830d767640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f8307fff640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f8307fff640 1 -- 172.21.15.46:0/3181436990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 msgr2=0x55f95ac2b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f8307fff640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac2b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f8307fff640 1 -- 172.21.15.46:0/3181436990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95a8f82b0 con 0x55f95ac212f0 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f830cf66640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac2b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f830d767640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f8307fff640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac286a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f82fc09c000 tx=0x7f82fc09c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8add479b5f9d9f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f82e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f82e7fff640 1 -- 172.21.15.46:0/3181436990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc01d040 con 0x55f95ac212f0 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f82e7fff640 1 -- 172.21.15.46:0/3181436990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f82fc0a00f0 con 0x55f95ac212f0 2024-09-19T09:17:43.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82f8019070 con 0x55f95ac212f0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f82e7fff640 1 -- 172.21.15.46:0/3181436990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f82fc0a4ce0 con 0x55f95ac212f0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f83115a3740 10 client.15012 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f95ac39ff0 con 0x55f95ac212f0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.606+0000 7f82e7fff640 1 -- 172.21.15.46:0/3181436990 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82f8019070 con 0x55f95ac212f0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f82e7fff640 1 -- 172.21.15.46:0/3181436990 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f82fc0a4950 con 0x55f95ac212f0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f83115a3740 10 client.15012 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f83115a3740 10 client.15012 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f83115a3740 20 client.15012 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f83115a3740 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95ac3c5f0 0x55f95ac3da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f83115a3740 4 client.15012 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f95ab94600 con 0x55f95ac3c5f0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f830cf66640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95ac3c5f0 0x55f95ac3da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f830cf66640 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95ac3c5f0 0x55f95ac3da60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f69ef4f2a14eb4c server_cookie=2ebe09d1c1f5be4d in_seq=0 out_seq=0 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.607+0000 7f82e7fff640 10 client.15012 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f82e7fff640 1 -- 172.21.15.46:0/3181436990 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f95ab94600 con 0x55f95ac3c5f0 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f82e7fff640 10 client.15012 handle_command_reply: tid=0 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 client.15012 shutdown 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 msgr2=0x55f95ac286a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac286a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f82fc09c000 tx=0x7f82fc09c870 comp rx=0 tx=0).stop 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 shutdown_connections 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95ac3c5f0 0x55f95ac3da60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac286a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 --2- 172.21.15.46:0/3181436990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac2b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 >> 172.21.15.46:0/3181436990 conn(0x55f95ac1cf60 msgr2=0x55f95ac22c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:43.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f82e7fff640 0 client.15012 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:17:43.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 shutdown_connections 2024-09-19T09:17:43.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.608+0000 7f83115a3740 1 -- 172.21.15.46:0/3181436990 wait complete. 2024-09-19T09:17:43.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.609+0000 7f83115a3740 20 client.15012 trim_cache size 0 max 16384 2024-09-19T09:17:43.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 Processor -- start 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 -- start start 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac209d0 0x55f95ac3bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac3d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac3bda0 con 0x55f95ac212f0 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac3c470 con 0x55f95ac2bbb0 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f83115a3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac3cb40 con 0x55f95ac209d0 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.626+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac3d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac3d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50346/0 (socket says 172.21.15.46:50346) 2024-09-19T09:17:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 -- 172.21.15.46:0/1680323394 learned_addr learned my addr 172.21.15.46:0/1680323394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f830cf66640 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac209d0 0x55f95ac3bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 -- 172.21.15.46:0/1680323394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac209d0 msgr2=0x55f95ac3bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac209d0 0x55f95ac3bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 -- 172.21.15.46:0/1680323394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 msgr2=0x55f95ac28660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 -- 172.21.15.46:0/1680323394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95ac21120 con 0x55f95ac212f0 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f8307fff640 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac3d390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0cdc10 tx=0x7f82fc09c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6891cd97d65ba7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f82ee7fc640 1 -- 172.21.15.46:0/1680323394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc01d040 con 0x55f95ac212f0 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f82ee7fc640 1 -- 172.21.15.46:0/1680323394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82fc0b5060 con 0x55f95ac212f0 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.627+0000 7f82ee7fc640 1 -- 172.21.15.46:0/1680323394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0a4850 con 0x55f95ac212f0 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 -- 172.21.15.46:0/1680323394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 msgr2=0x55f95ac3d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac3d390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0cdc10 tx=0x7f82fc09c8e0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 -- 172.21.15.46:0/1680323394 shutdown_connections 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac3d390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac2bbb0 0x55f95ac28660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 --2- 172.21.15.46:0/1680323394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac209d0 0x55f95ac3bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 -- 172.21.15.46:0/1680323394 >> 172.21.15.46:0/1680323394 conn(0x55f95ac1cf60 msgr2=0x55f95ac17ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 -- 172.21.15.46:0/1680323394 shutdown_connections 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 -- 172.21.15.46:0/1680323394 wait complete. 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 -- start start 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.628+0000 7f83115a3740 1 Processor -- start 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac40c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac3d8e0 con 0x55f95ac212f0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac3d210 con 0x55f95ac209d0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f95ac3dfb0 con 0x55f95ac2bbb0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 10 client.0 _ll_register_callbacks cb 0x7f82fc00a520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50352/0 (socket says 172.21.15.46:50352) 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 -- 172.21.15.46:0/2536482984 learned_addr learned my addr 172.21.15.46:0/2536482984 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f830d767640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 -- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 msgr2=0x55f95ac416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f830cf66640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac40c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 -- 172.21.15.46:0/2536482984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 msgr2=0x55f95ac40c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac40c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 -- 172.21.15.46:0/2536482984 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95aca4ef0 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f8307fff640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac411b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f82fc09c000 tx=0x7f82fc005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7f42d891ff8088 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f82e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f82e7fff640 1 -- 172.21.15.46:0/2536482984 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc01d040 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f82e7fff640 1 -- 172.21.15.46:0/2536482984 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f82fc0a4a50 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82fc0b5060 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f82e7fff640 1 -- 172.21.15.46:0/2536482984 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f82fc0a9050 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 10 client.15018 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.629+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f95aca61d0 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f82e7fff640 1 -- 172.21.15.46:0/2536482984 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82fc0b5060 con 0x55f95ac212f0 2024-09-19T09:17:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f82e7fff640 1 -- 172.21.15.46:0/2536482984 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f82fc09afc0 con 0x55f95ac212f0 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f83115a3740 10 client.15018 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f83115a3740 10 client.15018 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f83115a3740 20 client.15018 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f83115a3740 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95acaa800 0x55f95aca9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f83115a3740 4 client.15018 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "status"}) -- 0x55f95ab8eb10 con 0x55f95acaa800 2024-09-19T09:17:43.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.630+0000 7f830cf66640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95acaa800 0x55f95aca9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:43.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f830cf66640 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95acaa800 0x55f95aca9510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b0f5622cb833cf0 server_cookie=39b8135e611fb352 in_seq=0 out_seq=0 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f82e7fff640 10 client.15018 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f82e7fff640 1 -- 172.21.15.46:0/2536482984 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f95ab8eb10 con 0x55f95acaa800 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f82e7fff640 10 client.15018 handle_command_reply: tid=0 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 client.15018 shutdown 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 msgr2=0x55f95ac411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac411b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f82fc09c000 tx=0x7f82fc005300 comp rx=0 tx=0).stop 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 shutdown_connections 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55f95acaa800 0x55f95aca9510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f95ac212f0 0x55f95ac411b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f95ac2bbb0 0x55f95ac416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 --2- 172.21.15.46:0/2536482984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95ac209d0 0x55f95ac40c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f82e7fff640 0 client.15018 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 >> 172.21.15.46:0/2536482984 conn(0x55f95ac1cf60 msgr2=0x55f95ac28660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 shutdown_connections 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 1 -- 172.21.15.46:0/2536482984 wait complete. 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.631+0000 7f83115a3740 20 client.15018 trim_cache size 0 max 16384 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:17:43.640 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24472, 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 71.609385860000003, 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 98.828594116000005 2024-09-19T09:17:43.641 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f82f00a32d0 msgr2=0x7f82f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f82f00a32d0 0x7f82f00a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8300006010 tx=0x7f83000093f0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 msgr2=0x7f8308074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 0x7f8308074a30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00c890 tx=0x7f82fc00cd50 comp rx=0 tx=0).stop 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 shutdown_connections 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f82f00a32d0 0x7f82f00a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8308102790 0x7f8308074a30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8308106f10 0x7f8308074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 --2- 172.21.15.46:0/2208474701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8308101de0 0x7f83080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 >> 172.21.15.46:0/2208474701 conn(0x7f83080fd8c0 msgr2=0x7f83080fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 shutdown_connections 2024-09-19T09:17:43.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:43.632+0000 7f830f1ca640 1 -- 172.21.15.46:0/2208474701 wait complete. 2024-09-19T09:17:44.311 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:17:44.567 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:44.949 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:44 smithi046 ceph-mon[31203]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T09:17:45.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:44 smithi099 ceph-mon[35256]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T09:17:45.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 -- 172.21.15.46:0/655342016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41036e0 msgr2=0x7f51a4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 --2- 172.21.15.46:0/655342016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41036e0 0x7f51a4107b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5198009930 tx=0x7f519802a420 comp rx=0 tx=0).stop 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 -- 172.21.15.46:0/655342016 shutdown_connections 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 --2- 172.21.15.46:0/655342016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41036e0 0x7f51a4107b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 --2- 172.21.15.46:0/655342016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41082a0 0x7f51a410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 --2- 172.21.15.46:0/655342016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51a4102d30 0x7f51a4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 -- 172.21.15.46:0/655342016 >> 172.21.15.46:0/655342016 conn(0x7f51a40fc7d0 msgr2=0x7f51a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 -- 172.21.15.46:0/655342016 shutdown_connections 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 -- 172.21.15.46:0/655342016 wait complete. 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.032+0000 7f51a98c4640 1 Processor -- start 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 -- start start 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51a4102d30 0x7f51a4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41036e0 0x7f51a4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 0x7f51a419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4112060 con 0x7f51a41082a0 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f51a4111ee0 con 0x7f51a4102d30 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a98c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f51a41121e0 con 0x7f51a41036e0 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 0x7f51a419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 0x7f51a419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50368/0 (socket says 172.21.15.46:50368) 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 -- 172.21.15.46:0/1633387689 learned_addr learned my addr 172.21.15.46:0/1633387689 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51a4102d30 0x7f51a4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41036e0 0x7f51a4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 -- 172.21.15.46:0/1633387689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41036e0 msgr2=0x7f51a4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41036e0 0x7f51a4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 -- 172.21.15.46:0/1633387689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51a4102d30 msgr2=0x7f51a4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51a4102d30 0x7f51a4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 -- 172.21.15.46:0/1633387689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a419d610 con 0x7f51a41082a0 2024-09-19T09:17:45.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41036e0 0x7f51a4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.033+0000 7f51a37fe640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 0x7f51a419cf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e970 tx=0x7f519c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.034+0000 7f51a88c2640 1 -- 172.21.15.46:0/1633387689 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c00ccc0 con 0x7f51a41082a0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.034+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a419d900 con 0x7f51a41082a0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.034+0000 7f51a88c2640 1 -- 172.21.15.46:0/1633387689 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f519c00ce60 con 0x7f51a41082a0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.034+0000 7f51a88c2640 1 -- 172.21.15.46:0/1633387689 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f519c010490 con 0x7f51a41082a0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.034+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a41a51e0 con 0x7f51a41082a0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.036+0000 7f51a88c2640 1 -- 172.21.15.46:0/1633387689 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f519c005020 con 0x7f51a41082a0 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.036+0000 7f51abc9d740 1 Processor -- start 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.036+0000 7f51abc9d740 1 -- start start 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.036+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e990db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.036+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9912f0 0x556d1e99b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e99dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51abc9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556d1e8f7090 con 0x556d1e9909d0 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51abc9d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556d1e89ea70 con 0x556d1e99bbb0 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51abc9d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556d1e8f3050 con 0x556d1e9912f0 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a88c2640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f518c0a32d0 0x7f518c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e990db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e990db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50376/0 (socket says 172.21.15.46:50376) 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 -- 172.21.15.46:0/2312711462 learned_addr learned my addr 172.21.15.46:0/2312711462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a88c2640 1 -- 172.21.15.46:0/1633387689 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f519c0cffe0 con 0x7f51a41082a0 2024-09-19T09:17:45.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a37fe640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f518c0a32d0 0x7f518c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e99dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9912f0 0x556d1e99b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 -- 172.21.15.46:0/2312711462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9912f0 msgr2=0x556d1e99b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9912f0 0x556d1e99b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 -- 172.21.15.46:0/2312711462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 msgr2=0x556d1e99dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e99dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 -- 172.21.15.46:0/2312711462 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d1e8ab130 con 0x556d1e9909d0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a27fc640 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e990db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5198006010 tx=0x7f5198005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d9520fa3d3ba05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f51a37fe640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f518c0a32d0 0x7f518c0a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c6a0 tx=0x7f519c098040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.037+0000 7f5189ffb640 1 -- 172.21.15.46:0/2312711462 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198035050 con 0x556d1e9909d0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f5189ffb640 1 -- 172.21.15.46:0/2312711462 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51980318b0 con 0x556d1e9909d0 2024-09-19T09:17:45.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f5189ffb640 1 -- 172.21.15.46:0/2312711462 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51980046c0 con 0x556d1e9909d0 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 -- 172.21.15.46:0/2312711462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 msgr2=0x556d1e990db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e990db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5198006010 tx=0x7f5198005bb0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 -- 172.21.15.46:0/2312711462 shutdown_connections 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e99dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9912f0 0x556d1e99b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 --2- 172.21.15.46:0/2312711462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e990db0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 -- 172.21.15.46:0/2312711462 >> 172.21.15.46:0/2312711462 conn(0x556d1e98cf60 msgr2=0x556d1e98d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 -- 172.21.15.46:0/2312711462 shutdown_connections 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.038+0000 7f51abc9d740 1 -- 172.21.15.46:0/2312711462 wait complete. 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 -- start start 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 Processor -- start 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e99b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e998810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e998d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556d1e99e780 con 0x556d1e9909d0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556d1e8b1f20 con 0x556d1e9912f0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556d1e99e900 con 0x556d1e99bbb0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51abc9d740 10 client.0 _ll_register_callbacks cb 0x556d1e87b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e99b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e99b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50382/0 (socket says 172.21.15.46:50382) 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.039+0000 7f51a27fc640 1 -- 172.21.15.46:0/1836150943 learned_addr learned my addr 172.21.15.46:0/1836150943 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e998810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e998d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 -- 172.21.15.46:0/1836150943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 msgr2=0x556d1e998d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e998d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 -- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 msgr2=0x556d1e998810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e998810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 -- 172.21.15.46:0/1836150943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d1e6682b0 con 0x556d1e9909d0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e99b4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5198000c00 tx=0x7f51980053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ac4d40795a254e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f5182ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f5182ffd640 1 -- 172.21.15.46:0/1836150943 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198035070 con 0x556d1e9909d0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f5182ffd640 1 -- 172.21.15.46:0/1836150943 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f51980035f0 con 0x556d1e9909d0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51980318b0 con 0x556d1e9909d0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f5182ffd640 1 -- 172.21.15.46:0/1836150943 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f51980037f0 con 0x556d1e9909d0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51abc9d740 10 client.15030 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d1e9aa100 con 0x556d1e9909d0 2024-09-19T09:17:45.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.040+0000 7f5182ffd640 1 -- 172.21.15.46:0/1836150943 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51980318b0 con 0x556d1e9909d0 2024-09-19T09:17:45.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f5182ffd640 1 -- 172.21.15.46:0/1836150943 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5198057a90 con 0x556d1e9909d0 2024-09-19T09:17:45.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51abc9d740 10 client.15030 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:45.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51abc9d740 10 client.15030 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51abc9d740 20 client.15030 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1e9ac1f0 0x556d1e9ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51abc9d740 4 client.15030 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d1e904600 con 0x556d1e9ac1f0 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1e9ac1f0 0x556d1e9ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f5182ffd640 10 client.15030 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.041+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1e9ac1f0 0x556d1e9ab450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd81d9b2da2f6f1 server_cookie=a89a5a17b8bd1a5 in_seq=0 out_seq=0 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.042+0000 7f5182ffd640 1 -- 172.21.15.46:0/1836150943 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d1e904600 con 0x556d1e9ac1f0 2024-09-19T09:17:45.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.042+0000 7f5182ffd640 10 client.15030 handle_command_reply: tid=0 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.042+0000 7f51abc9d740 1 client.15030 shutdown 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.042+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 msgr2=0x556d1e99b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.042+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e99b4c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5198000c00 tx=0x7f51980053b0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 shutdown_connections 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1e9ac1f0 0x556d1e9ab450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e998d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e998810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1836150943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e99b4c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 >> 172.21.15.46:0/1836150943 conn(0x556d1e98cf60 msgr2=0x556d1e992c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f5182ffd640 0 client.15030 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:17:45.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 shutdown_connections 2024-09-19T09:17:45.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 1 -- 172.21.15.46:0/1836150943 wait complete. 2024-09-19T09:17:45.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.043+0000 7f51abc9d740 20 client.15030 trim_cache size 0 max 16384 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 Processor -- start 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 -- start start 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e9ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e9acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e9abb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556d1e9ab9a0 con 0x556d1e9909d0 2024-09-19T09:17:45.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556d1e9ac070 con 0x556d1e9912f0 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51abc9d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556d1e9ac740 con 0x556d1e99bbb0 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e9ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e9ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50384/0 (socket says 172.21.15.46:50384) 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 -- 172.21.15.46:0/3812981093 learned_addr learned my addr 172.21.15.46:0/3812981093 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 -- 172.21.15.46:0/3812981093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 msgr2=0x556d1e9abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e9abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 -- 172.21.15.46:0/3812981093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 msgr2=0x556d1e9acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e9acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 -- 172.21.15.46:0/3812981093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d1e996d80 con 0x556d1e9909d0 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.061+0000 7f51a27fc640 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e9ab450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f51980092a0 tx=0x7f5198005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e10e147542a1c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:45.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51897fa640 1 -- 172.21.15.46:0/3812981093 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198035070 con 0x556d1e9909d0 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51897fa640 1 -- 172.21.15.46:0/3812981093 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5198050070 con 0x556d1e9909d0 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51897fa640 1 -- 172.21.15.46:0/3812981093 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5198000e60 con 0x556d1e9909d0 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 -- 172.21.15.46:0/3812981093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 msgr2=0x556d1e9ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e9ab450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f51980092a0 tx=0x7f5198005fd0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 -- 172.21.15.46:0/3812981093 shutdown_connections 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e99bbb0 0x556d1e9abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e9912f0 0x556d1e9acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 --2- 172.21.15.46:0/3812981093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9909d0 0x556d1e9ab450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 -- 172.21.15.46:0/3812981093 >> 172.21.15.46:0/3812981093 conn(0x556d1e98cf60 msgr2=0x556d1e987ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 -- 172.21.15.46:0/3812981093 shutdown_connections 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.062+0000 7f51abc9d740 1 -- 172.21.15.46:0/3812981093 wait complete. 2024-09-19T09:17:45.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 -- start start 2024-09-19T09:17:45.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 Processor -- start 2024-09-19T09:17:45.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9909d0 0x556d1e9ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 0x556d1e9aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e9af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556d1e9ad4e0 con 0x556d1e9912f0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556d1e9ace10 con 0x556d1e99bbb0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556d1e9adbb0 con 0x556d1e9909d0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51abc9d740 10 client.0 _ll_register_callbacks cb 0x7f519c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51a2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 0x556d1e9aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51a2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 0x556d1e9aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50396/0 (socket says 172.21.15.46:50396) 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51a2ffd640 1 -- 172.21.15.46:0/1058865833 learned_addr learned my addr 172.21.15.46:0/1058865833 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9909d0 0x556d1e9ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.063+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e9af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a2ffd640 1 -- 172.21.15.46:0/1058865833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9909d0 msgr2=0x556d1e9ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9909d0 0x556d1e9ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a2ffd640 1 -- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 msgr2=0x556d1e9af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e9af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a2ffd640 1 -- 172.21.15.46:0/1058865833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d1ea14ac0 con 0x556d1e9912f0 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e9af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51a2ffd640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 0x556d1e9aeda0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5194003b00 tx=0x7f5194013a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa046a3f87a90772 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f5182ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f5182ffd640 1 -- 172.21.15.46:0/1058865833 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5194010750 con 0x556d1e9912f0 2024-09-19T09:17:45.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f5182ffd640 1 -- 172.21.15.46:0/1058865833 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f51940108f0 con 0x556d1e9912f0 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5198050070 con 0x556d1e9912f0 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f5182ffd640 1 -- 172.21.15.46:0/1058865833 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5194010b10 con 0x556d1e9912f0 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51abc9d740 10 client.15036 fetch_fsmap learned FSMap version 27 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556d1ea15de0 con 0x556d1e9912f0 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.064+0000 7f5182ffd640 1 -- 172.21.15.46:0/1058865833 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5198050070 con 0x556d1e9912f0 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f5182ffd640 1 -- 172.21.15.46:0/1058865833 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5194025030 con 0x556d1e9912f0 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 10 client.15036 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 10 client.15036 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 20 client.15036 populate_metadata read hostname 'smithi046' 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1ea1a9f0 0x556d1ea19700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 4 client.15036 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:17:45.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "status"}) -- 0x556d1e8feb10 con 0x556d1ea1a9f0 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1ea1a9f0 0x556d1ea19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51a27fc640 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1ea1a9f0 0x556d1ea19700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c35a534030b9295f server_cookie=d8ba998a2285b056 in_seq=0 out_seq=0 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f5182ffd640 10 client.15036 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f5182ffd640 1 -- 172.21.15.46:0/1058865833 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556d1e8feb10 con 0x556d1ea1a9f0 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f5182ffd640 10 client.15036 handle_command_reply: tid=0 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.065+0000 7f51abc9d740 1 client.15036 shutdown 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 msgr2=0x556d1e9aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 0x556d1e9aeda0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5194003b00 tx=0x7f5194013a50 comp rx=0 tx=0).stop 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 shutdown_connections 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556d1ea1a9f0 0x556d1ea19700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556d1e9912f0 0x556d1e9aeda0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556d1e99bbb0 0x556d1e9af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 --2- 172.21.15.46:0/1058865833 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556d1e9909d0 0x556d1e9ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 >> 172.21.15.46:0/1058865833 conn(0x556d1e98cf60 msgr2=0x556d1e996f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f5182ffd640 0 client.15036 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 shutdown_connections 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 1 -- 172.21.15.46:0/1058865833 wait complete. 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.066+0000 7f51abc9d740 20 client.15036 trim_cache size 0 max 16384 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:17:45.075 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24476, 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 80.079905236000002, 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 90.876267761999998 2024-09-19T09:17:45.076 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:17:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f518c0a32d0 msgr2=0x7f518c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f518c0a32d0 0x7f518c0a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f519c00c6a0 tx=0x7f519c098040 comp rx=0 tx=0).stop 2024-09-19T09:17:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 msgr2=0x7f51a419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 0x7f51a419cf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f519c00e970 tx=0x7f519c00ed70 comp rx=0 tx=0).stop 2024-09-19T09:17:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 shutdown_connections 2024-09-19T09:17:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f518c0a32d0 0x7f518c0a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f51a41082a0 0x7f51a419cf30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f51a41036e0 0x7f51a4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 --2- 172.21.15.46:0/1633387689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f51a4102d30 0x7f51a4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 >> 172.21.15.46:0/1633387689 conn(0x7f51a40fc7d0 msgr2=0x7f51a4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 shutdown_connections 2024-09-19T09:17:45.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:45.067+0000 7f51a98c4640 1 -- 172.21.15.46:0/1633387689 wait complete. 2024-09-19T09:17:45.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:44 smithi115 ceph-mon[35055]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T09:17:45.744 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:17:45.744 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:17:46.320 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:17:46.320 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:17:46.590 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:46.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:46 smithi046 ceph-mon[31203]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:17:47.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:46 smithi099 ceph-mon[35256]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:17:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 -- 172.21.15.46:0/2630675645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1530102e00 msgr2=0x7f1530103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 --2- 172.21.15.46:0/2630675645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1530102e00 0x7f1530103280 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1520009900 tx=0x7f152002a410 comp rx=0 tx=0).stop 2024-09-19T09:17:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 -- 172.21.15.46:0/2630675645 shutdown_connections 2024-09-19T09:17:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 --2- 172.21.15.46:0/2630675645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1530102e00 0x7f1530103280 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 --2- 172.21.15.46:0/2630675645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15301037c0 0x7f153010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 --2- 172.21.15.46:0/2630675645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1530101c00 0x7f1530102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 -- 172.21.15.46:0/2630675645 >> 172.21.15.46:0/2630675645 conn(0x7f15300fd390 msgr2=0x7f15300ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 -- 172.21.15.46:0/2630675645 shutdown_connections 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.006+0000 7f1537efb640 1 -- 172.21.15.46:0/2630675645 wait complete. 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 Processor -- start 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 -- start start 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1530101c00 0x7f1530197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530102e00 0x7f15301984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 0x7f153019f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f153010d930 con 0x7f15301037c0 2024-09-19T09:17:47.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f153010d7b0 con 0x7f1530101c00 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1537efb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f153010dab0 con 0x7f1530102e00 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 0x7f153019f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 0x7f153019f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50414/0 (socket says 172.21.15.46:50414) 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 -- 172.21.15.46:0/396759921 learned_addr learned my addr 172.21.15.46:0/396759921 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1535c97640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1530101c00 0x7f1530197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1535496640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530102e00 0x7f15301984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 -- 172.21.15.46:0/396759921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530102e00 msgr2=0x7f15301984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530102e00 0x7f15301984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 -- 172.21.15.46:0/396759921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1530101c00 msgr2=0x7f1530197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1530101c00 0x7f1530197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 -- 172.21.15.46:0/396759921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153019fbe0 con 0x7f15301037c0 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.007+0000 7f1536498640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 0x7f153019f570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f152800cad0 tx=0x7f152800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:47.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.008+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152800ad60 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.008+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1528005020 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.008+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152800f6b0 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.008+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153019fed0 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.008+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15301a0350 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.009+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1530108fa0 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.010+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1528005560 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.011+0000 7f1526ffd640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f151c0a3300 0x7f151c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.011+0000 7f1535c97640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f151c0a3300 0x7f151c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.011+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f15280cfd50 con 0x7f15301037c0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.011+0000 7f1535c97640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f151c0a3300 0x7f151c0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1530102c60 tx=0x7f152c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:47.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.014+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1528014030 con 0x7f15301037c0 2024-09-19T09:17:47.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.207+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1530062630 con 0x7f151c0a3300 2024-09-19T09:17:47.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:46 smithi115 ceph-mon[35055]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:17:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.208+0000 7f1526ffd640 1 -- 172.21.15.46:0/396759921 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1530062630 con 0x7f151c0a3300 2024-09-19T09:17:47.210 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2024-09-19T09:17:47.210 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2024-09-19T09:17:47.210 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f151c0a3300 msgr2=0x7f151c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f151c0a3300 0x7f151c0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1530102c60 tx=0x7f152c009110 comp rx=0 tx=0).stop 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 msgr2=0x7f153019f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 0x7f153019f570 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f152800cad0 tx=0x7f152800ced0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 shutdown_connections 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f151c0a3300 0x7f151c0a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15301037c0 0x7f153019f570 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1530102e00 0x7f15301984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 --2- 172.21.15.46:0/396759921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1530101c00 0x7f1530197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 >> 172.21.15.46:0/396759921 conn(0x7f15300fd390 msgr2=0x7f1530106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 shutdown_connections 2024-09-19T09:17:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:47.210+0000 7f1537efb640 1 -- 172.21.15.46:0/396759921 wait complete. 2024-09-19T09:17:47.959 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:17:48.222 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 -- 172.21.15.46:0/4191813140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c1026a0 msgr2=0x7f3b8c104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 --2- 172.21.15.46:0/4191813140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c104a90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c009900 tx=0x7f3b7c02a410 comp rx=0 tx=0).stop 2024-09-19T09:17:48.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 -- 172.21.15.46:0/4191813140 shutdown_connections 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 --2- 172.21.15.46:0/4191813140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c107900 0x7f3b8c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 --2- 172.21.15.46:0/4191813140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 --2- 172.21.15.46:0/4191813140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c104a90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 -- 172.21.15.46:0/4191813140 >> 172.21.15.46:0/4191813140 conn(0x7f3b8c0fc2a0 msgr2=0x7f3b8c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 -- 172.21.15.46:0/4191813140 shutdown_connections 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.684+0000 7f3b921c6640 1 -- 172.21.15.46:0/4191813140 wait complete. 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 Processor -- start 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 -- start start 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8c107900 0x7f3b8c19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10d920 con 0x7f3b8c104fd0 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10d7a0 con 0x7f3b8c1026a0 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.685+0000 7f3b921c6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c10daa0 con 0x7f3b8c107900 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33928/0 (socket says 172.21.15.46:33928) 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 -- 172.21.15.46:0/1974429496 learned_addr learned my addr 172.21.15.46:0/1974429496 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8b7fe640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 -- 172.21.15.46:0/1974429496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8c107900 msgr2=0x7f3b8c19f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8c107900 0x7f3b8c19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 -- 172.21.15.46:0/1974429496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c1026a0 msgr2=0x7f3b8c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 -- 172.21.15.46:0/1974429496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c19fb20 con 0x7f3b8c104fd0 2024-09-19T09:17:48.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8b7fe640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b8affd640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c198430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c970 tx=0x7f3b8000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80014070 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b80004440 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c19fe10 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000f450 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.686+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c1a0390 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.687+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c0fdd90 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.689+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3b80017070 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.689+0000 7f3b88ff9640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b740a3380 0x7f3b740a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.689+0000 7f3b8b7fe640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b740a3380 0x7f3b740a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.689+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3b800cf570 con 0x7f3b8c104fd0 2024-09-19T09:17:48.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.690+0000 7f3b8b7fe640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b740a3380 0x7f3b740a5840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:48.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.694+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b8001e030 con 0x7f3b8c104fd0 2024-09-19T09:17:48.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.879+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3b8c062630 con 0x7f3b740a3380 2024-09-19T09:17:48.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:48 smithi046 ceph-mon[31203]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:17:48.881 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:48 smithi046 ceph-mon[31203]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:48.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.891+0000 7f3b88ff9640 1 -- 172.21.15.46:0/1974429496 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3b8c062630 con 0x7f3b740a3380 2024-09-19T09:17:48.893 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:17:48.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.a smithi046 running (97s) 21s ago 97s 19.2M - 19.1.1-361-g2f599a46 d2baa855c067 c98a3b20441a 2024-09-19T09:17:48.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.b smithi099 running (95s) 27s ago 94s 26.6M - 19.1.1-361-g2f599a46 d2baa855c067 c5a33ce3e8cc 2024-09-19T09:17:48.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.c smithi115 running (109s) 27s ago 109s 17.8M - 19.1.1-361-g2f599a46 d2baa855c067 045bf3231bd9 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.d smithi046 running (117s) 21s ago 117s 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 1d465c309b4c 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.e smithi099 running (114s) 27s ago 114s 17.9M - 19.1.1-361-g2f599a46 d2baa855c067 b2da851b1298 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.f smithi115 running (112s) 27s ago 111s 20.1M - 19.1.1-361-g2f599a46 d2baa855c067 35e80748627e 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.g smithi046 running (101s) 21s ago 100s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 b7ba8648749e 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.h smithi099 running (107s) 27s ago 106s 19.3M - 19.1.1-361-g2f599a46 d2baa855c067 b7c1ee3d2906 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.i smithi115 running (104s) 27s ago 104s 18.2M - 19.1.1-361-g2f599a46 d2baa855c067 1e4d6b948a8f 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.j smithi046 running (2m) 21s ago 2m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 acd14ab5840e 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.k smithi099 running (2m) 27s ago 2m 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 49fce7ac9a03 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mds.l smithi115 running (2m) 27s ago 2m 16.2M - 19.1.1-361-g2f599a46 d2baa855c067 ddd13913a268 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.x smithi046 *:9283,8765 running (8m) 21s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 baa26900a671 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.y smithi099 *:8443,8765 running (7m) 27s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 39b5900b3e3e 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.z smithi115 *:8443,8765 running (7m) 27s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 ba63900103e8 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mon.a smithi046 running (9m) 21s ago 9m 53.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 96dfa5da0704 2024-09-19T09:17:48.894 INFO:teuthology.orchestra.run.smithi046.stdout:mon.b smithi099 running (7m) 27s ago 7m 38.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ebf1daa33973 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:mon.c smithi115 running (7m) 27s ago 7m 40.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 dc23161d66ef 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 21s ago 7m 45.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 3644dfc0cc04 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi099 running (6m) 27s ago 6m 45.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6a3ab28930b6 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi115 running (6m) 27s ago 6m 47.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 745ed83d0bb7 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi046 running (5m) 21s ago 5m 43.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 2211a535f620 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi099 running (5m) 27s ago 5m 55.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f47a79489c67 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi115 running (4m) 27s ago 4m 55.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 7156dc26ee8a 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 smithi046 running (4m) 21s ago 4m 42.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 cd84debaeb42 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 smithi099 running (4m) 27s ago 4m 53.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4cef91302df7 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.8 smithi115 running (3m) 27s ago 3m 45.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 74ac9206cd0e 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.9 smithi046 running (3m) 21s ago 3m 44.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 d1c1fc8c58d6 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.10 smithi099 running (2m) 27s ago 2m 45.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1ae1b574e1c6 2024-09-19T09:17:48.895 INFO:teuthology.orchestra.run.smithi046.stdout:osd.11 smithi115 running (2m) 27s ago 2m 39.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f63f9b56430c 2024-09-19T09:17:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.893+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b740a3380 msgr2=0x7f3b740a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.893+0000 7f3b921c6640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b740a3380 0x7f3b740a5840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c031400 comp rx=0 tx=0).stop 2024-09-19T09:17:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.893+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 msgr2=0x7f3b8c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.893+0000 7f3b921c6640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c198430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c970 tx=0x7f3b8000ce30 comp rx=0 tx=0).stop 2024-09-19T09:17:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.893+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 shutdown_connections 2024-09-19T09:17:48.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3b740a3380 0x7f3b740a5840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3b8c104fd0 0x7f3b8c198430 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3b8c107900 0x7f3b8c19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 --2- 172.21.15.46:0/1974429496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8c1026a0 0x7f3b8c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 >> 172.21.15.46:0/1974429496 conn(0x7f3b8c0fc2a0 msgr2=0x7f3b8c102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 shutdown_connections 2024-09-19T09:17:48.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:48.894+0000 7f3b921c6640 1 -- 172.21.15.46:0/1974429496 wait complete. 2024-09-19T09:17:49.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:48 smithi099 ceph-mon[35256]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:17:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:48 smithi099 ceph-mon[35256]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:49.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:48 smithi115 ceph-mon[35055]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T09:17:49.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:48 smithi115 ceph-mon[35055]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:49.512 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:17:49.767 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:50.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:49 smithi046 ceph-mon[31203]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:50.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:49 smithi099 ceph-mon[35256]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:50.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:49 smithi115 ceph-mon[35055]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:50.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 -- 172.21.15.46:0/2227117302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 msgr2=0x7fb16c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 --2- 172.21.15.46:0/2227117302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c108f60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb164009ca0 tx=0x7fb16402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 -- 172.21.15.46:0/2227117302 shutdown_connections 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 --2- 172.21.15.46:0/2227117302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c108f60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 --2- 172.21.15.46:0/2227117302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c101d10 0x7fb16c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 --2- 172.21.15.46:0/2227117302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb16c100b10 0x7fb16c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 -- 172.21.15.46:0/2227117302 >> 172.21.15.46:0/2227117302 conn(0x7fb16c0fc2a0 msgr2=0x7fb16c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 -- 172.21.15.46:0/2227117302 shutdown_connections 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.269+0000 7fb17477e640 1 -- 172.21.15.46:0/2227117302 wait complete. 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 Processor -- start 2024-09-19T09:17:50.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 -- start start 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c100b10 0x7fb16c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb16c101d10 0x7fb16c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10c7f0 con 0x7fb16c1026d0 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10c670 con 0x7fb16c101d10 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17477e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c10c970 con 0x7fb16c100b10 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb172d1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb172d1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c19f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33952/0 (socket says 172.21.15.46:33952) 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb172d1b640 1 -- 172.21.15.46:0/2217561355 learned_addr learned my addr 172.21.15.46:0/2217561355 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb171d19640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb16c101d10 0x7fb16c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.270+0000 7fb17251a640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c100b10 0x7fb16c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb172d1b640 1 -- 172.21.15.46:0/2217561355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c100b10 msgr2=0x7fb16c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb172d1b640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c100b10 0x7fb16c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb172d1b640 1 -- 172.21.15.46:0/2217561355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb16c101d10 msgr2=0x7fb16c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb172d1b640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb16c101d10 0x7fb16c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb172d1b640 1 -- 172.21.15.46:0/2217561355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c19fb70 con 0x7fb16c1026d0 2024-09-19T09:17:50.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb172d1b640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c19f500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb164005e30 tx=0x7fb164031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:50.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164003b70 con 0x7fb16c1026d0 2024-09-19T09:17:50.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb164003d10 con 0x7fb16c1026d0 2024-09-19T09:17:50.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c19fe00 con 0x7fb16c1026d0 2024-09-19T09:17:50.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16402fd30 con 0x7fb16c1026d0 2024-09-19T09:17:50.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.271+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a0380 con 0x7fb16c1026d0 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.272+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb16c1a05e0 con 0x7fb16c1026d0 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.273+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb164004050 con 0x7fb16c1026d0 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.274+0000 7fb1637fe640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1580a3380 0x7fb1580a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.274+0000 7fb17251a640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1580a3380 0x7fb1580a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.274+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb1640f0dd0 con 0x7fb16c1026d0 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.275+0000 7fb17251a640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1580a3380 0x7fb1580a5840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb168005fd0 tx=0x7fb168005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:50.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.278+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1640bda70 con 0x7fb16c1026d0 2024-09-19T09:17:50.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.462+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb16c1a07b0 con 0x7fb1580a3380 2024-09-19T09:17:50.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.468+0000 7fb1637fe640 1 -- 172.21.15.46:0/2217561355 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fb16c1a07b0 con 0x7fb1580a3380 2024-09-19T09:17:50.469 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:17:50.469 INFO:teuthology.orchestra.run.smithi046.stdout:mds.all 12/12 29s ago 2m smithi046=a;smithi046=d;smithi046=g;smithi046=j;smithi099=b;smithi099=e;smithi099=h;smithi099=k;smithi115=c;smithi115=f;smithi115=i;smithi115=l;count:12 2024-09-19T09:17:50.469 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 3/3 29s ago 7m smithi046=x;smithi099=y;smithi115=z;count:3 2024-09-19T09:17:50.469 INFO:teuthology.orchestra.run.smithi046.stdout:mon 3/3 29s ago 7m smithi046:172.21.15.46=a;smithi099:172.21.15.99=b;smithi115:172.21.15.115=c;count:3 2024-09-19T09:17:50.470 INFO:teuthology.orchestra.run.smithi046.stdout:osd 12 29s ago - 2024-09-19T09:17:50.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1580a3380 msgr2=0x7fb1580a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1580a3380 0x7fb1580a5840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb168005fd0 tx=0x7fb168005850 comp rx=0 tx=0).stop 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 msgr2=0x7fb16c19f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c19f500 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb164005e30 tx=0x7fb164031ee0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 shutdown_connections 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1580a3380 0x7fb1580a5840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb16c1026d0 0x7fb16c19f500 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb16c101d10 0x7fb16c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 --2- 172.21.15.46:0/2217561355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb16c100b10 0x7fb16c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 >> 172.21.15.46:0/2217561355 conn(0x7fb16c0fc2a0 msgr2=0x7fb16c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 shutdown_connections 2024-09-19T09:17:50.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:50.470+0000 7fb17477e640 1 -- 172.21.15.46:0/2217561355 wait complete. 2024-09-19T09:17:51.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:50 smithi099 ceph-mon[35256]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:51.092 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:50 smithi046 ceph-mon[31203]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:51.121 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:17:51.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:50 smithi115 ceph-mon[35055]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:17:51.377 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:51.796 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:51 smithi046 ceph-mon[31203]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:51.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/1385687084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 msgr2=0x7fc2c0107200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:51.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/1385687084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0107200 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009ca0 tx=0x7fc2b002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/1385687084 shutdown_connections 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/1385687084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0107200 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/1385687084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c0107740 0x7fc2c0109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/1385687084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c01024e0 0x7fc2c01048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/1385687084 >> 172.21.15.46:0/1385687084 conn(0x7fc2c00fc0e0 msgr2=0x7fc2c00fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/1385687084 shutdown_connections 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/1385687084 wait complete. 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 Processor -- start 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.879+0000 7fc2c5f9f640 1 -- start start 2024-09-19T09:17:51.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c5f9f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c01024e0 0x7fc2c0101e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c5f9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c5f9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c0107740 0x7fc2c01009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c5f9f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c010d6c0 con 0x7fc2c0104e10 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c5f9f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c010d540 con 0x7fc2c01024e0 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c5f9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c010d840 con 0x7fc2c0107740 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:51.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0100490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33966/0 (socket says 172.21.15.46:33966) 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 -- 172.21.15.46:0/72336151 learned_addr learned my addr 172.21.15.46:0/72336151 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c4f9d640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c01024e0 0x7fc2c0101e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2c579e640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c0107740 0x7fc2c01009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 -- 172.21.15.46:0/72336151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c0107740 msgr2=0x7fc2c01009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c0107740 0x7fc2c01009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 -- 172.21.15.46:0/72336151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c01024e0 msgr2=0x7fc2c0101e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c01024e0 0x7fc2c0101e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 -- 172.21.15.46:0/72336151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c0101290 con 0x7fc2c0104e10 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bffff640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0100490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0000f80 tx=0x7fc2b0031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.880+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b002fb60 con 0x7fc2c0104e10 2024-09-19T09:17:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.881+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b002fd00 con 0x7fc2c0104e10 2024-09-19T09:17:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.881+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c01a1ea0 con 0x7fc2c0104e10 2024-09-19T09:17:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.881+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00468a0 con 0x7fc2c0104e10 2024-09-19T09:17:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.881+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c01a2350 con 0x7fc2c0104e10 2024-09-19T09:17:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.882+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c00fdbd0 con 0x7fc2c0104e10 2024-09-19T09:17:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.883+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc2b0030ba0 con 0x7fc2c0104e10 2024-09-19T09:17:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.884+0000 7fc2bdffb640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2ac0a3350 0x7fc2ac0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.884+0000 7fc2c4f9d640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2ac0a3350 0x7fc2ac0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.884+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc2b00f0d60 con 0x7fc2c0104e10 2024-09-19T09:17:51.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.884+0000 7fc2c4f9d640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2ac0a3350 0x7fc2ac0a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800bbe0 tx=0x7fc2a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:51.888+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2b00bda60 con 0x7fc2c0104e10 2024-09-19T09:17:52.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:51 smithi099 ceph-mon[35256]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.073+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc2c0062630 con 0x7fc2ac0a3350 2024-09-19T09:17:52.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.075+0000 7fc2bdffb640 1 -- 172.21.15.46:0/72336151 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc2c0062630 con 0x7fc2ac0a3350 2024-09-19T09:17:52.076 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:17:52.076 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2024-09-19T09:17:52.077 INFO:teuthology.orchestra.run.smithi046.stdout:smithi099 172.21.15.99 2024-09-19T09:17:52.077 INFO:teuthology.orchestra.run.smithi046.stdout:smithi115 172.21.15.115 2024-09-19T09:17:52.077 INFO:teuthology.orchestra.run.smithi046.stdout:3 hosts in cluster 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2ac0a3350 msgr2=0x7fc2ac0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2ac0a3350 0x7fc2ac0a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800bbe0 tx=0x7fc2a800b390 comp rx=0 tx=0).stop 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 msgr2=0x7fc2c0100490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0100490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0000f80 tx=0x7fc2b0031ec0 comp rx=0 tx=0).stop 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 shutdown_connections 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2ac0a3350 0x7fc2ac0a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:52.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2c0104e10 0x7fc2c0100490 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc2c0107740 0x7fc2c01009d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 --2- 172.21.15.46:0/72336151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2c01024e0 0x7fc2c0101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.077+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 >> 172.21.15.46:0/72336151 conn(0x7fc2c00fc0e0 msgr2=0x7fc2c0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.078+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 shutdown_connections 2024-09-19T09:17:52.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:52.078+0000 7fc2c5f9f640 1 -- 172.21.15.46:0/72336151 wait complete. 2024-09-19T09:17:52.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:51 smithi115 ceph-mon[35055]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:52.748 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:17:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:52 smithi046 ceph-mon[31203]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:17:53.003 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:53.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:52 smithi099 ceph-mon[35256]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:17:53.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:52 smithi115 ceph-mon[35055]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 -- 172.21.15.46:0/584486813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8108102e00 msgr2=0x7f8108103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 --2- 172.21.15.46:0/584486813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8108102e00 0x7f8108103280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8104009900 tx=0x7f810402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 -- 172.21.15.46:0/584486813 shutdown_connections 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 --2- 172.21.15.46:0/584486813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8108102e00 0x7f8108103280 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 --2- 172.21.15.46:0/584486813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81081037c0 0x7f810810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 --2- 172.21.15.46:0/584486813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8108101c00 0x7f8108102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 -- 172.21.15.46:0/584486813 >> 172.21.15.46:0/584486813 conn(0x7f81080fd390 msgr2=0x7f81080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 -- 172.21.15.46:0/584486813 shutdown_connections 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 -- 172.21.15.46:0/584486813 wait complete. 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 Processor -- start 2024-09-19T09:17:53.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.455+0000 7f8110448640 1 -- start start 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8108101c00 0x7f8108197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8108102e00 0x7f8108198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 0x7f810819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f810810d8e0 con 0x7f81081037c0 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f810810d760 con 0x7f8108101c00 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f810810da60 con 0x7f8108102e00 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 0x7f810819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 0x7f810819f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33996/0 (socket says 172.21.15.46:33996) 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 -- 172.21.15.46:0/3436658206 learned_addr learned my addr 172.21.15.46:0/3436658206 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:53.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e1e4640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8108101c00 0x7f8108197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810d9e3640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8108102e00 0x7f8108198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 -- 172.21.15.46:0/3436658206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8108102e00 msgr2=0x7f8108198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8108102e00 0x7f8108198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 -- 172.21.15.46:0/3436658206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8108101c00 msgr2=0x7f8108197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8108101c00 0x7f8108197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 -- 172.21.15.46:0/3436658206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810819fb00 con 0x7f81081037c0 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e1e4640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8108101c00 0x7f8108197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f810e9e5640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 0x7f810819f490 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f810000b970 tx=0x7f810000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:53.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100019070 con 0x7f81081037c0 2024-09-19T09:17:53.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f810000cb40 con 0x7f81081037c0 2024-09-19T09:17:53.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.456+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810819fdf0 con 0x7f81081037c0 2024-09-19T09:17:53.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.457+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100007650 con 0x7f81081037c0 2024-09-19T09:17:53.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.457+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81081a02d0 con 0x7f81081037c0 2024-09-19T09:17:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.458+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8108108f30 con 0x7f81081037c0 2024-09-19T09:17:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.459+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f810001c070 con 0x7f81081037c0 2024-09-19T09:17:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.459+0000 7f80fb7fe640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80f40a3300 0x7f80f40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.460+0000 7f810e1e4640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80f40a3300 0x7f80f40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.460+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f81000cefa0 con 0x7f81081037c0 2024-09-19T09:17:53.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.460+0000 7f810e1e4640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80f40a3300 0x7f80f40a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8108102c60 tx=0x7f80fc00a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:53.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.464+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f810009bc40 con 0x7f81081037c0 2024-09-19T09:17:53.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.646+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8108062630 con 0x7f80f40a3300 2024-09-19T09:17:53.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.648+0000 7f80fb7fe640 1 -- 172.21.15.46:0/3436658206 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8108062630 con 0x7f80f40a3300 2024-09-19T09:17:53.649 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:17:53.649 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:17:53.649 INFO:teuthology.orchestra.run.smithi046.stdout:smithi099 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040101400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:17:53.650 INFO:teuthology.orchestra.run.smithi046.stdout:smithi115 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80f40a3300 msgr2=0x7f80f40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80f40a3300 0x7f80f40a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8108102c60 tx=0x7f80fc00a5e0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 msgr2=0x7f810819f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 0x7f810819f490 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f810000b970 tx=0x7f810000be30 comp rx=0 tx=0).stop 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 shutdown_connections 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f80f40a3300 0x7f80f40a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81081037c0 0x7f810819f490 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8108102e00 0x7f8108198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 --2- 172.21.15.46:0/3436658206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8108101c00 0x7f8108197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.650+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 >> 172.21.15.46:0/3436658206 conn(0x7f81080fd390 msgr2=0x7f8108106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:53.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.651+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 shutdown_connections 2024-09-19T09:17:53.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:53.651+0000 7f8110448640 1 -- 172.21.15.46:0/3436658206 wait complete. 2024-09-19T09:17:53.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:53 smithi046 ceph-mon[31203]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:54.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:53 smithi099 ceph-mon[35256]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:54.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:53 smithi115 ceph-mon[35055]: from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:54.280 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:17:54.290 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:17:54.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:17:54.546 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:54.931 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:54 smithi046 ceph-mon[31203]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:17:54.931 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:54 smithi046 ceph-mon[31203]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:55.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:54 smithi099 ceph-mon[35256]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:17:55.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:54 smithi099 ceph-mon[35256]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.011+0000 7f735ff1f640 1 -- 172.21.15.46:0/713255195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7358107940 msgr2=0x7f7358109d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.011+0000 7f735ff1f640 1 --2- 172.21.15.46:0/713255195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7358107940 0x7f7358109d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7350009900 tx=0x7f735002a410 comp rx=0 tx=0).stop 2024-09-19T09:17:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.011+0000 7f735ff1f640 1 -- 172.21.15.46:0/713255195 shutdown_connections 2024-09-19T09:17:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 --2- 172.21.15.46:0/713255195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7358107940 0x7f7358109d30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 --2- 172.21.15.46:0/713255195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7358105010 0x7f7358107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 --2- 172.21.15.46:0/713255195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73581026e0 0x7f7358104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- 172.21.15.46:0/713255195 >> 172.21.15.46:0/713255195 conn(0x7f73580fc280 msgr2=0x7f73580fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- 172.21.15.46:0/713255195 shutdown_connections 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- 172.21.15.46:0/713255195 wait complete. 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 Processor -- start 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- start start 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 0x7f7358102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7358105010 0x7f7358100690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7358107940 0x7f7358100bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f735810d8e0 con 0x7f73581026e0 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f735810d760 con 0x7f7358107940 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735ff1f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f735810da60 con 0x7f7358105010 2024-09-19T09:17:55.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.012+0000 7f735dcbb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 0x7f7358102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 0x7f7358102040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34016/0 (socket says 172.21.15.46:34016) 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 -- 172.21.15.46:0/3441100019 learned_addr learned my addr 172.21.15.46:0/3441100019 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735e4bc640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7358107940 0x7f7358100bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735d4ba640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7358105010 0x7f7358100690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 -- 172.21.15.46:0/3441100019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7358105010 msgr2=0x7f7358100690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7358105010 0x7f7358100690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 -- 172.21.15.46:0/3441100019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7358107940 msgr2=0x7f7358100bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7358107940 0x7f7358100bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 -- 172.21.15.46:0/3441100019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7358101490 con 0x7f73581026e0 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735dcbb640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 0x7f7358102040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f734800ba50 tx=0x7f734800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348019070 con 0x7f73581026e0 2024-09-19T09:17:55.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73581a20c0 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f734800cbe0 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480076e0 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.013+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73581a2650 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.014+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73580fdd70 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.015+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f734801c070 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.016+0000 7f7356ffd640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f73400a32d0 0x7f73400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.016+0000 7f735d4ba640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f73400a32d0 0x7f73400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.016+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f73480cf4a0 con 0x7f73581026e0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.017+0000 7f735d4ba640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f73400a32d0 0x7f73400a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7358101dc0 tx=0x7f734c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:55.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.019+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f734809c1a0 con 0x7f73581026e0 2024-09-19T09:17:55.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:54 smithi115 ceph-mon[35055]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:17:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:54 smithi115 ceph-mon[35055]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:17:55.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.230+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f735802d7c0 con 0x7f73581026e0 2024-09-19T09:17:55.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.231+0000 7f7356ffd640 1 -- 172.21.15.46:0/3441100019 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3119 (secure 0 0 0) 0x7f734809baa0 con 0x7f73581026e0 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:e27 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-19T09:16:36:049593+0000 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 27 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:17:55.233 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-19T09:16:24.646046+0000 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-19T09:16:36.049570+0000 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 300 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:17:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 5 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1,2,3,4 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=24476,1=24472,2=24463,3=24451,4=24446} 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 0 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 24476 members: 24476,24463,24451,24472,24446 2024-09-19T09:17:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.b{0:24476} state up:active seq 4 addr [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.e{0:24428} state up:standby-replay seq 1 addr [v2:172.21.15.99:6834/1791811881,v1:172.21.15.99:6835/1791811881] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.i{1:24472} state up:active seq 8 addr [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.l{1:24421} state up:standby-replay seq 1 addr [v2:172.21.15.115:6832/2187922257,v1:172.21.15.115:6833/2187922257] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.c{2:24463} state up:active seq 10 addr [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.k{2:24398} state up:standby-replay seq 1 addr [v2:172.21.15.99:6832/51140188,v1:172.21.15.99:6833/51140188] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.f{3:24451} state up:active seq 11 addr [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.a{3:14601} state up:standby-replay seq 1 addr [v2:172.21.15.46:6840/321773391,v1:172.21.15.46:6841/321773391] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.236 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.h{4:24446} state up:active seq 10 addr [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.237 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.g{4:14589} state up:standby-replay seq 1 addr [v2:172.21.15.46:6838/1918563776,v1:172.21.15.46:6839/1918563776] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:55.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:55.237 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-19T09:17:55.237 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:55.238 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.j{-1:14526} state up:standby seq 1 addr [v2:172.21.15.46:6834/1645318124,v1:172.21.15.46:6835/1645318124] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.238 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.d{-1:14538} state up:standby seq 1 addr [v2:172.21.15.46:6836/4123039561,v1:172.21.15.46:6837/4123039561] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:17:55.240 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:17:55.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f73400a32d0 msgr2=0x7f73400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:55.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f73400a32d0 0x7f73400a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7358101dc0 tx=0x7f734c00a4c0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 msgr2=0x7f7358102040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:55.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 0x7f7358102040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f734800ba50 tx=0x7f734800bf10 comp rx=0 tx=0).stop 2024-09-19T09:17:55.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 shutdown_connections 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f73400a32d0 0x7f73400a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7358107940 0x7f7358100bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7358105010 0x7f7358100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 --2- 172.21.15.46:0/3441100019 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f73581026e0 0x7f7358102040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 >> 172.21.15.46:0/3441100019 conn(0x7f73580fc280 msgr2=0x7f73581030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 shutdown_connections 2024-09-19T09:17:55.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:55.233+0000 7f735ff1f640 1 -- 172.21.15.46:0/3441100019 wait complete. 2024-09-19T09:17:55.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:55 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3441100019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:17:55.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a514acda-7666-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:17:56.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:55 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3441100019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:17:56.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:55 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3441100019' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:17:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:56.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 -- 172.21.15.46:0/708986122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 msgr2=0x7f1d84109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:56.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 --2- 172.21.15.46:0/708986122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84109d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009ca0 tx=0x7f1d7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 -- 172.21.15.46:0/708986122 shutdown_connections 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 --2- 172.21.15.46:0/708986122 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84109d50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 --2- 172.21.15.46:0/708986122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d84105030 0x7f1d84107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 --2- 172.21.15.46:0/708986122 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d84102700 0x7f1d84104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 -- 172.21.15.46:0/708986122 >> 172.21.15.46:0/708986122 conn(0x7f1d840fc2a0 msgr2=0x7f1d840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 -- 172.21.15.46:0/708986122 shutdown_connections 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.713+0000 7f1d88afb640 1 -- 172.21.15.46:0/708986122 wait complete. 2024-09-19T09:17:56.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 Processor -- start 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 -- start start 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d84102700 0x7f1d84102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d84105030 0x7f1d841006b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84100bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8410d8a0 con 0x7f1d84107960 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8410d720 con 0x7f1d84105030 2024-09-19T09:17:56.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d88afb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8410da20 con 0x7f1d84102700 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84100bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84100bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34032/0 (socket says 172.21.15.46:34032) 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 -- 172.21.15.46:0/2888728951 learned_addr learned my addr 172.21.15.46:0/2888728951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d81d9b640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d84105030 0x7f1d841006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d8259c640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d84102700 0x7f1d84102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 -- 172.21.15.46:0/2888728951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d84102700 msgr2=0x7f1d84102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d84102700 0x7f1d84102060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 -- 172.21.15.46:0/2888728951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d84105030 msgr2=0x7f1d841006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d84105030 0x7f1d841006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.714+0000 7f1d82d9d640 1 -- 172.21.15.46:0/2888728951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d841014b0 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.715+0000 7f1d82d9d640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84100bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c005e30 tx=0x7f1d7c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.715+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c003c30 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.715+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d841a2030 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.715+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d7c003dd0 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.715+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c02fde0 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.715+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d841a2590 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.716+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d840fdd90 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.717+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1d7c004050 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.718+0000 7f1d737fe640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d6c0a32d0 0x7f1d6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.718+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1d7c0f0ec0 con 0x7f1d84107960 2024-09-19T09:17:56.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.718+0000 7f1d8259c640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d6c0a32d0 0x7f1d6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:56.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.719+0000 7f1d8259c640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d6c0a32d0 0x7f1d6c0a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d740058c0 tx=0x7f1d7400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:56.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.721+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d7c0bdbc0 con 0x7f1d84107960 2024-09-19T09:17:56.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.899+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1d84062df0 con 0x7f1d84107960 2024-09-19T09:17:56.901 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:56 smithi046 ceph-mon[31203]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.900+0000 7f1d737fe640 1 -- 172.21.15.46:0/2888728951 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5243 (secure 0 0 0) 0x7f1d7c0bd4c0 con 0x7f1d84107960 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 84 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:fsid a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-19T09:08:41.072871+0000 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-19T09:17:30.696589+0000 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:crush_version 26 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:full_ratio 0.95 2024-09-19T09:17:56.902 INFO:teuthology.orchestra.run.smithi046.stdout:backfillfull_ratio 0.9 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:nearfull_ratio 0.85 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:require_min_compat_client luminous 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:min_compat_client luminous 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:require_osd_release squid 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:stretch_mode_enabled false 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:max_osd 12 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6802/1945664236,v1:172.21.15.46:6803/1945664236] [v2:172.21.15.46:6804/1945664236,v1:172.21.15.46:6805/1945664236] exists,up 84984725-789b-44a1-be8f-fef0fb7b9f20 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/469175428,v1:172.21.15.99:6801/469175428] [v2:172.21.15.99:6802/469175428,v1:172.21.15.99:6803/469175428] exists,up c1fce610-b700-449a-8d05-4f83c4db271b 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/888012303,v1:172.21.15.115:6801/888012303] [v2:172.21.15.115:6802/888012303,v1:172.21.15.115:6803/888012303] exists,up 61ebc0bf-183f-43b4-85c4-c891cda4dc2e 2024-09-19T09:17:56.903 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 up in weight 1 up_from 24 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6810/3435329392,v1:172.21.15.46:6811/3435329392] [v2:172.21.15.46:6812/3435329392,v1:172.21.15.46:6813/3435329392] exists,up 908f304e-8b1b-4ca4-9eea-b0948e997f0e 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 up in weight 1 up_from 31 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6808/3922710855,v1:172.21.15.99:6809/3922710855] [v2:172.21.15.99:6810/3922710855,v1:172.21.15.99:6811/3922710855] exists,up 20a50b73-a051-4d3d-927d-1a9ea780e1c2 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 up in weight 1 up_from 36 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6808/1551008641,v1:172.21.15.115:6809/1551008641] [v2:172.21.15.115:6810/1551008641,v1:172.21.15.115:6811/1551008641] exists,up 384f0d2b-a76a-423c-8e2e-f53d330e1a6a 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.6 up in weight 1 up_from 43 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6818/2376082017,v1:172.21.15.46:6819/2376082017] [v2:172.21.15.46:6820/2376082017,v1:172.21.15.46:6821/2376082017] exists,up c8122b9b-6ca9-4d55-aa49-303e5b409314 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.7 up in weight 1 up_from 48 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6816/1504821892,v1:172.21.15.99:6817/1504821892] [v2:172.21.15.99:6818/1504821892,v1:172.21.15.99:6819/1504821892] exists,up 37c74014-9375-4c7f-acff-71d0156c2d27 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.8 up in weight 1 up_from 55 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6816/849207919,v1:172.21.15.115:6817/849207919] [v2:172.21.15.115:6818/849207919,v1:172.21.15.115:6819/849207919] exists,up 6e366800-9368-47ba-be88-2eb812acc566 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.9 up in weight 1 up_from 63 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.46:6826/4010805716,v1:172.21.15.46:6827/4010805716] [v2:172.21.15.46:6828/4010805716,v1:172.21.15.46:6829/4010805716] exists,up e6698a57-d371-439e-9f43-56e1bce6d146 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.10 up in weight 1 up_from 68 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6824/3505432402,v1:172.21.15.99:6825/3505432402] [v2:172.21.15.99:6826/3505432402,v1:172.21.15.99:6827/3505432402] exists,up b1b83e9f-8b11-4023-a6e3-476b8c9a2651 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:osd.11 up in weight 1 up_from 76 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6824/2141739994,v1:172.21.15.115:6825/2141739994] [v2:172.21.15.115:6826/2141739994,v1:172.21.15.115:6827/2141739994] exists,up a61643cd-2ec2-494a-8e81-68fd46d421e9 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.e [2,4] 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 2.f [8,11] 2024-09-19T09:17:56.904 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.10 [5,9] 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.13 [4,9] 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.17 [4,8] 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:pg_upmap_items 3.38 [3,9] 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3574702566 expires 2024-09-20T09:09:28.870189+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/4173084876 expires 2024-09-20T09:09:28.870189+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/2790675564 expires 2024-09-20T09:09:28.870189+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/2471470384 expires 2024-09-20T09:09:28.870189+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/4173084876 expires 2024-09-20T09:09:28.870189+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/1027758264 expires 2024-09-20T09:09:05.243596+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/3215761570 expires 2024-09-20T09:09:05.243596+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6801/2938067554 expires 2024-09-20T09:09:05.243596+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:6800/2938067554 expires 2024-09-20T09:09:05.243596+0000 2024-09-19T09:17:56.905 INFO:teuthology.orchestra.run.smithi046.stdout:blocklist 172.21.15.46:0/2165633086 expires 2024-09-20T09:09:05.243596+0000 2024-09-19T09:17:56.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d6c0a32d0 msgr2=0x7f1d6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:56.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d6c0a32d0 0x7f1d6c0a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1d740058c0 tx=0x7f1d7400a4c0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 msgr2=0x7f1d84100bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:56.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84100bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c005e30 tx=0x7f1d7c031ee0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 shutdown_connections 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1d6c0a32d0 0x7f1d6c0a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d84107960 0x7f1d84100bf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d84105030 0x7f1d841006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 --2- 172.21.15.46:0/2888728951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d84102700 0x7f1d84102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 >> 172.21.15.46:0/2888728951 conn(0x7f1d840fc2a0 msgr2=0x7f1d84102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.902+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 shutdown_connections 2024-09-19T09:17:56.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:56.903+0000 7f1d88afb640 1 -- 172.21.15.46:0/2888728951 wait complete. 2024-09-19T09:17:57.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:56 smithi099 ceph-mon[35256]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:17:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:56 smithi115 ceph-mon[35055]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:17:57.718 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:17:57.729 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:57.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:57 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2888728951' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:17:57.988 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:17:58.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:57 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2888728951' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:17:58.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:57 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2888728951' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:17:58.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 -- 172.21.15.46:0/4179361485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4930102d30 msgr2=0x7f4930103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 --2- 172.21.15.46:0/4179361485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4930102d30 0x7f4930103110 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4920009930 tx=0x7f492002a420 comp rx=0 tx=0).stop 2024-09-19T09:17:58.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 -- 172.21.15.46:0/4179361485 shutdown_connections 2024-09-19T09:17:58.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 --2- 172.21.15.46:0/4179361485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49301082a0 0x7f493010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 --2- 172.21.15.46:0/4179361485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49301036e0 0x7f4930107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 --2- 172.21.15.46:0/4179361485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4930102d30 0x7f4930103110 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 -- 172.21.15.46:0/4179361485 >> 172.21.15.46:0/4179361485 conn(0x7f49300fc7d0 msgr2=0x7f49300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 -- 172.21.15.46:0/4179361485 shutdown_connections 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.421+0000 7f4936446640 1 -- 172.21.15.46:0/4179361485 wait complete. 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 Processor -- start 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 -- start start 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4930102d30 0x7f4930100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49301036e0 0x7f4930100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 0x7f4930101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f49301120a0 con 0x7f49301082a0 2024-09-19T09:17:58.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4930111f20 con 0x7f4930102d30 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f4936446640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112220 con 0x7f49301036e0 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.422+0000 7f49349e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 0x7f4930101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 0x7f4930101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51742/0 (socket says 172.21.15.46:51742) 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 -- 172.21.15.46:0/378218187 learned_addr learned my addr 172.21.15.46:0/378218187 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f492ffff640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4930102d30 0x7f4930100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f492f7fe640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49301036e0 0x7f4930100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 -- 172.21.15.46:0/378218187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49301036e0 msgr2=0x7f4930100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49301036e0 0x7f4930100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 -- 172.21.15.46:0/378218187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4930102d30 msgr2=0x7f4930100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4930102d30 0x7f4930100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 -- 172.21.15.46:0/378218187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49301a6a80 con 0x7f49301082a0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f49349e3640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 0x7f4930101410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f492800cad0 tx=0x7f492800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800ae20 con 0x7f49301082a0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4928005020 con 0x7f49301082a0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49301a6d70 con 0x7f49301082a0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800f6f0 con 0x7f49301082a0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.423+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49301a72b0 con 0x7f49301082a0 2024-09-19T09:17:58.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.425+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493006a850 con 0x7f49301082a0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.425+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f49280051d0 con 0x7f49301082a0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.426+0000 7f492d7fa640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f49180a32d0 0x7f49180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.426+0000 7f492ffff640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f49180a32d0 0x7f49180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.426+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f49280cfd00 con 0x7f49301082a0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.427+0000 7f492ffff640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f49180a32d0 0x7f49180a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4920009900 tx=0x7f49200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:58.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.431+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4928014030 con 0x7f49301082a0 2024-09-19T09:17:58.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.641+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f493010a2b0 con 0x7f49301082a0 2024-09-19T09:17:58.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.642+0000 7f492d7fa640 1 -- 172.21.15.46:0/378218187 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f492809c240 con 0x7f49301082a0 2024-09-19T09:17:58.643 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:17:58.644 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-19T09:16:36:049593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:16:36.049570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:17:58.644 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:17:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f49180a32d0 msgr2=0x7f49180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f49180a32d0 0x7f49180a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4920009900 tx=0x7f49200058d0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 msgr2=0x7f4930101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:58.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 0x7f4930101410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f492800cad0 tx=0x7f492800cf90 comp rx=0 tx=0).stop 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 shutdown_connections 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f49180a32d0 0x7f49180a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f49301082a0 0x7f4930101410 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f49301036e0 0x7f4930100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 --2- 172.21.15.46:0/378218187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4930102d30 0x7f4930100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 >> 172.21.15.46:0/378218187 conn(0x7f49300fc7d0 msgr2=0x7f4930105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 shutdown_connections 2024-09-19T09:17:58.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:17:58.644+0000 7f4936446640 1 -- 172.21.15.46:0/378218187 wait complete. 2024-09-19T09:17:58.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:58 smithi046 ceph-mon[31203]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:58.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:17:58 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/378218187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:59.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:58 smithi115 ceph-mon[35055]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:59.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:17:58 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/378218187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:59.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:58 smithi099 ceph-mon[35256]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T09:17:59.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:17:58 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/378218187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:17:59.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:17:59.705 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 -- 172.21.15.46:0/3309887635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124103740 msgr2=0x7f3124107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 --2- 172.21.15.46:0/3309887635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124103740 0x7f3124107b80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3118009930 tx=0x7f311802a420 comp rx=0 tx=0).stop 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 -- 172.21.15.46:0/3309887635 shutdown_connections 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 --2- 172.21.15.46:0/3309887635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124103740 0x7f3124107b80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 --2- 172.21.15.46:0/3309887635 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124108290 0x7f312410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 --2- 172.21.15.46:0/3309887635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124102d90 0x7f3124103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 -- 172.21.15.46:0/3309887635 >> 172.21.15.46:0/3309887635 conn(0x7f31240fc7d0 msgr2=0x7f31240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 -- 172.21.15.46:0/3309887635 shutdown_connections 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 -- 172.21.15.46:0/3309887635 wait complete. 2024-09-19T09:18:00.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.184+0000 7f3129993640 1 Processor -- start 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 -- start start 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124102d90 0x7f3124198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124103740 0x7f3124198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 0x7f312419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f31241120b0 con 0x7f3124108290 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3124111f30 con 0x7f3124103740 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3129993640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3124112230 con 0x7f3124102d90 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 0x7f312419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 0x7f312419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51748/0 (socket says 172.21.15.46:51748) 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 -- 172.21.15.46:0/2537274275 learned_addr learned my addr 172.21.15.46:0/2537274275 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:00.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f3122ffd640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124102d90 0x7f3124198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31227fc640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124103740 0x7f3124198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 -- 172.21.15.46:0/2537274275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124102d90 msgr2=0x7f3124198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124102d90 0x7f3124198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 -- 172.21.15.46:0/2537274275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124103740 msgr2=0x7f3124198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124103740 0x7f3124198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31237fe640 1 -- 172.21.15.46:0/2537274275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312419d530 con 0x7f3124108290 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.185+0000 7f31227fc640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124103740 0x7f3124198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.186+0000 7f31237fe640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 0x7f312419ce50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f311c00b970 tx=0x7f311c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.186+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c019070 con 0x7f3124108290 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.186+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f311c014440 con 0x7f3124108290 2024-09-19T09:18:00.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.186+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312419d820 con 0x7f3124108290 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.186+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c0075d0 con 0x7f3124108290 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.186+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31241a5100 con 0x7f3124108290 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.187+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3124103170 con 0x7f3124108290 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.188+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f311c01c070 con 0x7f3124108290 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.189+0000 7f3128991640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f310c0a3240 0x7f310c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.189+0000 7f3122ffd640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f310c0a3240 0x7f310c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.189+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f311c0cef90 con 0x7f3124108290 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.189+0000 7f3122ffd640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f310c0a3240 0x7f310c0a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f311400abe0 tx=0x7f311400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:00.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.193+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f311c09bc80 con 0x7f3124108290 2024-09-19T09:18:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.405+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f312410a2a0 con 0x7f3124108290 2024-09-19T09:18:00.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.406+0000 7f3128991640 1 -- 172.21.15.46:0/2537274275 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11959 (secure 0 0 0) 0x7f311c09b580 con 0x7f3124108290 2024-09-19T09:18:00.409 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:00.409 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-19T09:16:36:049593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:16:36.049570+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:18:00.410 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f310c0a3240 msgr2=0x7f310c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f310c0a3240 0x7f310c0a5700 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f311400abe0 tx=0x7f311400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 msgr2=0x7f312419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 0x7f312419ce50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f311c00b970 tx=0x7f311c00bd70 comp rx=0 tx=0).stop 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 shutdown_connections 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f310c0a3240 0x7f310c0a5700 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3124108290 0x7f312419ce50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3124103740 0x7f3124198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 --2- 172.21.15.46:0/2537274275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3124102d90 0x7f3124198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 >> 172.21.15.46:0/2537274275 conn(0x7f31240fc7d0 msgr2=0x7f3124106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 shutdown_connections 2024-09-19T09:18:00.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:00.409+0000 7f3129993640 1 -- 172.21.15.46:0/2537274275 wait complete. 2024-09-19T09:18:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:00 smithi046 ceph-mon[31203]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:18:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:00 smithi046 ceph-mon[31203]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:18:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:00 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2537274275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:01.044 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:18:01.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:00 smithi115 ceph-mon[35055]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:18:01.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:00 smithi115 ceph-mon[35055]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:18:01.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:00 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2537274275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:01.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:00 smithi099 ceph-mon[35256]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T09:18:01.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:00 smithi099 ceph-mon[35256]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:18:01.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:00 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2537274275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:01.306 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:01.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 -- 172.21.15.46:0/4056440147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 msgr2=0x7fc0341031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 --2- 172.21.15.46:0/4056440147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc0341031d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc030009900 tx=0x7fc03002a410 comp rx=0 tx=0).stop 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 -- 172.21.15.46:0/4056440147 shutdown_connections 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 --2- 172.21.15.46:0/4056440147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc03410c2f0 0x7fc03410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 --2- 172.21.15.46:0/4056440147 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0341037a0 0x7fc03410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 --2- 172.21.15.46:0/4056440147 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc0341031d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.841+0000 7fc03b766640 1 -- 172.21.15.46:0/4056440147 >> 172.21.15.46:0/4056440147 conn(0x7fc0340fc7d0 msgr2=0x7fc0340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.842+0000 7fc03b766640 1 -- 172.21.15.46:0/4056440147 shutdown_connections 2024-09-19T09:18:01.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.842+0000 7fc03b766640 1 -- 172.21.15.46:0/4056440147 wait complete. 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.842+0000 7fc03b766640 1 Processor -- start 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.842+0000 7fc03b766640 1 -- start start 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc03b766640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc03419f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc03b766640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0341037a0 0x7fc03419f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc03b766640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc03410c2f0 0x7fc03410adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc03b766640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc0341121d0 con 0x7fc034102df0 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc03b766640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc034112050 con 0x7fc03410c2f0 2024-09-19T09:18:01.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc03b766640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc034112350 con 0x7fc0341037a0 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc03419f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc03419f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51766/0 (socket says 172.21.15.46:51766) 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 -- 172.21.15.46:0/2467711672 learned_addr learned my addr 172.21.15.46:0/2467711672 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc038d01640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0341037a0 0x7fc03419f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039d03640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc03410c2f0 0x7fc03410adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 -- 172.21.15.46:0/2467711672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0341037a0 msgr2=0x7fc03419f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0341037a0 0x7fc03419f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 -- 172.21.15.46:0/2467711672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc03410c2f0 msgr2=0x7fc03410adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc03410c2f0 0x7fc03410adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 -- 172.21.15.46:0/2467711672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03410b650 con 0x7fc034102df0 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.843+0000 7fc039502640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc03419f270 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc030005940 tx=0x7fc0300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:01.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.844+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03003f030 con 0x7fc034102df0 2024-09-19T09:18:01.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.844+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03410b8e0 con 0x7fc034102df0 2024-09-19T09:18:01.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.844+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc030003ce0 con 0x7fc034102df0 2024-09-19T09:18:01.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.844+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030035070 con 0x7fc034102df0 2024-09-19T09:18:01.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.844+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03419adb0 con 0x7fc034102df0 2024-09-19T09:18:01.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.845+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0341031d0 con 0x7fc034102df0 2024-09-19T09:18:01.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.847+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc030042030 con 0x7fc034102df0 2024-09-19T09:18:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.847+0000 7fc02a7fc640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc0200a3240 0x7fc0200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.847+0000 7fc038d01640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc0200a3240 0x7fc0200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.847+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc0300effc0 con 0x7fc034102df0 2024-09-19T09:18:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.848+0000 7fc038d01640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc0200a3240 0x7fc0200a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc03410c000 tx=0x7fc024009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:01.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:01.851+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc030049030 con 0x7fc034102df0 2024-09-19T09:18:02.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.027+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc03419af80 con 0x7fc034102df0 2024-09-19T09:18:02.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.029+0000 7fc02a7fc640 1 -- 172.21.15.46:0/2467711672 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22631 (secure 0 0 0) 0x7fc0300bcdb0 con 0x7fc034102df0 2024-09-19T09:18:02.030 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:02.031 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:17:30.696589+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc0200a3240 msgr2=0x7fc0200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:02.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc0200a3240 0x7fc0200a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc03410c000 tx=0x7fc024009110 comp rx=0 tx=0).stop 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 msgr2=0x7fc03419f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc03419f270 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc030005940 tx=0x7fc0300042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 shutdown_connections 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc0200a3240 0x7fc0200a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc03410c2f0 0x7fc03410adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc0341037a0 0x7fc03419f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 --2- 172.21.15.46:0/2467711672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc034102df0 0x7fc03419f270 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 >> 172.21.15.46:0/2467711672 conn(0x7fc0340fc7d0 msgr2=0x7fc03410d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 shutdown_connections 2024-09-19T09:18:02.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:02.031+0000 7fc03b766640 1 -- 172.21.15.46:0/2467711672 wait complete. 2024-09-19T09:18:02.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:16:24.646046+0000', 'modified': '2024-09-19T09:16:36.049570+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24472, 'mds_2': 24463, 'mds_3': 24451, 'mds_4': 24446}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14589': {'gid': 14589, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/1918563776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1918563776}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1918563776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6841/321773391', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6840', 'nonce': 321773391}, {'type': 'v1', 'addr': '172.21.15.46:6841', 'nonce': 321773391}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6833/51140188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 51140188}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 51140188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6833/2187922257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6832', 'nonce': 2187922257}, {'type': 'v1', 'addr': '172.21.15.115:6833', 'nonce': 2187922257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6835/1791811881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 1791811881}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 1791811881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.99:6837/58768930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 58768930}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 58768930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.115:6835/3610194671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3610194671}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3610194671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6837/1753777056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 1753777056}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1753777056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.115:6839/1737720182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1737720182}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1737720182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/718433968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 718433968}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 718433968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24476, 24463, 24451, 24472, 24446]} 2024-09-19T09:18:02.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:18:02.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:18:02.944 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:02 smithi046 ceph-mon[31203]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:18:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:02 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2467711672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:03.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:02 smithi115 ceph-mon[35055]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:18:03.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2467711672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:03.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:02 smithi099 ceph-mon[35256]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:18:03.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:02 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2467711672' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 -- 172.21.15.46:0/299034135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8106a80 msgr2=0x7f98a8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 --2- 172.21.15.46:0/299034135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8106a80 0x7f98a8106e60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9898009930 tx=0x7f989802a420 comp rx=0 tx=0).stop 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 -- 172.21.15.46:0/299034135 shutdown_connections 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 --2- 172.21.15.46:0/299034135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a8101420 0x7f98a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 --2- 172.21.15.46:0/299034135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a8100a80 0x7f98a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 --2- 172.21.15.46:0/299034135 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8106a80 0x7f98a8106e60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 -- 172.21.15.46:0/299034135 >> 172.21.15.46:0/299034135 conn(0x7f98a80fc7a0 msgr2=0x7f98a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 -- 172.21.15.46:0/299034135 shutdown_connections 2024-09-19T09:18:03.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.400+0000 7f98acc2b640 1 -- 172.21.15.46:0/299034135 wait complete. 2024-09-19T09:18:03.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 Processor -- start 2024-09-19T09:18:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 -- start start 2024-09-19T09:18:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a8100a80 0x7f98a810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 0x7f98a810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a8106a80 0x7f98a810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f98a8111fa0 con 0x7f98a8101420 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f98a8111e20 con 0x7f98a8100a80 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98acc2b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f98a8112120 con 0x7f98a8106a80 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f989dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 0x7f98a810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f989dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 0x7f98a810e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51784/0 (socket says 172.21.15.46:51784) 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f989dd9b640 1 -- 172.21.15.46:0/2412784129 learned_addr learned my addr 172.21.15.46:0/2412784129 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98a659c640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a8100a80 0x7f98a810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a8106a80 0x7f98a810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.401+0000 7f989dd9b640 1 -- 172.21.15.46:0/2412784129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a8106a80 msgr2=0x7f98a810ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989dd9b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a8106a80 0x7f98a810ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989dd9b640 1 -- 172.21.15.46:0/2412784129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a8100a80 msgr2=0x7f98a810e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989dd9b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a8100a80 0x7f98a810e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989dd9b640 1 -- 172.21.15.46:0/2412784129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a81a69e0 con 0x7f98a8101420 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989dd9b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 0x7f98a810e920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f989000b4a0 tx=0x7f989000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989ffff640 1 -- 172.21.15.46:0/2412784129 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890014070 con 0x7f98a8101420 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989ffff640 1 -- 172.21.15.46:0/2412784129 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9890010af0 con 0x7f98a8101420 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a81a6cd0 con 0x7f98a8101420 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f989ffff640 1 -- 172.21.15.46:0/2412784129 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890017d10 con 0x7f98a8101420 2024-09-19T09:18:03.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.402+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a81a71c0 con 0x7f98a8101420 2024-09-19T09:18:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.404+0000 7f989ffff640 1 -- 172.21.15.46:0/2412784129 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9890017070 con 0x7f98a8101420 2024-09-19T09:18:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 Processor -- start 2024-09-19T09:18:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 -- start start 2024-09-19T09:18:03.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a039d0 0x563fa8a03db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a0ebb0 0x563fa8a10fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563fa896a090 con 0x563fa8a0ebb0 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563fa8911a70 con 0x563fa8a042f0 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98af004740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563fa8966050 con 0x563fa8a039d0 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f989dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a0ebb0 0x563fa8a10fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f989ffff640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98940a3240 0x7f98940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f989dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a0ebb0 0x563fa8a10fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51786/0 (socket says 172.21.15.46:51786) 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f989dd9b640 1 -- 172.21.15.46:0/3263822341 learned_addr learned my addr 172.21.15.46:0/3263822341 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98a659c640 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.405+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a039d0 0x563fa8a03db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98940a3240 0x7f98940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f989ffff640 1 -- 172.21.15.46:0/2412784129 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98900cec00 con 0x7f98a8101420 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a659c640 1 -- 172.21.15.46:0/3263822341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a039d0 msgr2=0x563fa8a03db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a659c640 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a039d0 0x563fa8a03db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a659c640 1 -- 172.21.15.46:0/3263822341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a0ebb0 msgr2=0x563fa8a10fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a659c640 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a0ebb0 0x563fa8a10fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a659c640 1 -- 172.21.15.46:0/3263822341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa891e130 con 0x563fa8a042f0 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a659c640 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0e670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9898005940 tx=0x7f9898031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9151bfbed95e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98940a3240 0x7f98940a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009fd0 tx=0x7f98a0009b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f989cd99640 1 -- 172.21.15.46:0/3263822341 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898040070 con 0x563fa8a042f0 2024-09-19T09:18:03.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f989cd99640 1 -- 172.21.15.46:0/3263822341 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9898031a20 con 0x563fa8a042f0 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.406+0000 7f989cd99640 1 -- 172.21.15.46:0/3263822341 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898035040 con 0x563fa8a042f0 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 -- 172.21.15.46:0/3263822341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 msgr2=0x563fa8a0e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0e670 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9898005940 tx=0x7f9898031630 comp rx=0 tx=0).stop 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 -- 172.21.15.46:0/3263822341 shutdown_connections 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a0ebb0 0x563fa8a10fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0e670 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 --2- 172.21.15.46:0/3263822341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a039d0 0x563fa8a03db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 -- 172.21.15.46:0/3263822341 >> 172.21.15.46:0/3263822341 conn(0x563fa89fff60 msgr2=0x563fa8a00340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 -- 172.21.15.46:0/3263822341 shutdown_connections 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.407+0000 7f98af004740 1 -- 172.21.15.46:0/3263822341 wait complete. 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 -- start start 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 Processor -- start 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a0e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a11780 con 0x563fa8a039d0 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563fa8924f20 con 0x563fa8a042f0 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a11900 con 0x563fa8a0ebb0 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98af004740 10 client.0 _ll_register_callbacks cb 0x563fa88ee030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a0e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a0e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51794/0 (socket says 172.21.15.46:51794) 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 -- 172.21.15.46:0/5582149 learned_addr learned my addr 172.21.15.46:0/5582149 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f989dd9b640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 -- 172.21.15.46:0/5582149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 msgr2=0x563fa8a0bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 -- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 msgr2=0x563fa8a0b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.408+0000 7f98a659c640 1 -- 172.21.15.46:0/5582149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa86db2b0 con 0x563fa8a039d0 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98a659c640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a0e2a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9898009900 tx=0x7f989802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da16ebd74552e2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f988dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f988dffb640 1 -- 172.21.15.46:0/5582149 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898040030 con 0x563fa8a039d0 2024-09-19T09:18:03.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f988dffb640 1 -- 172.21.15.46:0/5582149 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9898004250 con 0x563fa8a039d0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9898031a20 con 0x563fa8a039d0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f988dffb640 1 -- 172.21.15.46:0/5582149 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9898035040 con 0x563fa8a039d0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 10 client.15108 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563fa8a1cee0 con 0x563fa8a039d0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f988dffb640 1 -- 172.21.15.46:0/5582149 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9898031a20 con 0x563fa8a039d0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f988dffb640 1 -- 172.21.15.46:0/5582149 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9898003820 con 0x563fa8a039d0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 10 client.15108 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 10 client.15108 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 20 client.15108 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 4 client.15108 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.409+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fa8977600 con 0x563fa8a1f030 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.410+0000 7f989dd9b640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.410+0000 7f989dd9b640 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a204a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f4fb57006e303512 server_cookie=1683108793587669 in_seq=0 out_seq=0 2024-09-19T09:18:03.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.410+0000 7f988dffb640 10 client.15108 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f988dffb640 1 -- 172.21.15.46:0/5582149 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563fa8977600 con 0x563fa8a1f030 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f988dffb640 10 client.15108 handle_command_reply: tid=0 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 client.15108 shutdown 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 msgr2=0x563fa8a0e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a0e2a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9898009900 tx=0x7f989802a420 comp rx=0 tx=0).stop 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 shutdown_connections 2024-09-19T09:18:03.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a204a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f988dffb640 0 client.15108 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 --2- 172.21.15.46:0/5582149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a0e2a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 >> 172.21.15.46:0/5582149 conn(0x563fa89fff60 msgr2=0x563fa8a05c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 shutdown_connections 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 1 -- 172.21.15.46:0/5582149 wait complete. 2024-09-19T09:18:03.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.411+0000 7f98af004740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.429+0000 7f98af004740 1 Processor -- start 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.429+0000 7f98af004740 1 -- start start 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98af004740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98af004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98af004740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98af004740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a1e7e0 con 0x563fa8a039d0 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98af004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a1eeb0 con 0x563fa8a042f0 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98af004740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a1f580 con 0x563fa8a0ebb0 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a204a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51800/0 (socket says 172.21.15.46:51800) 2024-09-19T09:18:03.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 -- 172.21.15.46:0/1965401039 learned_addr learned my addr 172.21.15.46:0/1965401039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 -- 172.21.15.46:0/1965401039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 msgr2=0x563fa8a0d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 -- 172.21.15.46:0/1965401039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 msgr2=0x563fa8a0c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f989dd9b640 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 -- 172.21.15.46:0/1965401039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fa8a04120 con 0x563fa8a039d0 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f98a659c640 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a204a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f989802a940 tx=0x7f9898005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7badbaafa6c1cdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f988ffff640 1 -- 172.21.15.46:0/1965401039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898040070 con 0x563fa8a039d0 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f988ffff640 1 -- 172.21.15.46:0/1965401039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f989804d070 con 0x563fa8a039d0 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.430+0000 7f988ffff640 1 -- 172.21.15.46:0/1965401039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898004f70 con 0x563fa8a039d0 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 -- 172.21.15.46:0/1965401039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 msgr2=0x563fa8a204a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a204a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f989802a940 tx=0x7f9898005e60 comp rx=0 tx=0).stop 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 -- 172.21.15.46:0/1965401039 shutdown_connections 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a0d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a0c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 --2- 172.21.15.46:0/1965401039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a204a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 -- 172.21.15.46:0/1965401039 >> 172.21.15.46:0/1965401039 conn(0x563fa89fff60 msgr2=0x563fa8a00340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 -- 172.21.15.46:0/1965401039 shutdown_connections 2024-09-19T09:18:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 -- 172.21.15.46:0/1965401039 wait complete. 2024-09-19T09:18:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 -- start start 2024-09-19T09:18:03.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.431+0000 7f98af004740 1 Processor -- start 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a28b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a08100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a08640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a20320 con 0x563fa8a039d0 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a1fc50 con 0x563fa8a042f0 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563fa8a209f0 con 0x563fa8a0ebb0 2024-09-19T09:18:03.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98af004740 10 client.0 _ll_register_callbacks cb 0x7f989802aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a28b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a28b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51810/0 (socket says 172.21.15.46:51810) 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 -- 172.21.15.46:0/1583927161 learned_addr learned my addr 172.21.15.46:0/1583927161 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f989dd9b640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a6d9d640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a08640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 -- 172.21.15.46:0/1583927161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 msgr2=0x563fa8a08640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a08640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 -- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 msgr2=0x563fa8a08100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a08100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 -- 172.21.15.46:0/1583927161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fa8a08b80 con 0x563fa8a039d0 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f98a659c640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a28b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9898031420 tx=0x7f9898004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f97cce5cff2710 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:03.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.432+0000 7f988dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f988dffb640 1 -- 172.21.15.46:0/1583927161 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9898040070 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f988dffb640 1 -- 172.21.15.46:0/1583927161 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f98980035f0 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f989804d070 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f988dffb640 1 -- 172.21.15.46:0/1583927161 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9898003fe0 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 10 client.15114 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563fa8a253d0 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f988dffb640 1 -- 172.21.15.46:0/1583927161 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f989804d070 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f988dffb640 1 -- 172.21.15.46:0/1583927161 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f989805c030 con 0x563fa8a039d0 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 10 client.15114 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 10 client.15114 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 20 client.15114 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a8c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:03.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 4 client.15114 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.433+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "status"}) -- 0x563fa8971b10 con 0x563fa8a1f030 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f989dd9b640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a8c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f988dffb640 10 client.15114 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f989dd9b640 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a8c740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=543f3239b0f98fc8 server_cookie=b565fc459f9543d9 in_seq=0 out_seq=0 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f988dffb640 1 -- 172.21.15.46:0/1583927161 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563fa8971b10 con 0x563fa8a1f030 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f988dffb640 10 client.15114 handle_command_reply: tid=0 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 client.15114 shutdown 2024-09-19T09:18:03.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 msgr2=0x563fa8a28b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a28b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9898031420 tx=0x7f9898004bc0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 shutdown_connections 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x563fa8a1f030 0x563fa8a8c740 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563fa8a0ebb0 0x563fa8a08640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.434+0000 7f98af004740 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563fa8a042f0 0x563fa8a08100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98af004740 1 --2- 172.21.15.46:0/1583927161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563fa8a039d0 0x563fa8a28b90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f988dffb640 0 client.15114 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 >> 172.21.15.46:0/1583927161 conn(0x563fa89fff60 msgr2=0x563fa8a0b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 shutdown_connections 2024-09-19T09:18:03.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98af004740 1 -- 172.21.15.46:0/1583927161 wait complete. 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98af004740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24446, 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:03.444 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:03.445 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 88.391348626999999, 2024-09-19T09:18:03.445 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:18:03.445 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:03.445 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:18:03.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 121.284699731 2024-09-19T09:18:03.445 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98940a3240 msgr2=0x7f98940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98940a3240 0x7f98940a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009fd0 tx=0x7f98a0009b10 comp rx=0 tx=0).stop 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 msgr2=0x7f98a810e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 0x7f98a810e920 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f989000b4a0 tx=0x7f989000b960 comp rx=0 tx=0).stop 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 shutdown_connections 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98940a3240 0x7f98940a5700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98a8101420 0x7f98a810e920 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98a8106a80 0x7f98a810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 --2- 172.21.15.46:0/2412784129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98a8100a80 0x7f98a810e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:03.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.435+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 >> 172.21.15.46:0/2412784129 conn(0x7f98a80fc7a0 msgr2=0x7f98a80fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.436+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 shutdown_connections 2024-09-19T09:18:03.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:03.436+0000 7f98acc2b640 1 -- 172.21.15.46:0/2412784129 wait complete. 2024-09-19T09:18:04.208 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T09:18:04.470 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:04.861 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:04 smithi046 ceph-mon[31203]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 -- 172.21.15.46:0/3251702158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 msgr2=0x7f4ac810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 --2- 172.21.15.46:0/3251702158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac810da40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009900 tx=0x7f4ac002a480 comp rx=0 tx=0).stop 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 -- 172.21.15.46:0/3251702158 shutdown_connections 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 --2- 172.21.15.46:0/3251702158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac810da40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 --2- 172.21.15.46:0/3251702158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ac8102570 0x7f4ac81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 --2- 172.21.15.46:0/3251702158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ac8100e20 0x7f4ac8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 -- 172.21.15.46:0/3251702158 >> 172.21.15.46:0/3251702158 conn(0x7f4ac80fc7d0 msgr2=0x7f4ac80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 -- 172.21.15.46:0/3251702158 shutdown_connections 2024-09-19T09:18:04.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 -- 172.21.15.46:0/3251702158 wait complete. 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.943+0000 7f4ace06e640 1 Processor -- start 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 -- start start 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ac8100e20 0x7f4ac81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ac8102570 0x7f4ac8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac8199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac8110f80 con 0x7f4ac8102ef0 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac8110e00 con 0x7f4ac8100e20 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ace06e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac8111100 con 0x7f4ac8102570 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac8199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac8199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51832/0 (socket says 172.21.15.46:51832) 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 -- 172.21.15.46:0/1526025451 learned_addr learned my addr 172.21.15.46:0/1526025451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:04.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ac8100e20 0x7f4ac81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ac8102570 0x7f4ac8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 -- 172.21.15.46:0/1526025451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ac8102570 msgr2=0x7f4ac8199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ac8102570 0x7f4ac8199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 -- 172.21.15.46:0/1526025451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ac8100e20 msgr2=0x7f4ac81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ac8100e20 0x7f4ac81993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.944+0000 7f4ac7fff640 1 -- 172.21.15.46:0/1526025451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac81a47d0 con 0x7f4ac8102ef0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.945+0000 7f4ac7fff640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac8199e90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0004770 tx=0x7f4ac0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.945+0000 7f4ac4ff9640 1 -- 172.21.15.46:0/1526025451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac003f070 con 0x7f4ac8102ef0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.945+0000 7f4ac4ff9640 1 -- 172.21.15.46:0/1526025451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ac0031c30 con 0x7f4ac8102ef0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.945+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac81a4a60 con 0x7f4ac8102ef0 2024-09-19T09:18:04.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.945+0000 7f4ac4ff9640 1 -- 172.21.15.46:0/1526025451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0035030 con 0x7f4ac8102ef0 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.945+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac81a4f40 con 0x7f4ac8102ef0 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.947+0000 7f4ac4ff9640 1 -- 172.21.15.46:0/1526025451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4ac0042070 con 0x7f4ac8102ef0 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.947+0000 7f4ad0447740 1 Processor -- start 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.947+0000 7f4ad0447740 1 -- start start 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad852cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad861a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad861fc0 0x55f1ad8643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ad0447740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad7b9090 con 0x55f1ad8528f0 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ad0447740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad760a70 con 0x55f1ad861fc0 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ad0447740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad7b5050 con 0x55f1ad853210 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac4ff9640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ab00a3240 0x7f4ab00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad852cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad852cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51846/0 (socket says 172.21.15.46:51846) 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/4064323839 learned_addr learned my addr 172.21.15.46:0/4064323839 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac7fff640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ab00a3240 0x7f4ab00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad861a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad861fc0 0x55f1ad8643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac4ff9640 1 -- 172.21.15.46:0/1526025451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4ac00f01a0 con 0x7f4ac8102ef0 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/4064323839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 msgr2=0x55f1ad861a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad861a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/4064323839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad861fc0 msgr2=0x55f1ad8643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad861fc0 0x55f1ad8643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/4064323839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ad76d130 con 0x55f1ad8528f0 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad852cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4abc013520 tx=0x7f4abc00b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfee4b38ab635faa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:04.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4ac7fff640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ab00a3240 0x7f4ab00a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00bc780 tx=0x7f4ac008b530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.948+0000 7f4aadffb640 1 -- 172.21.15.46:0/4064323839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc019030 con 0x55f1ad8528f0 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4aadffb640 1 -- 172.21.15.46:0/4064323839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4abc005bf0 con 0x55f1ad8528f0 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4aadffb640 1 -- 172.21.15.46:0/4064323839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc01d880 con 0x55f1ad8528f0 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 -- 172.21.15.46:0/4064323839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 msgr2=0x55f1ad852cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad852cd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4abc013520 tx=0x7f4abc00b610 comp rx=0 tx=0).stop 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 -- 172.21.15.46:0/4064323839 shutdown_connections 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad861fc0 0x55f1ad8643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad861a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 --2- 172.21.15.46:0/4064323839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad852cd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 -- 172.21.15.46:0/4064323839 >> 172.21.15.46:0/4064323839 conn(0x55f1ad84ef60 msgr2=0x55f1ad84f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 -- 172.21.15.46:0/4064323839 shutdown_connections 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.949+0000 7f4ad0447740 1 -- 172.21.15.46:0/4064323839 wait complete. 2024-09-19T09:18:04.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 -- start start 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 Processor -- start 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad8528f0 0x55f1ad861850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad85eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad85f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad864b30 con 0x55f1ad861fc0 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad773f20 con 0x55f1ad8528f0 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad864cb0 con 0x55f1ad853210 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ad0447740 10 client.0 _ll_register_callbacks cb 0x55f1ad73d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad85f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad85f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51852/0 (socket says 172.21.15.46:51852) 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/1252653204 learned_addr learned my addr 172.21.15.46:0/1252653204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:04.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad85eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.950+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad8528f0 0x55f1ad861850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac77fe640 1 -- 172.21.15.46:0/1252653204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad8528f0 msgr2=0x55f1ad861850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad8528f0 0x55f1ad861850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac77fe640 1 -- 172.21.15.46:0/1252653204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 msgr2=0x55f1ad85f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad85f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac77fe640 1 -- 172.21.15.46:0/1252653204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ad52a2b0 con 0x55f1ad853210 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad85f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad85eba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8012980 tx=0x7f4ab8012e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f67ccc731cbaa09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4aa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/1252653204 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab801f060 con 0x55f1ad853210 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1ad7c6600 con 0x55f1ad853210 2024-09-19T09:18:04.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/1252653204 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4ab800cd80 con 0x55f1ad853210 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/1252653204 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4ab801a3f0 con 0x55f1ad853210 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ad0447740 10 client.24832 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f1ad870560 con 0x55f1ad853210 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.951+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/1252653204 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f1ad7c6600 con 0x55f1ad853210 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/1252653204 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4ab8019030 con 0x55f1ad853210 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4ad0447740 10 client.24832 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4ad0447740 10 client.24832 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4ad0447740 20 client.24832 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4ad0447740 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad872ae0 0x55f1ad873f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4ad0447740 4 client.24832 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:04.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.952+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1ad7c0b10 con 0x55f1ad872ae0 2024-09-19T09:18:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.953+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad872ae0 0x55f1ad873f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.953+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad872ae0 0x55f1ad873f50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=33259ed90929ad7d server_cookie=b77aaf82d1498e43 in_seq=0 out_seq=0 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.953+0000 7f4aa6ffd640 10 client.24832 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/1252653204 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1ad7c0b10 con 0x55f1ad872ae0 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4aa6ffd640 10 client.24832 handle_command_reply: tid=0 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 client.24832 shutdown 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 msgr2=0x55f1ad85eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad85eba0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8012980 tx=0x7f4ab8012e40 comp rx=0 tx=0).stop 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 shutdown_connections 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad872ae0 0x55f1ad873f50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad85f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad853210 0x55f1ad85eba0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4aa6ffd640 0 client.24832 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:04.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 --2- 172.21.15.46:0/1252653204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad8528f0 0x55f1ad861850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 >> 172.21.15.46:0/1252653204 conn(0x55f1ad84ef60 msgr2=0x55f1ad854bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 shutdown_connections 2024-09-19T09:18:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 1 -- 172.21.15.46:0/1252653204 wait complete. 2024-09-19T09:18:04.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.954+0000 7f4ad0447740 20 client.24832 trim_cache size 0 max 16384 2024-09-19T09:18:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 Processor -- start 2024-09-19T09:18:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 -- start start 2024-09-19T09:18:04.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad8528f0 0x55f1ad873f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad87c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad87c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad872290 con 0x55f1ad861fc0 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad872960 con 0x55f1ad853210 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ad0447740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad873030 con 0x55f1ad8528f0 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad87c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad87c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51860/0 (socket says 172.21.15.46:51860) 2024-09-19T09:18:04.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.972+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2638368724 learned_addr learned my addr 172.21.15.46:0/2638368724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad87c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad8528f0 0x55f1ad873f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2638368724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad8528f0 msgr2=0x55f1ad873f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad8528f0 0x55f1ad873f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2638368724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 msgr2=0x55f1ad87c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad87c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2638368724 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ad85f960 con 0x55f1ad861fc0 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad87c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad87c770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00bec0 tx=0x7f4abc01d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af8b63e912706e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4aad7fa640 1 -- 172.21.15.46:0/2638368724 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc019040 con 0x55f1ad861fc0 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4aad7fa640 1 -- 172.21.15.46:0/2638368724 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4abc033030 con 0x55f1ad861fc0 2024-09-19T09:18:04.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.973+0000 7f4aad7fa640 1 -- 172.21.15.46:0/2638368724 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc011730 con 0x55f1ad861fc0 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 -- 172.21.15.46:0/2638368724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 msgr2=0x55f1ad87c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad87c770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00bec0 tx=0x7f4abc01d460 comp rx=0 tx=0).stop 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 -- 172.21.15.46:0/2638368724 shutdown_connections 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad861fc0 0x55f1ad87c770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad87c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2638368724 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad8528f0 0x55f1ad873f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 -- 172.21.15.46:0/2638368724 >> 172.21.15.46:0/2638368724 conn(0x55f1ad84ef60 msgr2=0x55f1ad85a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 -- 172.21.15.46:0/2638368724 shutdown_connections 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 -- 172.21.15.46:0/2638368724 wait complete. 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 -- start start 2024-09-19T09:18:04.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.974+0000 7f4ad0447740 1 Processor -- start 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad875690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad875bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad861fc0 0x55f1ad8db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad873dd0 con 0x55f1ad8528f0 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad873700 con 0x55f1ad853210 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f1ad8744a0 con 0x55f1ad861fc0 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ad0447740 10 client.0 _ll_register_callbacks cb 0x7f4ab8009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad875690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad875690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51872/0 (socket says 172.21.15.46:51872) 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2498697187 learned_addr learned my addr 172.21.15.46:0/2498697187 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad875bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad861fc0 0x55f1ad8db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad861fc0 msgr2=0x55f1ad8db1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad861fc0 0x55f1ad8db1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2498697187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 msgr2=0x55f1ad875bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad875bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 -- 172.21.15.46:0/2498697187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ad8db720 con 0x55f1ad8528f0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4ac6ffd640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad875690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4abc004630 tx=0x7f4abc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce1e0d14f5993b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.975+0000 7f4aa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/2498697187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc041020 con 0x55f1ad8528f0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/2498697187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4abc0114b0 con 0x55f1ad8528f0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4abc033030 con 0x55f1ad8528f0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/2498697187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4abc019070 con 0x55f1ad8528f0 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 10 client.15132 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:04.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f1ad8dc920 con 0x55f1ad8528f0 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/2498697187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4abc033030 con 0x55f1ad8528f0 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/2498697187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4abc02fad0 con 0x55f1ad8528f0 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 10 client.15132 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 10 client.15132 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 20 client.15132 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad8e0c90 0x55f1ad8df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 4 client.15132 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.976+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "status"}) -- 0x55f1ad73d0e0 con 0x55f1ad8e0c90 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad8e0c90 0x55f1ad8df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ac77fe640 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad8e0c90 0x55f1ad8df9a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=210aaf9604f1288d server_cookie=1911ca3f59a35039 in_seq=0 out_seq=0 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4aa6ffd640 10 client.15132 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4aa6ffd640 1 -- 172.21.15.46:0/2498697187 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f1ad73d0e0 con 0x55f1ad8e0c90 2024-09-19T09:18:04.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4aa6ffd640 10 client.15132 handle_command_reply: tid=0 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 client.15132 shutdown 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 msgr2=0x55f1ad875690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad875690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4abc004630 tx=0x7f4abc011e20 comp rx=0 tx=0).stop 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 shutdown_connections 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f1ad8e0c90 0x55f1ad8df9a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f1ad861fc0 0x55f1ad8db1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f1ad853210 0x55f1ad875bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 --2- 172.21.15.46:0/2498697187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f1ad8528f0 0x55f1ad875690 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4aa6ffd640 0 client.15132 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 >> 172.21.15.46:0/2498697187 conn(0x55f1ad84ef60 msgr2=0x55f1ad85d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.977+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 shutdown_connections 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ad0447740 1 -- 172.21.15.46:0/2498697187 wait complete. 2024-09-19T09:18:04.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ad0447740 20 client.15132 trim_cache size 0 max 16384 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24451, 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 90.941611246999997, 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:18:04.985 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:04.986 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:18:04.986 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 128.085686213 2024-09-19T09:18:04.986 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:04.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ab00a3240 msgr2=0x7f4ab00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ab00a3240 0x7f4ab00a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00bc780 tx=0x7f4ac008b530 comp rx=0 tx=0).stop 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 msgr2=0x7f4ac8199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac8199e90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0004770 tx=0x7f4ac0003c10 comp rx=0 tx=0).stop 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 shutdown_connections 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4ab00a3240 0x7f4ab00a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4ac8102ef0 0x7f4ac8199e90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ac8102570 0x7f4ac8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 --2- 172.21.15.46:0/1526025451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ac8100e20 0x7f4ac81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 >> 172.21.15.46:0/1526025451 conn(0x7f4ac80fc7d0 msgr2=0x7f4ac81068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 shutdown_connections 2024-09-19T09:18:04.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:04.978+0000 7f4ace06e640 1 -- 172.21.15.46:0/1526025451 wait complete. 2024-09-19T09:18:05.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:04 smithi115 ceph-mon[35055]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:18:05.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:04 smithi099 ceph-mon[35256]: pgmap v331: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:18:05.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:18:05.973 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:06.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 -- 172.21.15.46:0/350902907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 msgr2=0x7f627c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 --2- 172.21.15.46:0/350902907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c1067e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f626c009900 tx=0x7f626c02a410 comp rx=0 tx=0).stop 2024-09-19T09:18:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 -- 172.21.15.46:0/350902907 shutdown_connections 2024-09-19T09:18:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 --2- 172.21.15.46:0/350902907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c1067e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 --2- 172.21.15.46:0/350902907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f627c106f10 0x7f627c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 --2- 172.21.15.46:0/350902907 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c101de0 0x7f627c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 -- 172.21.15.46:0/350902907 >> 172.21.15.46:0/350902907 conn(0x7f627c0fd8c0 msgr2=0x7f627c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 -- 172.21.15.46:0/350902907 shutdown_connections 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.394+0000 7f6284691640 1 -- 172.21.15.46:0/350902907 wait complete. 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.395+0000 7f6284691640 1 Processor -- start 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.395+0000 7f6284691640 1 -- start start 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6284691640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f627c101de0 0x7f627c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6284691640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6284691640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c106f10 0x7f627c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6284691640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f627c111f30 con 0x7f627c102790 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6284691640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f627c111db0 con 0x7f627c101de0 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6284691640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f627c1120b0 con 0x7f627c106f10 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51888/0 (socket says 172.21.15.46:51888) 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 -- 172.21.15.46:0/2845162796 learned_addr learned my addr 172.21.15.46:0/2845162796 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f628242d640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f627c101de0 0x7f627c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6282c2e640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c106f10 0x7f627c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 -- 172.21.15.46:0/2845162796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c106f10 msgr2=0x7f627c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c106f10 0x7f627c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 -- 172.21.15.46:0/2845162796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f627c101de0 msgr2=0x7f627c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f627c101de0 0x7f627c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 -- 172.21.15.46:0/2845162796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c19d300 con 0x7f627c102790 2024-09-19T09:18:06.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6282c2e640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c106f10 0x7f627c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.396+0000 7f6281c2c640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c198890 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f626c005ab0 tx=0x7f626c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.397+0000 7f62737fe640 1 -- 172.21.15.46:0/2845162796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c03f030 con 0x7f627c102790 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.397+0000 7f62737fe640 1 -- 172.21.15.46:0/2845162796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f626c003ce0 con 0x7f627c102790 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.397+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c19d590 con 0x7f627c102790 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.397+0000 7f62737fe640 1 -- 172.21.15.46:0/2845162796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c035070 con 0x7f627c102790 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.397+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c1a4ed0 con 0x7f627c102790 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.399+0000 7f62737fe640 1 -- 172.21.15.46:0/2845162796 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f626c042030 con 0x7f627c102790 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.399+0000 7f6286a6a740 1 Processor -- start 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 -- start start 2024-09-19T09:18:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f62737fe640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62680a32c0 0x7f62680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd18db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd23bb0 0x55653bd25fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55653bc7f090 con 0x55653bd23bb0 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55653bc26a70 con 0x55653bd189d0 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6286a6a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55653bc7b050 con 0x55653bd192f0 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6282c2e640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62680a32c0 0x7f62680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f62737fe640 1 -- 172.21.15.46:0/2845162796 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f626c0efe90 con 0x7f627c102790 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f628242d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd18db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f628242d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd18db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:41920/0 (socket says 172.21.15.46:41920) 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f628242d640 1 -- 172.21.15.46:0/4186343453 learned_addr learned my addr 172.21.15.46:0/4186343453 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6282c2e640 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd23bb0 0x55653bd25fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.400+0000 7f6281c2c640 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f6282c2e640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62680a32c0 0x7f62680a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6274005cc0 tx=0x7f6274014a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f628242d640 1 -- 172.21.15.46:0/4186343453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 msgr2=0x55653bd23670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f628242d640 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd23670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f628242d640 1 -- 172.21.15.46:0/4186343453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd23bb0 msgr2=0x55653bd25fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f628242d640 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd23bb0 0x55653bd25fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f628242d640 1 -- 172.21.15.46:0/4186343453 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653bc33130 con 0x55653bd189d0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f6281c2c640 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd23670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f628242d640 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd18db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f627800cc60 tx=0x7f627800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc25019e128a059f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f6270ff9640 1 -- 172.21.15.46:0/4186343453 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278014070 con 0x55653bd189d0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f6270ff9640 1 -- 172.21.15.46:0/4186343453 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62780047a0 con 0x55653bd189d0 2024-09-19T09:18:06.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.401+0000 7f6270ff9640 1 -- 172.21.15.46:0/4186343453 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62780107f0 con 0x55653bd189d0 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 -- 172.21.15.46:0/4186343453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 msgr2=0x55653bd18db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd18db0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f627800cc60 tx=0x7f627800e720 comp rx=0 tx=0).stop 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 -- 172.21.15.46:0/4186343453 shutdown_connections 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd23bb0 0x55653bd25fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd23670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 --2- 172.21.15.46:0/4186343453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd18db0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 -- 172.21.15.46:0/4186343453 >> 172.21.15.46:0/4186343453 conn(0x55653bd14f60 msgr2=0x55653bd15340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 -- 172.21.15.46:0/4186343453 shutdown_connections 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 -- 172.21.15.46:0/4186343453 wait complete. 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 -- start start 2024-09-19T09:18:06.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.402+0000 7f6286a6a740 1 Processor -- start 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd23430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 0x55653bd20780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd20cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55653bd26780 con 0x55653bd192f0 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55653bc39f20 con 0x55653bd189d0 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55653bd26900 con 0x55653bd23bb0 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6286a6a740 10 client.0 _ll_register_callbacks cb 0x55653bc03030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 0x55653bd20780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 0x55653bd20780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51902/0 (socket says 172.21.15.46:51902) 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 -- 172.21.15.46:0/620736826 learned_addr learned my addr 172.21.15.46:0/620736826 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f628242d640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd23430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6282c2e640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd20cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 -- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 msgr2=0x55653bd20cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd20cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 -- 172.21.15.46:0/620736826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 msgr2=0x55653bd23430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd23430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 -- 172.21.15.46:0/620736826 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653b9f02b0 con 0x55653bd192f0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6282c2e640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd20cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6281c2c640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 0x55653bd20780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f626c000c00 tx=0x7f626c0bc080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd6f5db73f63c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.403+0000 7f6265ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6265ffb640 1 -- 172.21.15.46:0/620736826 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c049040 con 0x55653bd192f0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6265ffb640 1 -- 172.21.15.46:0/620736826 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f626c0eda70 con 0x55653bd192f0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62780047a0 con 0x55653bd192f0 2024-09-19T09:18:06.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6265ffb640 1 -- 172.21.15.46:0/620736826 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f626c0bcb80 con 0x55653bd192f0 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 10 client.15144 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55653bd32090 con 0x55653bd192f0 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6265ffb640 1 -- 172.21.15.46:0/620736826 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62780047a0 con 0x55653bd192f0 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6265ffb640 1 -- 172.21.15.46:0/620736826 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f626c047120 con 0x55653bd192f0 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 10 client.15144 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 10 client.15144 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 20 client.15144 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bd35b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 4 client.15144 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.404+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55653bc8c600 con 0x55653bd346d0 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.405+0000 7f628242d640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bd35b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.405+0000 7f6265ffb640 10 client.15144 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:06.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.405+0000 7f628242d640 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bd35b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc5765146a0027ee server_cookie=e358713e798772e7 in_seq=0 out_seq=0 2024-09-19T09:18:06.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6265ffb640 1 -- 172.21.15.46:0/620736826 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55653bc8c600 con 0x55653bd346d0 2024-09-19T09:18:06.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6265ffb640 10 client.15144 handle_command_reply: tid=0 2024-09-19T09:18:06.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 client.15144 shutdown 2024-09-19T09:18:06.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 msgr2=0x55653bd20780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 0x55653bd20780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f626c000c00 tx=0x7f626c0bc080 comp rx=0 tx=0).stop 2024-09-19T09:18:06.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 shutdown_connections 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bd35b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6265ffb640 0 client.15144 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd192f0 0x55653bd20780 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd20cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 --2- 172.21.15.46:0/620736826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd189d0 0x55653bd23430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 >> 172.21.15.46:0/620736826 conn(0x55653bd14f60 msgr2=0x55653bd1ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 shutdown_connections 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 1 -- 172.21.15.46:0/620736826 wait complete. 2024-09-19T09:18:06.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.406+0000 7f6286a6a740 20 client.15144 trim_cache size 0 max 16384 2024-09-19T09:18:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 Processor -- start 2024-09-19T09:18:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 -- start start 2024-09-19T09:18:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd35b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd192f0 0x55653bd1f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd1f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55653bd33e80 con 0x55653bd189d0 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55653bd34550 con 0x55653bd192f0 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6286a6a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55653bd34c20 con 0x55653bd23bb0 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd35b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd35b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51914/0 (socket says 172.21.15.46:51914) 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 -- 172.21.15.46:0/1877803407 learned_addr learned my addr 172.21.15.46:0/1877803407 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6281c2c640 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd192f0 0x55653bd1f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f6282c2e640 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd1f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 -- 172.21.15.46:0/1877803407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 msgr2=0x55653bd1f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd1f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 -- 172.21.15.46:0/1877803407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd192f0 msgr2=0x55653bd1f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd192f0 0x55653bd1f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.426+0000 7f628242d640 1 -- 172.21.15.46:0/1877803407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653bd21540 con 0x55653bd189d0 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f628242d640 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd35b40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f627800cb80 tx=0x7f627800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a8b24909ff2d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6267fff640 1 -- 172.21.15.46:0/1877803407 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278014070 con 0x55653bd189d0 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6267fff640 1 -- 172.21.15.46:0/1877803407 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6278005530 con 0x55653bd189d0 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6267fff640 1 -- 172.21.15.46:0/1877803407 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278003850 con 0x55653bd189d0 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 -- 172.21.15.46:0/1877803407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 msgr2=0x55653bd35b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd35b40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f627800cb80 tx=0x7f627800eed0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 -- 172.21.15.46:0/1877803407 shutdown_connections 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd23bb0 0x55653bd1f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd192f0 0x55653bd1f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 --2- 172.21.15.46:0/1877803407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd35b40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.427+0000 7f6286a6a740 1 -- 172.21.15.46:0/1877803407 >> 172.21.15.46:0/1877803407 conn(0x55653bd14f60 msgr2=0x55653bd20740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 -- 172.21.15.46:0/1877803407 shutdown_connections 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 -- 172.21.15.46:0/1877803407 wait complete. 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 -- start start 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 Processor -- start 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd3e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd3e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd23bb0 0x55653bd37340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55653bd359c0 con 0x55653bd189d0 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55653bd352f0 con 0x55653bd23bb0 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55653bd36090 con 0x55653bd192f0 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f6286a6a740 10 client.0 _ll_register_callbacks cb 0x7f626c003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f628242d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd3e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f628242d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd3e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51924/0 (socket says 172.21.15.46:51924) 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.428+0000 7f628242d640 1 -- 172.21.15.46:0/66757278 learned_addr learned my addr 172.21.15.46:0/66757278 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:06.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6281c2c640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd3e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6282c2e640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd23bb0 0x55653bd37340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f628242d640 1 -- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 msgr2=0x55653bd3e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f628242d640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd3e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f628242d640 1 -- 172.21.15.46:0/66757278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd23bb0 msgr2=0x55653bd37340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f628242d640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd23bb0 0x55653bd37340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f628242d640 1 -- 172.21.15.46:0/66757278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653bd37b70 con 0x55653bd189d0 2024-09-19T09:18:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6281c2c640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd3e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6282c2e640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd23bb0 0x55653bd37340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f628242d640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd3e010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6278010e70 tx=0x7f6278005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d04306707fd1f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6265ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6265ffb640 1 -- 172.21.15.46:0/66757278 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278014070 con 0x55653bd189d0 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6265ffb640 1 -- 172.21.15.46:0/66757278 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6278010630 con 0x55653bd189d0 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6278005530 con 0x55653bd189d0 2024-09-19T09:18:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6265ffb640 1 -- 172.21.15.46:0/66757278 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6278010850 con 0x55653bd189d0 2024-09-19T09:18:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6286a6a740 10 client.15150 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55653bd3c5f0 con 0x55653bd189d0 2024-09-19T09:18:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.429+0000 7f6265ffb640 1 -- 172.21.15.46:0/66757278 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6278005530 con 0x55653bd189d0 2024-09-19T09:18:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6265ffb640 1 -- 172.21.15.46:0/66757278 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6278024460 con 0x55653bd189d0 2024-09-19T09:18:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6286a6a740 10 client.15150 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6286a6a740 10 client.15150 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6286a6a740 20 client.15150 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6286a6a740 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bda19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6286a6a740 4 client.15150 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "status"}) -- 0x55653bc86b10 con 0x55653bd346d0 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6281c2c640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bda19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6281c2c640 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bda19f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f90eeefea2a9577 server_cookie=85764306187dc62d in_seq=0 out_seq=0 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.430+0000 7f6265ffb640 10 client.15150 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6265ffb640 1 -- 172.21.15.46:0/66757278 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55653bc86b10 con 0x55653bd346d0 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6265ffb640 10 client.15150 handle_command_reply: tid=0 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 client.15150 shutdown 2024-09-19T09:18:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 msgr2=0x55653bd3e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd3e010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6278010e70 tx=0x7f6278005c90 comp rx=0 tx=0).stop 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 shutdown_connections 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55653bd346d0 0x55653bda19f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55653bd23bb0 0x55653bd37340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55653bd192f0 0x55653bd3e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 --2- 172.21.15.46:0/66757278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55653bd189d0 0x55653bd3e010 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 >> 172.21.15.46:0/66757278 conn(0x55653bd14f60 msgr2=0x55653bd1f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6265ffb640 0 client.15150 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 shutdown_connections 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 1 -- 172.21.15.46:0/66757278 wait complete. 2024-09-19T09:18:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.431+0000 7f6286a6a740 20 client.15150 trim_cache size 0 max 16384 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24463, 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 93.402476751999998, 2024-09-19T09:18:06.444 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:18:06.445 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:06.445 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:18:06.445 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 126.910161135 2024-09-19T09:18:06.445 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:06.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62680a32c0 msgr2=0x7f62680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62680a32c0 0x7f62680a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6274005cc0 tx=0x7f6274014a30 comp rx=0 tx=0).stop 2024-09-19T09:18:06.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 msgr2=0x7f627c198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:06.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c198890 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f626c005ab0 tx=0x7f626c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 shutdown_connections 2024-09-19T09:18:06.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62680a32c0 0x7f62680a5780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f627c102790 0x7f627c198890 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f627c106f10 0x7f627c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 --2- 172.21.15.46:0/2845162796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f627c101de0 0x7f627c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 >> 172.21.15.46:0/2845162796 conn(0x7f627c0fd8c0 msgr2=0x7f627c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:06.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 shutdown_connections 2024-09-19T09:18:06.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:06.432+0000 7f6284691640 1 -- 172.21.15.46:0/2845162796 wait complete. 2024-09-19T09:18:07.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:06 smithi115 ceph-mon[35055]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:18:07.219 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:06 smithi046 ceph-mon[31203]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:18:07.251 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:18:07.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:06 smithi099 ceph-mon[35256]: pgmap v332: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:18:07.512 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 -- 172.21.15.46:0/4025745460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48101de0 msgr2=0x7f2f481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 --2- 172.21.15.46:0/4025745460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48101de0 0x7f2f481021c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009900 tx=0x7f2f3802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 -- 172.21.15.46:0/4025745460 shutdown_connections 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 --2- 172.21.15.46:0/4025745460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f48106f10 0x7f2f4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 --2- 172.21.15.46:0/4025745460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f48102790 0x7f2f481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 --2- 172.21.15.46:0/4025745460 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48101de0 0x7f2f481021c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 -- 172.21.15.46:0/4025745460 >> 172.21.15.46:0/4025745460 conn(0x7f2f480fd8c0 msgr2=0x7f2f480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 -- 172.21.15.46:0/4025745460 shutdown_connections 2024-09-19T09:18:07.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.962+0000 7f2f4db47640 1 -- 172.21.15.46:0/4025745460 wait complete. 2024-09-19T09:18:07.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.963+0000 7f2f4db47640 1 Processor -- start 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.963+0000 7f2f4db47640 1 -- start start 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f4db47640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f48101de0 0x7f2f4819f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f4db47640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 0x7f2f4819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f4db47640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f48106f10 0x7f2f4810dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f4db47640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48111f70 con 0x7f2f48102790 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f4db47640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2f48111df0 con 0x7f2f48106f10 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f4db47640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2f481120f0 con 0x7f2f48101de0 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 0x7f2f4819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f47fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f48106f10 0x7f2f4810dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 0x7f2f4819f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51946/0 (socket says 172.21.15.46:51946) 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 -- 172.21.15.46:0/143524302 learned_addr learned my addr 172.21.15.46:0/143524302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f477fe640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f48101de0 0x7f2f4819f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 -- 172.21.15.46:0/143524302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f48101de0 msgr2=0x7f2f4819f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f48101de0 0x7f2f4819f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 -- 172.21.15.46:0/143524302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f48106f10 msgr2=0x7f2f4810dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f48106f10 0x7f2f4810dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 -- 172.21.15.46:0/143524302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4810e520 con 0x7f2f48102790 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.964+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 0x7f2f4819f5d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000d950 tx=0x7f2f3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.965+0000 7f2f44ff9640 1 -- 172.21.15.46:0/143524302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30017070 con 0x7f2f48102790 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.965+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4810e810 con 0x7f2f48102790 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.965+0000 7f2f44ff9640 1 -- 172.21.15.46:0/143524302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30009c30 con 0x7f2f48102790 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.965+0000 7f2f44ff9640 1 -- 172.21.15.46:0/143524302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000f6b0 con 0x7f2f48102790 2024-09-19T09:18:07.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.965+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4819ad10 con 0x7f2f48102790 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.967+0000 7f2f44ff9640 1 -- 172.21.15.46:0/143524302 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2f300109d0 con 0x7f2f48102790 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.967+0000 7f2f4ff20740 1 Processor -- start 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.967+0000 7f2f4ff20740 1 -- start start 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509989d0 0x563d50998db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509992f0 0x563d509a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563d508ff090 con 0x563d509992f0 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563d508a6a70 con 0x563d509a3bb0 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563d508fb050 con 0x563d509989d0 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509992f0 0x563d509a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509989d0 0x563d50998db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509992f0 0x563d509a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51956/0 (socket says 172.21.15.46:51956) 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f477fe640 1 -- 172.21.15.46:0/3320256729 learned_addr learned my addr 172.21.15.46:0/3320256729 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 -- 172.21.15.46:0/3320256729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 msgr2=0x563d509a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 -- 172.21.15.46:0/3320256729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509992f0 msgr2=0x563d509a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509992f0 0x563d509a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 -- 172.21.15.46:0/3320256729 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d508b3130 con 0x563d509989d0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f44ff9640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2f340a3240 0x7f2f340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f47fff640 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509989d0 0x563d50998db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009f00 tx=0x7f2f40011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab1cb2e7a5daea20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.968+0000 7f2f477fe640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2f340a3240 0x7f2f340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f3dffb640 1 -- 172.21.15.46:0/3320256729 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40004d20 con 0x563d509989d0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f44ff9640 1 -- 172.21.15.46:0/143524302 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2f300cf500 con 0x7f2f48102790 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f3dffb640 1 -- 172.21.15.46:0/3320256729 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40004050 con 0x563d509989d0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f3dffb640 1 -- 172.21.15.46:0/3320256729 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40005280 con 0x563d509989d0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 -- 172.21.15.46:0/3320256729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509989d0 msgr2=0x563d50998db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f477fe640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2f340a3240 0x7f2f340a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f380096c0 tx=0x7f2f380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509989d0 0x563d50998db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009f00 tx=0x7f2f40011810 comp rx=0 tx=0).stop 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 -- 172.21.15.46:0/3320256729 shutdown_connections 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509992f0 0x563d509a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/3320256729 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509989d0 0x563d50998db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 -- 172.21.15.46:0/3320256729 >> 172.21.15.46:0/3320256729 conn(0x563d50994f60 msgr2=0x563d50995340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 -- 172.21.15.46:0/3320256729 shutdown_connections 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.969+0000 7f2f4ff20740 1 -- 172.21.15.46:0/3320256729 wait complete. 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 -- start start 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 Processor -- start 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509a3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509992f0 0x563d509a0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509a3bb0 0x563d509a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563d509a6780 con 0x563d509989d0 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563d508b9f20 con 0x563d509992f0 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563d509a6900 con 0x563d509a3bb0 2024-09-19T09:18:07.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f4ff20740 10 client.0 _ll_register_callbacks cb 0x563d50883030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51970/0 (socket says 172.21.15.46:51970) 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.970+0000 7f2f477fe640 1 -- 172.21.15.46:0/374979807 learned_addr learned my addr 172.21.15.46:0/374979807 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509a3bb0 0x563d509a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509992f0 0x563d509a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 -- 172.21.15.46:0/374979807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509992f0 msgr2=0x563d509a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509992f0 0x563d509a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 -- 172.21.15.46:0/374979807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 msgr2=0x563d509a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:07.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 -- 172.21.15.46:0/374979807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d506702b0 con 0x563d509a3bb0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f477fe640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f47fff640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509a3bb0 0x563d509a0ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f40006010 tx=0x7f2f400044b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6696c410cdeacfbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f26ffd640 1 -- 172.21.15.46:0/374979807 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40029020 con 0x563d509a3bb0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f40004050 con 0x563d509a3bb0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f26ffd640 1 -- 172.21.15.46:0/374979807 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2f40025470 con 0x563d509a3bb0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f26ffd640 1 -- 172.21.15.46:0/374979807 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2f40025670 con 0x563d509a3bb0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f4ff20740 10 client.24862 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.971+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d509b2070 con 0x563d509a3bb0 2024-09-19T09:18:07.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f26ffd640 1 -- 172.21.15.46:0/374979807 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40004050 con 0x563d509a3bb0 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f26ffd640 1 -- 172.21.15.46:0/374979807 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2f40019a30 con 0x563d509a3bb0 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f4ff20740 10 client.24862 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f4ff20740 10 client.24862 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f4ff20740 20 client.24862 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d509b4490 0x563d509b5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f4ff20740 4 client.24862 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d5090c600 con 0x563d509b4490 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.972+0000 7f2f477fe640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d509b4490 0x563d509b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.973+0000 7f2f26ffd640 10 client.24862 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:07.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.973+0000 7f2f477fe640 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d509b4490 0x563d509b5900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a4099d325640e38 server_cookie=7c74600306c711c5 in_seq=0 out_seq=0 2024-09-19T09:18:07.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.973+0000 7f2f26ffd640 1 -- 172.21.15.46:0/374979807 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d5090c600 con 0x563d509b4490 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.973+0000 7f2f26ffd640 10 client.24862 handle_command_reply: tid=0 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.973+0000 7f2f4ff20740 1 client.24862 shutdown 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509a3bb0 msgr2=0x563d509a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509a3bb0 0x563d509a0ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f40006010 tx=0x7f2f400044b0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 shutdown_connections 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d509b4490 0x563d509b5900 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509a3bb0 0x563d509a0ca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509992f0 0x563d509a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/374979807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f26ffd640 0 client.24862 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 >> 172.21.15.46:0/374979807 conn(0x563d50994f60 msgr2=0x563d5099ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 shutdown_connections 2024-09-19T09:18:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 1 -- 172.21.15.46:0/374979807 wait complete. 2024-09-19T09:18:07.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.974+0000 7f2f4ff20740 20 client.24862 trim_cache size 0 max 16384 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 Processor -- start 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 -- start start 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563d509b3c40 con 0x563d509989d0 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563d509b4310 con 0x563d509a3bb0 2024-09-19T09:18:07.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.994+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563d509b49e0 con 0x563d509992f0 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f46ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f46ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:53656/0 (socket says 172.21.15.46:53656) 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f46ffd640 1 -- 172.21.15.46:0/802419587 learned_addr learned my addr 172.21.15.46:0/802419587 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 -- 172.21.15.46:0/802419587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 msgr2=0x563d509b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 -- 172.21.15.46:0/802419587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 msgr2=0x563d509b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 -- 172.21.15.46:0/802419587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d50999120 con 0x563d509a3bb0 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:07.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f477fe640 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f47fff640 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b3dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f40002230 tx=0x7f2f40005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba9d62047ada6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f3d7fa640 1 -- 172.21.15.46:0/802419587 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40029040 con 0x563d509a3bb0 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f3d7fa640 1 -- 172.21.15.46:0/802419587 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40009b30 con 0x563d509a3bb0 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.995+0000 7f2f3d7fa640 1 -- 172.21.15.46:0/802419587 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40023cf0 con 0x563d509a3bb0 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 -- 172.21.15.46:0/802419587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 msgr2=0x563d509b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b3dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f40002230 tx=0x7f2f40005f10 comp rx=0 tx=0).stop 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 -- 172.21.15.46:0/802419587 shutdown_connections 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b3dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/802419587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 -- 172.21.15.46:0/802419587 >> 172.21.15.46:0/802419587 conn(0x563d50994f60 msgr2=0x563d509b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 -- 172.21.15.46:0/802419587 shutdown_connections 2024-09-19T09:18:08.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 -- 172.21.15.46:0/802419587 wait complete. 2024-09-19T09:18:08.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.996+0000 7f2f4ff20740 1 -- start start 2024-09-19T09:18:08.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 Processor -- start 2024-09-19T09:18:08.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x563d509b5780 con 0x563d509989d0 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x563d509b50b0 con 0x563d509a3bb0 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x563d509b5e50 con 0x563d509992f0 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f4ff20740 10 client.0 _ll_register_callbacks cb 0x7f2f38009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51994/0 (socket says 172.21.15.46:51994) 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 -- 172.21.15.46:0/4278358630 learned_addr learned my addr 172.21.15.46:0/4278358630 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f47fff640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 -- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 msgr2=0x563d509b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 -- 172.21.15.46:0/4278358630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 msgr2=0x563d509b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.997+0000 7f2f477fe640 1 -- 172.21.15.46:0/4278358630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d50a1ce30 con 0x563d509989d0 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f477fe640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b8bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2f38031b20 tx=0x7f2f38009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f99e0e360a8ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f26ffd640 1 -- 172.21.15.46:0/4278358630 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38035040 con 0x563d509989d0 2024-09-19T09:18:08.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f26ffd640 1 -- 172.21.15.46:0/4278358630 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2f38003a00 con 0x563d509989d0 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f40009b30 con 0x563d509989d0 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f26ffd640 1 -- 172.21.15.46:0/4278358630 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2f380044b0 con 0x563d509989d0 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 10 client.15168 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d50a1e170 con 0x563d509989d0 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f26ffd640 1 -- 172.21.15.46:0/4278358630 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40009b30 con 0x563d509989d0 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f26ffd640 1 -- 172.21.15.46:0/4278358630 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2f3803d450 con 0x563d509989d0 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 10 client.15168 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 20 client.15168 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.998+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d50a22d20 0x563d50a21a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f4ff20740 4 client.15168 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:08.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "status"}) -- 0x563d50906b10 con 0x563d50a22d20 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d50a22d20 0x563d50a21a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f46ffd640 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d50a22d20 0x563d50a21a30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec377b43ac20f072 server_cookie=166a6d9270d5fc7e in_seq=0 out_seq=0 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f26ffd640 10 client.15168 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f26ffd640 1 -- 172.21.15.46:0/4278358630 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563d50906b10 con 0x563d50a22d20 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f26ffd640 10 client.15168 handle_command_reply: tid=0 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:07.999+0000 7f2f4ff20740 1 client.15168 shutdown 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 msgr2=0x563d509b8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b8bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2f38031b20 tx=0x7f2f38009260 comp rx=0 tx=0).stop 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 shutdown_connections 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x563d50a22d20 0x563d50a21a30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563d509a3bb0 0x563d509b9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x563d509992f0 0x563d509b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 --2- 172.21.15.46:0/4278358630 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x563d509989d0 0x563d509b8bd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 >> 172.21.15.46:0/4278358630 conn(0x563d50994f60 msgr2=0x563d509a0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f26ffd640 0 client.15168 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 shutdown_connections 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 1 -- 172.21.15.46:0/4278358630 wait complete. 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4ff20740 20 client.15168 trim_cache size 0 max 16384 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2024-09-19T09:18:08.008 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24472, 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 95.977917696999995, 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 123.197127225 2024-09-19T09:18:08.009 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2f340a3240 msgr2=0x7f2f340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4db47640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2f340a3240 0x7f2f340a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f380096c0 tx=0x7f2f380058d0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 msgr2=0x7f2f4819f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.000+0000 7f2f4db47640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 0x7f2f4819f5d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000d950 tx=0x7f2f3000de10 comp rx=0 tx=0).stop 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 shutdown_connections 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2f340a3240 0x7f2f340a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f48102790 0x7f2f4819f5d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2f48106f10 0x7f2f4810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 --2- 172.21.15.46:0/143524302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f48101de0 0x7f2f4819f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 >> 172.21.15.46:0/143524302 conn(0x7f2f480fd8c0 msgr2=0x7f2f480feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 shutdown_connections 2024-09-19T09:18:08.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:08.001+0000 7f2f4db47640 1 -- 172.21.15.46:0/143524302 wait complete. 2024-09-19T09:18:08.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:18:08.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:08 smithi046 ceph-mon[31203]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:18:09.074 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:09.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:08 smithi115 ceph-mon[35055]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:18:09.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:08 smithi099 ceph-mon[35256]: pgmap v333: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3612498688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58101de0 msgr2=0x7fdc581021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3612498688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58101de0 0x7fdc581021c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009900 tx=0x7fdc4802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3612498688 shutdown_connections 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3612498688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58106f10 0x7fdc5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3612498688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc58102790 0x7fdc581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3612498688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58101de0 0x7fdc581021c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3612498688 >> 172.21.15.46:0/3612498688 conn(0x7fdc580fd8c0 msgr2=0x7fdc580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3612498688 shutdown_connections 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.556+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3612498688 wait complete. 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 Processor -- start 2024-09-19T09:18:09.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 -- start start 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc58101de0 0x7fdc58198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58102790 0x7fdc58198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 0x7fdc5819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58111f90 con 0x7fdc58106f10 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58111e10 con 0x7fdc58102790 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc5caaa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58112110 con 0x7fdc58101de0 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 0x7fdc5819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc56d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 0x7fdc5819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52734/0 (socket says 172.21.15.46:52734) 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc56d9d640 1 -- 172.21.15.46:0/3739402503 learned_addr learned my addr 172.21.15.46:0/3739402503 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.557+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58102790 0x7fdc58198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc5659c640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc58101de0 0x7fdc58198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc56d9d640 1 -- 172.21.15.46:0/3739402503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc58101de0 msgr2=0x7fdc58198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc56d9d640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc58101de0 0x7fdc58198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc56d9d640 1 -- 172.21.15.46:0/3739402503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58102790 msgr2=0x7fdc58198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc56d9d640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58102790 0x7fdc58198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc56d9d640 1 -- 172.21.15.46:0/3739402503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5819d4c0 con 0x7fdc58106f10 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58102790 0x7fdc58198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc56d9d640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 0x7fdc5819cde0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000eaa0 tx=0x7fdc5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc4ffff640 1 -- 172.21.15.46:0/3739402503 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000cdb0 con 0x7fdc58106f10 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc4ffff640 1 -- 172.21.15.46:0/3739402503 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc50005020 con 0x7fdc58106f10 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5819d7b0 con 0x7fdc58106f10 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc4ffff640 1 -- 172.21.15.46:0/3739402503 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500116b0 con 0x7fdc58106f10 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.558+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581a5090 con 0x7fdc58106f10 2024-09-19T09:18:09.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.560+0000 7fdc4ffff640 1 -- 172.21.15.46:0/3739402503 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdc50005560 con 0x7fdc58106f10 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 Processor -- start 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 -- start start 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c5868d0 0x557f1c586cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c595a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c595fc0 0x557f1c5983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f1c4ed090 con 0x557f1c5871f0 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557f1c494a70 con 0x557f1c5868d0 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557f1c4e9050 con 0x557f1c595fc0 2024-09-19T09:18:09.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c595a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c595a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52736/0 (socket says 172.21.15.46:52736) 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc5659c640 1 -- 172.21.15.46:0/432363879 learned_addr learned my addr 172.21.15.46:0/432363879 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c5868d0 0x557f1c586cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc4ffff640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdc440a3240 0x7fdc440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.561+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c595fc0 0x557f1c5983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc5659c640 1 -- 172.21.15.46:0/432363879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c595fc0 msgr2=0x557f1c5983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc5659c640 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c595fc0 0x557f1c5983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc5659c640 1 -- 172.21.15.46:0/432363879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c5868d0 msgr2=0x557f1c586cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc5659c640 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c5868d0 0x557f1c586cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc5659c640 1 -- 172.21.15.46:0/432363879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1c4a1130 con 0x557f1c5871f0 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc56d9d640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdc440a3240 0x7fdc440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc4ffff640 1 -- 172.21.15.46:0/3739402503 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdc500cfc10 con 0x7fdc58106f10 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc5659c640 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c595a80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdc48006010 tx=0x7fdc48031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c9d2344ae9afb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc4cd99640 1 -- 172.21.15.46:0/432363879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4803f070 con 0x557f1c5871f0 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc56d9d640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdc440a3240 0x7fdc440a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc500cdab0 tx=0x7fdc50066bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc4cd99640 1 -- 172.21.15.46:0/432363879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc480317b0 con 0x557f1c5871f0 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.562+0000 7fdc4cd99640 1 -- 172.21.15.46:0/432363879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48035070 con 0x557f1c5871f0 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 -- 172.21.15.46:0/432363879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 msgr2=0x557f1c595a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c595a80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdc48006010 tx=0x7fdc48031510 comp rx=0 tx=0).stop 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 -- 172.21.15.46:0/432363879 shutdown_connections 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c595a80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c595fc0 0x557f1c5983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/432363879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c5868d0 0x557f1c586cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 -- 172.21.15.46:0/432363879 >> 172.21.15.46:0/432363879 conn(0x557f1c582f60 msgr2=0x557f1c583340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 -- 172.21.15.46:0/432363879 shutdown_connections 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 -- 172.21.15.46:0/432363879 wait complete. 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 -- start start 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.563+0000 7fdc5ee83740 1 Processor -- start 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5958f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c592c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c593180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f1c598b90 con 0x557f1c5871f0 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557f1c4a7f20 con 0x557f1c595fc0 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557f1c598d10 con 0x557f1c5868d0 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 10 client.0 _ll_register_callbacks cb 0x557f1c471030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:09.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c592c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c592c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52750/0 (socket says 172.21.15.46:52750) 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 -- 172.21.15.46:0/605838123 learned_addr learned my addr 172.21.15.46:0/605838123 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c593180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 -- 172.21.15.46:0/605838123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 msgr2=0x557f1c5958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 -- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 msgr2=0x557f1c593180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c593180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 -- 172.21.15.46:0/605838123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f1c25e2b0 con 0x557f1c5871f0 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c593180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5659c640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c592c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdc48005910 tx=0x7fdc4802ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de67979dcc8b224b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:09.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc3dffb640 1 -- 172.21.15.46:0/605838123 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4803f050 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc480317b0 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.564+0000 7fdc3dffb640 1 -- 172.21.15.46:0/605838123 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdc48004040 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc3dffb640 1 -- 172.21.15.46:0/605838123 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc48054070 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 10 client.15180 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f1c5a4580 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc3dffb640 1 -- 172.21.15.46:0/605838123 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc480317b0 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc3dffb640 1 -- 172.21.15.46:0/605838123 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdc4803b460 con 0x557f1c5871f0 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 10 client.15180 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 20 client.15180 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c5a6740 0x557f1c5a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 4 client.15180 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:09.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.565+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f1c4fa600 con 0x557f1c5a6740 2024-09-19T09:18:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.566+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c5a6740 0x557f1c5a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.566+0000 7fdc3dffb640 10 client.15180 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:09.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.566+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c5a6740 0x557f1c5a7bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da81fcb6ade82286 server_cookie=930c0fdf2d9e15d6 in_seq=0 out_seq=0 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc3dffb640 1 -- 172.21.15.46:0/605838123 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f1c4fa600 con 0x557f1c5a6740 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc3dffb640 10 client.15180 handle_command_reply: tid=0 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 client.15180 shutdown 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 msgr2=0x557f1c592c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c592c40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdc48005910 tx=0x7fdc4802ab60 comp rx=0 tx=0).stop 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 shutdown_connections 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c5a6740 0x557f1c5a7bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c592c40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c593180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/605838123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 >> 172.21.15.46:0/605838123 conn(0x557f1c582f60 msgr2=0x557f1c588cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc3dffb640 0 client.15180 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 shutdown_connections 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 1 -- 172.21.15.46:0/605838123 wait complete. 2024-09-19T09:18:09.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.567+0000 7fdc5ee83740 20 client.15180 trim_cache size 0 max 16384 2024-09-19T09:18:09.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 Processor -- start 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 -- start start 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 0x557f1c5a6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5871f0 0x557f1c5a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c5a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f1c5a5ef0 con 0x557f1c5868d0 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557f1c5a65c0 con 0x557f1c595fc0 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557f1c5a6c90 con 0x557f1c5871f0 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc4dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 0x557f1c5a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc4dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 0x557f1c5a6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52764/0 (socket says 172.21.15.46:52764) 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.589+0000 7fdc4dd9b640 1 -- 172.21.15.46:0/535248210 learned_addr learned my addr 172.21.15.46:0/535248210 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:09.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc4dd9b640 1 -- 172.21.15.46:0/535248210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5871f0 msgr2=0x557f1c5a6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc5659c640 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5871f0 0x557f1c5a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5871f0 0x557f1c5a6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc4dd9b640 1 -- 172.21.15.46:0/535248210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 msgr2=0x557f1c5a1fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c5a1fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc4dd9b640 1 -- 172.21.15.46:0/535248210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1c595c60 con 0x557f1c5868d0 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc5659c640 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5871f0 0x557f1c5a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 0x557f1c5a6070 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000a8e0 tx=0x7fdc40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9305adb7678b7fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc3ffff640 1 -- 172.21.15.46:0/535248210 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4001f380 con 0x557f1c5868d0 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc3ffff640 1 -- 172.21.15.46:0/535248210 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc40024070 con 0x557f1c5868d0 2024-09-19T09:18:09.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.590+0000 7fdc3ffff640 1 -- 172.21.15.46:0/535248210 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40014a10 con 0x557f1c5868d0 2024-09-19T09:18:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- 172.21.15.46:0/535248210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 msgr2=0x557f1c5a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 0x557f1c5a6070 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000a8e0 tx=0x7fdc40008040 comp rx=0 tx=0).stop 2024-09-19T09:18:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- 172.21.15.46:0/535248210 shutdown_connections 2024-09-19T09:18:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c5a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5871f0 0x557f1c5a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/535248210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5868d0 0x557f1c5a6070 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- 172.21.15.46:0/535248210 >> 172.21.15.46:0/535248210 conn(0x557f1c582f60 msgr2=0x557f1c583340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- 172.21.15.46:0/535248210 shutdown_connections 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- 172.21.15.46:0/535248210 wait complete. 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- start start 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 Processor -- start 2024-09-19T09:18:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c5b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c5a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f1c5a7a30 con 0x557f1c5871f0 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557f1c5a7360 con 0x557f1c595fc0 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557f1c5a8100 con 0x557f1c5868d0 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5ee83740 10 client.0 _ll_register_callbacks cb 0x7fdc4000a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.591+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c5b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c5b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52768/0 (socket says 172.21.15.46:52768) 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 -- 172.21.15.46:0/2944021643 learned_addr learned my addr 172.21.15.46:0/2944021643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 -- 172.21.15.46:0/2944021643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 msgr2=0x557f1c5b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 -- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 msgr2=0x557f1c5a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c5a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 -- 172.21.15.46:0/2944021643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f1c5a9e90 con 0x557f1c5871f0 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5659c640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c5b06f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc4803ba70 tx=0x7fdc48031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93d782b6045fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc3dffb640 1 -- 172.21.15.46:0/2944021643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4803f040 con 0x557f1c5871f0 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc3dffb640 1 -- 172.21.15.46:0/2944021643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdc48031b70 con 0x557f1c5871f0 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc40024070 con 0x557f1c5871f0 2024-09-19T09:18:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc3dffb640 1 -- 172.21.15.46:0/2944021643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdc48035040 con 0x557f1c5871f0 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5ee83740 10 client.15186 fetch_fsmap learned FSMap version 27 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557f1c5ae840 con 0x557f1c5871f0 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.592+0000 7fdc3dffb640 1 -- 172.21.15.46:0/2944021643 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc40024070 con 0x557f1c5871f0 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc3dffb640 1 -- 172.21.15.46:0/2944021643 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fdc48059b20 con 0x557f1c5871f0 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc5ee83740 10 client.15186 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc5ee83740 10 client.15186 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc5ee83740 20 client.15186 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c615590 0x557f1c6142a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc5ee83740 4 client.15186 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "status"}) -- 0x557f1c4f4b10 con 0x557f1c615590 2024-09-19T09:18:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c615590 0x557f1c6142a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc4dd9b640 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c615590 0x557f1c6142a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f04e226ff2390d01 server_cookie=f9eb32b198f18ff2 in_seq=0 out_seq=0 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.593+0000 7fdc3dffb640 10 client.15186 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc3dffb640 1 -- 172.21.15.46:0/2944021643 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x557f1c4f4b10 con 0x557f1c615590 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc3dffb640 10 client.15186 handle_command_reply: tid=0 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 client.15186 shutdown 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 msgr2=0x557f1c5b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c5b06f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc4803ba70 tx=0x7fdc48031860 comp rx=0 tx=0).stop 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 shutdown_connections 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f1c615590 0x557f1c6142a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f1c5871f0 0x557f1c5b06f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc3dffb640 0 client.15186 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f1c595fc0 0x557f1c5a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 --2- 172.21.15.46:0/2944021643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f1c5868d0 0x557f1c5b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 >> 172.21.15.46:0/2944021643 conn(0x557f1c582f60 msgr2=0x557f1c58e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 shutdown_connections 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 1 -- 172.21.15.46:0/2944021643 wait complete. 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5ee83740 20 client.15186 trim_cache size 0 max 16384 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-19T09:18:09.603 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24476, 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 104.607064765, 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 27, 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 115.403426028 2024-09-19T09:18:09.604 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdc440a3240 msgr2=0x7fdc440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdc440a3240 0x7fdc440a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc500cdab0 tx=0x7fdc50066bf0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 msgr2=0x7fdc5819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.594+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 0x7fdc5819cde0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000eaa0 tx=0x7fdc5000ef60 comp rx=0 tx=0).stop 2024-09-19T09:18:09.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 shutdown_connections 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdc440a3240 0x7fdc440a5700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc58106f10 0x7fdc5819cde0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc58102790 0x7fdc58198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 --2- 172.21.15.46:0/3739402503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc58101de0 0x7fdc58198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 >> 172.21.15.46:0/3739402503 conn(0x7fdc580fd8c0 msgr2=0x7fdc580fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 shutdown_connections 2024-09-19T09:18:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:09.595+0000 7fdc5caaa640 1 -- 172.21.15.46:0/3739402503 wait complete. 2024-09-19T09:18:10.378 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:18:10.388 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:18:10.389 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:18:10.389 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:18:10.389 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:18:10.421 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:18:10.422 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:18:10.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:10.422 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-19T09:18:10.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:10.445 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-19T09:18:10.513 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-09-19T09:18:10.514 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:18:10.515 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T09:18:10.515 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:18:10.515 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:10.515 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:18:10.811 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:11.064 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:10 smithi099 ceph-mon[35256]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:18:11.065 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:10 smithi046 ceph-mon[31203]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:18:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:10 smithi115 ceph-mon[35055]: pgmap v334: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T09:18:11.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 -- 172.21.15.46:0/2839835485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c103660 msgr2=0x7fa95c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2839835485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c103660 0x7fa95c10bb50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa944009900 tx=0x7fa94402a480 comp rx=0 tx=0).stop 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 -- 172.21.15.46:0/2839835485 shutdown_connections 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2839835485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c103660 0x7fa95c10bb50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2839835485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa95c10c170 0x7fa95c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2839835485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa95c102d40 0x7fa95c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 -- 172.21.15.46:0/2839835485 >> 172.21.15.46:0/2839835485 conn(0x7fa95c0fc7a0 msgr2=0x7fa95c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 -- 172.21.15.46:0/2839835485 shutdown_connections 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.325+0000 7fa9609f5640 1 -- 172.21.15.46:0/2839835485 wait complete. 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 Processor -- start 2024-09-19T09:18:11.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 -- start start 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa95c102d40 0x7fa95c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa95c103660 0x7fa95c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 0x7fa95c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c111fb0 con 0x7fa95c10c170 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c111e30 con 0x7fa95c102d40 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa9609f5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c112130 con 0x7fa95c103660 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa95ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 0x7fa95c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa95ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 0x7fa95c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52786/0 (socket says 172.21.15.46:52786) 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa95ad9d640 1 -- 172.21.15.46:0/2867054297 learned_addr learned my addr 172.21.15.46:0/2867054297 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.326+0000 7fa953fff640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa95c103660 0x7fa95c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95a59c640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa95c102d40 0x7fa95c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95ad9d640 1 -- 172.21.15.46:0/2867054297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa95c103660 msgr2=0x7fa95c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95ad9d640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa95c103660 0x7fa95c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95ad9d640 1 -- 172.21.15.46:0/2867054297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa95c102d40 msgr2=0x7fa95c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95ad9d640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa95c102d40 0x7fa95c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95ad9d640 1 -- 172.21.15.46:0/2867054297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c1a6920 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa95ad9d640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 0x7fa95c101420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa95400cce0 tx=0x7fa95400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95400f450 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95400fad0 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95c1a6c10 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa954018c10 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.327+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95c1a70d0 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.328+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95c103120 con 0x7fa95c10c170 2024-09-19T09:18:11.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.329+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa95400f5f0 con 0x7fa95c10c170 2024-09-19T09:18:11.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.330+0000 7fa9537fe640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9480a3240 0x7fa9480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.330+0000 7fa95a59c640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9480a3240 0x7fa9480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.330+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa9540cffd0 con 0x7fa95c10c170 2024-09-19T09:18:11.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.330+0000 7fa95a59c640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9480a3240 0x7fa9480a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009890 tx=0x7fa94c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.334+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa954014030 con 0x7fa95c10c170 2024-09-19T09:18:11.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.550+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa95c1071e0 con 0x7fa95c10c170 2024-09-19T09:18:11.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.550+0000 7fa9537fe640 1 -- 172.21.15.46:0/2867054297 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fa95409cd20 con 0x7fa95c10c170 2024-09-19T09:18:11.551 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9480a3240 msgr2=0x7fa9480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9480a3240 0x7fa9480a5700 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009890 tx=0x7fa94c008040 comp rx=0 tx=0).stop 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 msgr2=0x7fa95c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 0x7fa95c101420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa95400cce0 tx=0x7fa95400a620 comp rx=0 tx=0).stop 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 shutdown_connections 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9480a3240 0x7fa9480a5700 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa95c10c170 0x7fa95c101420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa95c103660 0x7fa95c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 --2- 172.21.15.46:0/2867054297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa95c102d40 0x7fa95c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 >> 172.21.15.46:0/2867054297 conn(0x7fa95c0fc7a0 msgr2=0x7fa95c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 shutdown_connections 2024-09-19T09:18:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:11.553+0000 7fa9609f5640 1 -- 172.21.15.46:0/2867054297 wait complete. 2024-09-19T09:18:12.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:11 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2867054297' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:18:12.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:11 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2867054297' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:18:12.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:11 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2867054297' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:18:12.371 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:18:12.372 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:18:12.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:12.373 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-09-19T09:18:12.391 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:18:12.391 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:18:12.391 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:18:12.391 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:12.391 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-09-19T09:18:12.391 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42214sec preferred_lft 42214sec 2024-09-19T09:18:12.392 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-19T09:18:12.393 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:12.393 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:12.393 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:12.393 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-09-19T09:18:12.393 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:18:12.394 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-19T09:18:12.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:12.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:12.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:12.612 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:18:12.642 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-09-19T09:18:12.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:12.642 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-09-19T09:18:12.714 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-09-19T09:18:12.715 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:18:12.715 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:18:12.715 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:18:12.715 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:18:12.715 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:12.715 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-19T09:18:12.715 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:18:12.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:18:12.716 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:18:12.716 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-19T09:18:12.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:12.928 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:12 smithi046 ceph-mon[31203]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:18:13.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:13.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:13.026 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-19T09:18:13.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:13.043 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-09-19T09:18:13.099 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:13.099 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-19T09:18:13.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:18:13.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:18:13.099 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-19T09:18:13.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:13.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:12 smithi115 ceph-mon[35055]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:18:13.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:13.220 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:18:13.220 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:13.220 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-19T09:18:13.220 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:18:13.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:18:13.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:18:13.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:18:13.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:18:13.221 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-19T09:18:13.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:12 smithi099 ceph-mon[35256]: pgmap v335: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:18:13.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:13.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:13.350 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:13.350 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-19T09:18:13.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-09-19T09:18:13.350 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:18:13.350 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-19T09:18:13.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:13.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:13.429 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:18:13.429 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:13.445 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:18:13.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:18:13.446 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:13.501 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T09:18:13.501 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T09:18:13.501 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee 2024-09-19T09:18:13.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:13.501 DEBUG:teuthology.orchestra.run.smithi046:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T09:18:13.612 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T09:18:13.612 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-19T09:18:13.752 INFO:teuthology.orchestra.run.smithi046.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T09:18:13.752 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-19T09:18:13.752 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: resolved to: "172.21.15.46:3300,172.21.15.99:3300,172.21.15.115:3300" 2024-09-19T09:18:13.752 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: trying mount with new device syntax: 0@a514acda-7666-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee 2024-09-19T09:18:13.752 INFO:teuthology.orchestra.run.smithi046.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.46:3300/172.21.15.99:3300/172.21.15.115:3300" will pass to kernel 2024-09-19T09:18:13.753 INFO:teuthology.orchestra.run.smithi046.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:18:13.753 INFO:teuthology.orchestra.run.smithi046.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:18:13.753 INFO:teuthology.orchestra.run.smithi046.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:18:13.753 INFO:teuthology.orchestra.run.smithi046.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:18:13.753 INFO:teuthology.orchestra.run.smithi046.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:18:13.755 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:18:13.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:13.755 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:13.785 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:18:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:18:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:13.883 INFO:teuthology.orchestra.run.smithi046.stdout:client24851 2024-09-19T09:18:13.884 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:18:13.884 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:13.901 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:18:13.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:18:13.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:14.001 INFO:teuthology.orchestra.run.smithi046.stdout:client24851 2024-09-19T09:18:14.001 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:18:14.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:18:14.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi046.stdout:client24851 2024-09-19T09:18:14.059 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a514acda-7666-11ef-bceb-c7b262605968.client24851/status') 2024-09-19T09:18:14.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:14.119 INFO:teuthology.orchestra.run.smithi046.stdout:instance: client.24851 (3)172.21.15.46:0/3307981276 2024-09-19T09:18:14.120 INFO:teuthology.orchestra.run.smithi046.stdout:blocklisted: false 2024-09-19T09:18:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records in 2024-09-19T09:18:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:0+1 records out 2024-09-19T09:18:14.120 INFO:teuthology.orchestra.run.smithi046.stderr:71 bytes copied, 2.4123e-05 s, 2.9 MB/s 2024-09-19T09:18:14.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:14.127 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T09:18:14.138 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T09:18:14.138 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:18:14.138 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T09:18:14.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.242+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/2369592617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae4102df0 msgr2=0x7f1ae4103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.242+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/2369592617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae4102df0 0x7f1ae4103270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8009900 tx=0x7f1ad802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/2369592617 shutdown_connections 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/2369592617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae4102df0 0x7f1ae4103270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/2369592617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae41037b0 0x7f1ae410a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/2369592617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/2369592617 >> 172.21.15.46:0/2369592617 conn(0x7f1ae40fb980 msgr2=0x7f1ae40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/2369592617 shutdown_connections 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/2369592617 wait complete. 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 Processor -- start 2024-09-19T09:18:14.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.243+0000 7f1ae8aaf640 1 -- start start 2024-09-19T09:18:14.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae4102df0 0x7f1ae41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae41037b0 0x7f1ae419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae410d8f0 con 0x7f1ae40ffe20 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae410d770 con 0x7f1ae41037b0 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae410da70 con 0x7f1ae4102df0 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52816/0 (socket says 172.21.15.46:52816) 2024-09-19T09:18:14.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 -- 172.21.15.46:0/608175417 learned_addr learned my addr 172.21.15.46:0/608175417 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae1d9b640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae4102df0 0x7f1ae41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 -- 172.21.15.46:0/608175417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae4102df0 msgr2=0x7f1ae41984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae4102df0 0x7f1ae41984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 -- 172.21.15.46:0/608175417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae41037b0 msgr2=0x7f1ae419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae2d9d640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae41037b0 0x7f1ae419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae41037b0 0x7f1ae419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 -- 172.21.15.46:0/608175417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae419fba0 con 0x7f1ae40ffe20 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae1d9b640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae4102df0 0x7f1ae41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae2d9d640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae41037b0 0x7f1ae419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae259c640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4197f80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b450 tx=0x7f1ad400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4015020 con 0x7f1ae40ffe20 2024-09-19T09:18:14.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ad4011d70 con 0x7f1ae40ffe20 2024-09-19T09:18:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae419fe90 con 0x7f1ae40ffe20 2024-09-19T09:18:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400f340 con 0x7f1ae40ffe20 2024-09-19T09:18:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.244+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae41a03d0 con 0x7f1ae40ffe20 2024-09-19T09:18:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.246+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae4109040 con 0x7f1ae40ffe20 2024-09-19T09:18:14.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.247+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ad4018020 con 0x7f1ae40ffe20 2024-09-19T09:18:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.247+0000 7f1ad37fe640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1acc0a3370 0x7f1acc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.247+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1ad40cf3d0 con 0x7f1ae40ffe20 2024-09-19T09:18:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.247+0000 7f1ae1d9b640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1acc0a3370 0x7f1acc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.248+0000 7f1ae1d9b640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1acc0a3370 0x7f1acc0a5830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c00 tx=0x7f1ad8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.252+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ad401f020 con 0x7f1ae40ffe20 2024-09-19T09:18:14.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.469+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f1ae4062df0 con 0x7f1ae40ffe20 2024-09-19T09:18:14.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.807+0000 7f1ad37fe640 1 -- 172.21.15.46:0/608175417 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f1ad400d040 con 0x7f1ae40ffe20 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1acc0a3370 msgr2=0x7f1acc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1acc0a3370 0x7f1acc0a5830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8000c00 tx=0x7f1ad8031400 comp rx=0 tx=0).stop 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 msgr2=0x7f1ae4197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4197f80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b450 tx=0x7f1ad400b910 comp rx=0 tx=0).stop 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 shutdown_connections 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1acc0a3370 0x7f1acc0a5830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ae41037b0 0x7f1ae419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ae4102df0 0x7f1ae41984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 --2- 172.21.15.46:0/608175417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ae40ffe20 0x7f1ae4197f80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 >> 172.21.15.46:0/608175417 conn(0x7f1ae40fb980 msgr2=0x7f1ae4106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 shutdown_connections 2024-09-19T09:18:14.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.809+0000 7f1ae8aaf640 1 -- 172.21.15.46:0/608175417 wait complete. 2024-09-19T09:18:14.822 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:18:14.833 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T09:18:14.880 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/3032024329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4100420 msgr2=0x7f2cb4100820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/3032024329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4100420 0x7f2cb4100820 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009900 tx=0x7f2ca402a480 comp rx=0 tx=0).stop 2024-09-19T09:18:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/3032024329 shutdown_connections 2024-09-19T09:18:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/3032024329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4101700 0x7f2cb4101bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/3032024329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cb4100d60 0x7f2cb41011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/3032024329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4100420 0x7f2cb4100820 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.986+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/3032024329 >> 172.21.15.46:0/3032024329 conn(0x7f2cb40fc190 msgr2=0x7f2cb40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/3032024329 shutdown_connections 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/3032024329 wait complete. 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 Processor -- start 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 -- start start 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cb4100420 0x7f2cb419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4100d60 0x7f2cb419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 0x7f2cb41a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410fa60 con 0x7f2cb4101700 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410f8e0 con 0x7f2cb4100d60 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.987+0000 7f2cb8f5f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb410fbe0 con 0x7f2cb4100420 2024-09-19T09:18:14.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 0x7f2cb41a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 0x7f2cb41a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52838/0 (socket says 172.21.15.46:52838) 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 -- 172.21.15.46:0/1467041852 learned_addr learned my addr 172.21.15.46:0/1467041852 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb1d9b640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4100d60 0x7f2cb419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb259c640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cb4100420 0x7f2cb419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 -- 172.21.15.46:0/1467041852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cb4100420 msgr2=0x7f2cb419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cb4100420 0x7f2cb419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 -- 172.21.15.46:0/1467041852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4100d60 msgr2=0x7f2cb419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4100d60 0x7f2cb419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 -- 172.21.15.46:0/1467041852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb41a1d30 con 0x7f2cb4101700 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb2d9d640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 0x7f2cb41a16c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00eaa0 tx=0x7f2cac00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac004d20 con 0x7f2cb4101700 2024-09-19T09:18:14.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cac005020 con 0x7f2cb4101700 2024-09-19T09:18:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb41a1fc0 con 0x7f2cb4101700 2024-09-19T09:18:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0116d0 con 0x7f2cb4101700 2024-09-19T09:18:14.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.988+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb41a2560 con 0x7f2cb4101700 2024-09-19T09:18:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.989+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb410b300 con 0x7f2cb4101700 2024-09-19T09:18:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.991+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2cac0051d0 con 0x7f2cb4101700 2024-09-19T09:18:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.991+0000 7f2ca37fe640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2c9c0a32d0 0x7f2c9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.991+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2cac0cfda0 con 0x7f2cb4101700 2024-09-19T09:18:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.991+0000 7f2cb259c640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2c9c0a32d0 0x7f2c9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.992+0000 7f2cb259c640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2c9c0a32d0 0x7f2c9c0a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4031610 tx=0x7f2ca4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:14.995+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cac016030 con 0x7f2cb4101700 2024-09-19T09:18:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.173+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2cb4062df0 con 0x7f2cb4101700 2024-09-19T09:18:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.174+0000 7f2ca37fe640 1 -- 172.21.15.46:0/1467041852 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22631 (secure 0 0 0) 0x7f2cac09cb70 con 0x7f2cb4101700 2024-09-19T09:18:15.175 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:15.175 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:17:30.696589+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2c9c0a32d0 msgr2=0x7f2c9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2c9c0a32d0 0x7f2c9c0a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4031610 tx=0x7f2ca4005a20 comp rx=0 tx=0).stop 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 msgr2=0x7f2cb41a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 0x7f2cb41a16c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00eaa0 tx=0x7f2cac00eea0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 shutdown_connections 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2c9c0a32d0 0x7f2c9c0a5790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cb4101700 0x7f2cb41a16c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cb4100d60 0x7f2cb419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 --2- 172.21.15.46:0/1467041852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cb4100420 0x7f2cb419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 >> 172.21.15.46:0/1467041852 conn(0x7f2cb40fc190 msgr2=0x7f2cb40fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 shutdown_connections 2024-09-19T09:18:15.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.176+0000 7f2cb8f5f640 1 -- 172.21.15.46:0/1467041852 wait complete. 2024-09-19T09:18:15.187 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:14 smithi046 ceph-mon[31203]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:18:15.187 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:14 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/608175417' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:18:15.188 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:11:45.380119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:16:20.505085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:16:22.965130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:18:15.189 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:18:15.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:14 smithi115 ceph-mon[35055]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:18:15.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:14 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/608175417' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:18:15.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:14 smithi099 ceph-mon[35256]: pgmap v336: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-19T09:18:15.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:14 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/608175417' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 -- 172.21.15.46:0/1109774302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 msgr2=0x7f63781072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 --2- 172.21.15.46:0/1109774302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f63781072d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6364009900 tx=0x7f636402a410 comp rx=0 tx=0).stop 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 -- 172.21.15.46:0/1109774302 shutdown_connections 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 --2- 172.21.15.46:0/1109774302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f63781072d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 --2- 172.21.15.46:0/1109774302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6378107810 0x7f6378109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 --2- 172.21.15.46:0/1109774302 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63781025b0 0x7f63781049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 -- 172.21.15.46:0/1109774302 >> 172.21.15.46:0/1109774302 conn(0x7f63780fc1b0 msgr2=0x7f63780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 -- 172.21.15.46:0/1109774302 shutdown_connections 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.294+0000 7f637eec3640 1 -- 172.21.15.46:0/1109774302 wait complete. 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 Processor -- start 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 -- start start 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63781025b0 0x7f6378197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f6378198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6378107810 0x7f637819f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f637810d830 con 0x7f6378104ee0 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f637810d6b0 con 0x7f63781025b0 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637eec3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f637810d9b0 con 0x7f6378107810 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f6377fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f6378198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f6377fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f6378198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52850/0 (socket says 172.21.15.46:52850) 2024-09-19T09:18:15.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f6377fff640 1 -- 172.21.15.46:0/3157713399 learned_addr learned my addr 172.21.15.46:0/3157713399 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637cc5f640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63781025b0 0x7f6378197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.295+0000 7f637d460640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6378107810 0x7f637819f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6377fff640 1 -- 172.21.15.46:0/3157713399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6378107810 msgr2=0x7f637819f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6377fff640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6378107810 0x7f637819f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6377fff640 1 -- 172.21.15.46:0/3157713399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63781025b0 msgr2=0x7f6378197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6377fff640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63781025b0 0x7f6378197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6377fff640 1 -- 172.21.15.46:0/3157713399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637819fb20 con 0x7f6378104ee0 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6377fff640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f6378198440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6364031610 tx=0x7f6364032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636403f030 con 0x7f6378104ee0 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6364003ce0 con 0x7f6378104ee0 2024-09-19T09:18:15.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f637819fdb0 con 0x7f6378104ee0 2024-09-19T09:18:15.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6364035070 con 0x7f6378104ee0 2024-09-19T09:18:15.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.296+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781a0240 con 0x7f6378104ee0 2024-09-19T09:18:15.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.297+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63780fdca0 con 0x7f6378104ee0 2024-09-19T09:18:15.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.298+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6364042030 con 0x7f6378104ee0 2024-09-19T09:18:15.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.299+0000 7f6375ffb640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f63680a3250 0x7f63680a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.299+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f63640f00c0 con 0x7f6378104ee0 2024-09-19T09:18:15.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.299+0000 7f637cc5f640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f63680a3250 0x7f63680a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.300+0000 7f637cc5f640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f63680a3250 0x7f63680a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f636c009bd0 tx=0x7f636c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.302+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63640bc760 con 0x7f6378104ee0 2024-09-19T09:18:15.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.481+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f637802da10 con 0x7f6378104ee0 2024-09-19T09:18:15.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.481+0000 7f6375ffb640 1 -- 172.21.15.46:0/3157713399 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f63640c0a60 con 0x7f6378104ee0 2024-09-19T09:18:15.482 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-19T09:18:15.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f63680a3250 msgr2=0x7f63680a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f63680a3250 0x7f63680a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f636c009bd0 tx=0x7f636c005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 msgr2=0x7f6378198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f6378198440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6364031610 tx=0x7f6364032ce0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 shutdown_connections 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f63680a3250 0x7f63680a5710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6378104ee0 0x7f6378198440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6378107810 0x7f637819f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 --2- 172.21.15.46:0/3157713399 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63781025b0 0x7f6378197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 >> 172.21.15.46:0/3157713399 conn(0x7f63780fc1b0 msgr2=0x7f6378102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 shutdown_connections 2024-09-19T09:18:15.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.484+0000 7f637eec3640 1 -- 172.21.15.46:0/3157713399 wait complete. 2024-09-19T09:18:15.496 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 -- 172.21.15.46:0/3263166110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1025c0 msgr2=0x7f3e1c108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 --2- 172.21.15.46:0/3263166110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1025c0 0x7f3e1c108e50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009ca0 tx=0x7f3e1402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 -- 172.21.15.46:0/3263166110 shutdown_connections 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 --2- 172.21.15.46:0/3263166110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c1025c0 0x7f3e1c108e50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 --2- 172.21.15.46:0/3263166110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c101c00 0x7f3e1c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 --2- 172.21.15.46:0/3263166110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c100a10 0x7f3e1c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 -- 172.21.15.46:0/3263166110 >> 172.21.15.46:0/3263166110 conn(0x7f3e1c0fc190 msgr2=0x7f3e1c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 -- 172.21.15.46:0/3263166110 shutdown_connections 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 -- 172.21.15.46:0/3263166110 wait complete. 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 Processor -- start 2024-09-19T09:18:15.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.602+0000 7f3e228f8640 1 -- start start 2024-09-19T09:18:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e228f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 0x7f3e1c1049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e228f8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c101c00 0x7f3e1c102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e228f8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c1025c0 0x7f3e1c103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e228f8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c10c6e0 con 0x7f3e1c100a10 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e228f8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c10c560 con 0x7f3e1c101c00 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e228f8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c10c860 con 0x7f3e1c1025c0 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 0x7f3e1c1049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 0x7f3e1c1049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52858/0 (socket says 172.21.15.46:52858) 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 -- 172.21.15.46:0/786859530 learned_addr learned my addr 172.21.15.46:0/786859530 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e20e95640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c1025c0 0x7f3e1c103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1b7fe640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c101c00 0x7f3e1c102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 -- 172.21.15.46:0/786859530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c1025c0 msgr2=0x7f3e1c103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c1025c0 0x7f3e1c103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 -- 172.21.15.46:0/786859530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c101c00 msgr2=0x7f3e1c102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c101c00 0x7f3e1c102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 -- 172.21.15.46:0/786859530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c103db0 con 0x7f3e1c100a10 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e1bfff640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 0x7f3e1c1049a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00d770 tx=0x7f3e0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.603+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c017070 con 0x7f3e1c100a10 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.604+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e0c009c30 con 0x7f3e1c100a10 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.604+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c1a1fb0 con 0x7f3e1c100a10 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.604+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c003dd0 con 0x7f3e1c100a10 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.604+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c1a23c0 con 0x7f3e1c100a10 2024-09-19T09:18:15.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.604+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c1a26b0 con 0x7f3e1c100a10 2024-09-19T09:18:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.606+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3e0c003fb0 con 0x7f3e1c100a10 2024-09-19T09:18:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.606+0000 7f3e197fa640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3e040a3250 0x7f3e040a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.606+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3e0c0cf120 con 0x7f3e1c100a10 2024-09-19T09:18:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.606+0000 7f3e1b7fe640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3e040a3250 0x7f3e040a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.607+0000 7f3e1b7fe640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3e040a3250 0x7f3e040a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c104710 tx=0x7f3e10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.610+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e0c009de0 con 0x7f3e1c100a10 2024-09-19T09:18:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.785+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3e1c1a2fe0 con 0x7f3e1c100a10 2024-09-19T09:18:15.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.786+0000 7f3e197fa640 1 -- 172.21.15.46:0/786859530 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f3e0c09b820 con 0x7f3e1c100a10 2024-09-19T09:18:15.786 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-09-19T09:18:15.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3e040a3250 msgr2=0x7f3e040a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3e040a3250 0x7f3e040a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c104710 tx=0x7f3e10005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 msgr2=0x7f3e1c1049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 0x7f3e1c1049a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00d770 tx=0x7f3e0c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 shutdown_connections 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3e040a3250 0x7f3e040a5710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e1c1025c0 0x7f3e1c103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3e1c101c00 0x7f3e1c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 --2- 172.21.15.46:0/786859530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e1c100a10 0x7f3e1c1049a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 >> 172.21.15.46:0/786859530 conn(0x7f3e1c0fc190 msgr2=0x7f3e1c06a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 shutdown_connections 2024-09-19T09:18:15.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.788+0000 7f3e228f8640 1 -- 172.21.15.46:0/786859530 wait complete. 2024-09-19T09:18:15.800 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:18:15.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 -- 172.21.15.46:0/1573517573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 msgr2=0x7f62181020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 --2- 172.21.15.46:0/1573517573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181020a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6200009900 tx=0x7f620002a410 comp rx=0 tx=0).stop 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 -- 172.21.15.46:0/1573517573 shutdown_connections 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 --2- 172.21.15.46:0/1573517573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181020a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 --2- 172.21.15.46:0/1573517573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62181025e0 0x7f6218108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 --2- 172.21.15.46:0/1573517573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 0x7f6218100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 -- 172.21.15.46:0/1573517573 >> 172.21.15.46:0/1573517573 conn(0x7f62180fc1b0 msgr2=0x7f62180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 -- 172.21.15.46:0/1573517573 shutdown_connections 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.907+0000 7f621e2ed640 1 -- 172.21.15.46:0/1573517573 wait complete. 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 Processor -- start 2024-09-19T09:18:15.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 -- start start 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 0x7f6218197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62181025e0 0x7f621819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f621810d860 con 0x7f6218101c20 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f621810d6e0 con 0x7f62181025e0 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621e2ed640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f621810d9e0 con 0x7f6218100a30 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52880/0 (socket says 172.21.15.46:52880) 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 -- 172.21.15.46:0/413561949 learned_addr learned my addr 172.21.15.46:0/413561949 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f621c88a640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62181025e0 0x7f621819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f6217fff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 0x7f6218197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 -- 172.21.15.46:0/413561949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 msgr2=0x7f6218197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 0x7f6218197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 -- 172.21.15.46:0/413561949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62181025e0 msgr2=0x7f621819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62181025e0 0x7f621819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f620ffff640 1 -- 172.21.15.46:0/413561949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621819fa80 con 0x7f6218101c20 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.908+0000 7f6217fff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 0x7f6218197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.909+0000 7f620ffff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181983a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6200031610 tx=0x7f6200032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.909+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f620003f030 con 0x7f6218101c20 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.909+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621819fd10 con 0x7f6218101c20 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.909+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6200003ce0 con 0x7f6218101c20 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.909+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200035070 con 0x7f6218101c20 2024-09-19T09:18:15.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.909+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62181a01b0 con 0x7f6218101c20 2024-09-19T09:18:15.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.910+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6218107e70 con 0x7f6218101c20 2024-09-19T09:18:15.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.911+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6200042030 con 0x7f6218101c20 2024-09-19T09:18:15.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.912+0000 7f6215ffb640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62040a3250 0x7f62040a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.912+0000 7f6217fff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62040a3250 0x7f62040a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.912+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f62000f03c0 con 0x7f6218101c20 2024-09-19T09:18:15.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.912+0000 7f6217fff640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62040a3250 0x7f62040a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62080058c0 tx=0x7f6208005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:15.915+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62000bd0b0 con 0x7f6218101c20 2024-09-19T09:18:16.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.097+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f621802d970 con 0x7f6218101c20 2024-09-19T09:18:16.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.097+0000 7f6215ffb640 1 -- 172.21.15.46:0/413561949 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f62000bc9b0 con 0x7f6218101c20 2024-09-19T09:18:16.098 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-09-19T09:18:16.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62040a3250 msgr2=0x7f62040a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62040a3250 0x7f62040a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62080058c0 tx=0x7f6208005ec0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 msgr2=0x7f62181983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181983a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6200031610 tx=0x7f6200032ce0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 shutdown_connections 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f62040a3250 0x7f62040a5710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6218101c20 0x7f62181983a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62181025e0 0x7f621819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 --2- 172.21.15.46:0/413561949 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6218100a30 0x7f6218197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 >> 172.21.15.46:0/413561949 conn(0x7f62180fc1b0 msgr2=0x7f6218105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 shutdown_connections 2024-09-19T09:18:16.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.100+0000 7f621e2ed640 1 -- 172.21.15.46:0/413561949 wait complete. 2024-09-19T09:18:16.110 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/608175417' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:18:16.110 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:15 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:18:16.110 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1467041852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:16.110 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3157713399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:18:16.111 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/786859530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:18:16.111 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T09:18:16.112 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:16.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/608175417' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:18:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:15 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:18:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1467041852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3157713399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:18:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/786859530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:18:16.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/608175417' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T09:18:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:15 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:18:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1467041852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3157713399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:18:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/786859530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:18:16.368 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:16.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.864+0000 7fb11c26c640 1 -- 172.21.15.46:0/1252253973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114101de0 msgr2=0x7fb1141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.864+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1252253973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114101de0 0x7fb1141021c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb110009900 tx=0x7fb11002a410 comp rx=0 tx=0).stop 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 -- 172.21.15.46:0/1252253973 shutdown_connections 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1252253973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb114106f10 0x7fb11410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1252253973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114102790 0x7fb1141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1252253973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114101de0 0x7fb1141021c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 -- 172.21.15.46:0/1252253973 >> 172.21.15.46:0/1252253973 conn(0x7fb1140fd8c0 msgr2=0x7fb1140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 -- 172.21.15.46:0/1252253973 shutdown_connections 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 -- 172.21.15.46:0/1252253973 wait complete. 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 Processor -- start 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 -- start start 2024-09-19T09:18:16.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114101de0 0x7fb1140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.865+0000 7fb11c26c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 0x7fb114074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11c26c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb114106f10 0x7fb114074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11c26c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb114111f70 con 0x7fb114102790 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11c26c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb114111df0 con 0x7fb114101de0 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11c26c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb1141120f0 con 0x7fb114106f10 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 0x7fb114074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 0x7fb114074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52894/0 (socket says 172.21.15.46:52894) 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 -- 172.21.15.46:0/1593678934 learned_addr learned my addr 172.21.15.46:0/1593678934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11a008640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114101de0 0x7fb1140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11a809640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb114106f10 0x7fb114074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 -- 172.21.15.46:0/1593678934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb114106f10 msgr2=0x7fb114074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb114106f10 0x7fb114074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 -- 172.21.15.46:0/1593678934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114101de0 msgr2=0x7fb1140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114101de0 0x7fb1140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 -- 172.21.15.46:0/1593678934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1141a68f0 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb119807640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 0x7fb114074a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb10400d950 tx=0x7fb10400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb104017070 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb104009c30 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1141a6be0 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb10400f6b0 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.866+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1141a7120 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.867+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1141021c0 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.869+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb1040109d0 con 0x7fb114102790 2024-09-19T09:18:16.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.869+0000 7fb10b7fe640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1000a3240 0x7fb1000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.869+0000 7fb11a008640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1000a3240 0x7fb1000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.869+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb1040cf480 con 0x7fb114102790 2024-09-19T09:18:16.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.870+0000 7fb11a008640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1000a3240 0x7fb1000a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb110009230 tx=0x7fb1100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:16.873+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb104009de0 con 0x7fb114102790 2024-09-19T09:18:17.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.085+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb114109b60 con 0x7fb114102790 2024-09-19T09:18:17.086 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:16 smithi046 ceph-mon[31203]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:18:17.086 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:16 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/413561949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:18:17.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.086+0000 7fb10b7fe640 1 -- 172.21.15.46:0/1593678934 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7fb10409bb80 con 0x7fb114102790 2024-09-19T09:18:17.087 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:17.087 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:18:17.087 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1000a3240 msgr2=0x7fb1000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1000a3240 0x7fb1000a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb110009230 tx=0x7fb1100058d0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 msgr2=0x7fb114074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 0x7fb114074a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb10400d950 tx=0x7fb10400de10 comp rx=0 tx=0).stop 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 shutdown_connections 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1000a3240 0x7fb1000a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb114102790 0x7fb114074a30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb114106f10 0x7fb114074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 --2- 172.21.15.46:0/1593678934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114101de0 0x7fb1140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 >> 172.21.15.46:0/1593678934 conn(0x7fb1140fd8c0 msgr2=0x7fb1140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 shutdown_connections 2024-09-19T09:18:17.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.088+0000 7fb11c26c640 1 -- 172.21.15.46:0/1593678934 wait complete. 2024-09-19T09:18:17.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:16 smithi115 ceph-mon[35055]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:18:17.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:16 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/413561949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:18:17.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:16 smithi099 ceph-mon[35256]: pgmap v337: 97 pgs: 97 active+clean; 645 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:18:17.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:16 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/413561949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:18:17.879 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T09:18:17.879 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T09:18:17.879 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:18:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 -- 172.21.15.46:0/3534381014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 msgr2=0x7fd8541072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3534381014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd8541072b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd844009900 tx=0x7fd84402a410 comp rx=0 tx=0).stop 2024-09-19T09:18:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 -- 172.21.15.46:0/3534381014 shutdown_connections 2024-09-19T09:18:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3534381014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd8541072b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3534381014 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8541077f0 0x7fd854109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3534381014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd854102590 0x7fd854104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 -- 172.21.15.46:0/3534381014 >> 172.21.15.46:0/3534381014 conn(0x7fd8540fc170 msgr2=0x7fd8540fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 -- 172.21.15.46:0/3534381014 shutdown_connections 2024-09-19T09:18:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.993+0000 7fd85c07b640 1 -- 172.21.15.46:0/3534381014 wait complete. 2024-09-19T09:18:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 Processor -- start 2024-09-19T09:18:17.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 -- start start 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd854102590 0x7fd85419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd85419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8541077f0 0x7fd8541a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410d7a0 con 0x7fd854104ec0 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410d620 con 0x7fd8541077f0 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85c07b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd85410d920 con 0x7fd854102590 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd859616640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd85419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd859616640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd85419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52906/0 (socket says 172.21.15.46:52906) 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd859616640 1 -- 172.21.15.46:0/3385856472 learned_addr learned my addr 172.21.15.46:0/3385856472 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd85a618640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8541077f0 0x7fd8541a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd859e17640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd854102590 0x7fd85419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.994+0000 7fd859616640 1 -- 172.21.15.46:0/3385856472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd854102590 msgr2=0x7fd85419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd859616640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd854102590 0x7fd85419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd859616640 1 -- 172.21.15.46:0/3385856472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8541077f0 msgr2=0x7fd8541a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd859616640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8541077f0 0x7fd8541a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd859616640 1 -- 172.21.15.46:0/3385856472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8541a1cc0 con 0x7fd854104ec0 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd859e17640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd854102590 0x7fd85419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd859616640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd85419a5e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd844031610 tx=0x7fd8440043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84403f030 con 0x7fd854104ec0 2024-09-19T09:18:17.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd844003ce0 con 0x7fd854104ec0 2024-09-19T09:18:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8541a1f50 con 0x7fd854104ec0 2024-09-19T09:18:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844035070 con 0x7fd854104ec0 2024-09-19T09:18:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.995+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8541a23c0 con 0x7fd854104ec0 2024-09-19T09:18:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.996+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd854109330 con 0x7fd854104ec0 2024-09-19T09:18:17.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.997+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd844042030 con 0x7fd854104ec0 2024-09-19T09:18:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.998+0000 7fd84affd640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8400a32d0 0x7fd8400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.998+0000 7fd859e17640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8400a32d0 0x7fd8400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.998+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd8440effa0 con 0x7fd854104ec0 2024-09-19T09:18:18.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:17.998+0000 7fd859e17640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8400a32d0 0x7fd8400a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd8500058c0 tx=0x7fd850005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.001+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8440bcd90 con 0x7fd854104ec0 2024-09-19T09:18:18.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.173+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd854062630 con 0x7fd8400a32d0 2024-09-19T09:18:18.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.180+0000 7fd84affd640 1 -- 172.21.15.46:0/3385856472 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258982 (secure 0 0 0) 0x7fd854062630 con 0x7fd8400a32d0 2024-09-19T09:18:18.183 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:18.185 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:18:18.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8400a32d0 msgr2=0x7fd8400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8400a32d0 0x7fd8400a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd8500058c0 tx=0x7fd850005850 comp rx=0 tx=0).stop 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 msgr2=0x7fd85419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd85419a5e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd844031610 tx=0x7fd8440043b0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 shutdown_connections 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8400a32d0 0x7fd8400a5790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd854104ec0 0x7fd85419a5e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8541077f0 0x7fd8541a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 --2- 172.21.15.46:0/3385856472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd854102590 0x7fd85419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 >> 172.21.15.46:0/3385856472 conn(0x7fd8540fc170 msgr2=0x7fd854101d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 shutdown_connections 2024-09-19T09:18:18.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.183+0000 7fd85c07b640 1 -- 172.21.15.46:0/3385856472 wait complete. 2024-09-19T09:18:18.193 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:17 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1593678934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:18.194 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T09:18:16.982108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664977,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1176,"num_read_kb":719,"num_write":446,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348204,"kb_used_data":11436,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593620,"statfs":{"total":1151940427776,"available":1151583866880,"internally_reserved":0,"allocated":11710464,"data_stored":7352895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":82,"num_write":8,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003031"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981549+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:17:58.981549+0000","last_peered":"2024-09-19T09:17:58.981549+0000","last_clean":"2024-09-19T09:17:58.981549+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:17:58.981549+0000","last_undegraded":"2024-09-19T09:17:58.981549+0000","last_fullsized":"2024-09-19T09:17:58.981549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.978712+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:17:58.978712+0000","last_peered":"2024-09-19T09:17:58.978712+0000","last_clean":"2024-09-19T09:17:58.978712+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:17:58.978712+0000","last_undegraded":"2024-09-19T09:17:58.978712+0000","last_fullsized":"2024-09-19T09:17:58.978712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980087+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:17:58.980087+0000","last_peered":"2024-09-19T09:17:58.980087+0000","last_clean":"2024-09-19T09:17:58.980087+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.980087+0000","last_undegraded":"2024-09-19T09:17:58.980087+0000","last_fullsized":"2024-09-19T09:17:58.980087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963356+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:17:58.963356+0000","last_peered":"2024-09-19T09:17:58.963356+0000","last_clean":"2024-09-19T09:17:58.963356+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:17:58.963356+0000","last_undegraded":"2024-09-19T09:17:58.963356+0000","last_fullsized":"2024-09-19T09:17:58.963356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956263+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:17:58.956263+0000","last_peered":"2024-09-19T09:17:58.956263+0000","last_clean":"2024-09-19T09:17:58.956263+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:17:58.956263+0000","last_undegraded":"2024-09-19T09:17:58.956263+0000","last_fullsized":"2024-09-19T09:17:58.956263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970384+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:17:58.970384+0000","last_peered":"2024-09-19T09:17:58.970384+0000","last_clean":"2024-09-19T09:17:58.970384+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:17:58.970384+0000","last_undegraded":"2024-09-19T09:17:58.970384+0000","last_fullsized":"2024-09-19T09:17:58.970384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968788+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:17:58.968788+0000","last_peered":"2024-09-19T09:17:58.968788+0000","last_clean":"2024-09-19T09:17:58.968788+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:17:58.968788+0000","last_undegraded":"2024-09-19T09:17:58.968788+0000","last_fullsized":"2024-09-19T09:17:58.968788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969443+0000","last_change":"2024-09-19T09:17:30.741930+0000","last_active":"2024-09-19T09:17:58.969443+0000","last_peered":"2024-09-19T09:17:58.969443+0000","last_clean":"2024-09-19T09:17:58.969443+0000","last_became_active":"2024-09-19T09:17:30.741704+0000","last_became_peered":"2024-09-19T09:17:30.741704+0000","last_unstale":"2024-09-19T09:17:58.969443+0000","last_undegraded":"2024-09-19T09:17:58.969443+0000","last_fullsized":"2024-09-19T09:17:58.969443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:05.913992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981366+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:17:58.981366+0000","last_peered":"2024-09-19T09:17:58.981366+0000","last_clean":"2024-09-19T09:17:58.981366+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:17:58.981366+0000","last_undegraded":"2024-09-19T09:17:58.981366+0000","last_fullsized":"2024-09-19T09:17:58.981366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968579+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:17:58.968579+0000","last_peered":"2024-09-19T09:17:58.968579+0000","last_clean":"2024-09-19T09:17:58.968579+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:17:58.968579+0000","last_undegraded":"2024-09-19T09:17:58.968579+0000","last_fullsized":"2024-09-19T09:17:58.968579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980413+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:17:58.980413+0000","last_peered":"2024-09-19T09:17:58.980413+0000","last_clean":"2024-09-19T09:17:58.980413+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:17:58.980413+0000","last_undegraded":"2024-09-19T09:17:58.980413+0000","last_fullsized":"2024-09-19T09:17:58.980413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961145+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:17:58.961145+0000","last_peered":"2024-09-19T09:17:58.961145+0000","last_clean":"2024-09-19T09:17:58.961145+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:17:58.961145+0000","last_undegraded":"2024-09-19T09:17:58.961145+0000","last_fullsized":"2024-09-19T09:17:58.961145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967545+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:17:58.967545+0000","last_peered":"2024-09-19T09:17:58.967545+0000","last_clean":"2024-09-19T09:17:58.967545+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:17:58.967545+0000","last_undegraded":"2024-09-19T09:17:58.967545+0000","last_fullsized":"2024-09-19T09:17:58.967545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977708+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:17:58.977708+0000","last_peered":"2024-09-19T09:17:58.977708+0000","last_clean":"2024-09-19T09:17:58.977708+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:17:58.977708+0000","last_undegraded":"2024-09-19T09:17:58.977708+0000","last_fullsized":"2024-09-19T09:17:58.977708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979172+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:17:58.979172+0000","last_peered":"2024-09-19T09:17:58.979172+0000","last_clean":"2024-09-19T09:17:58.979172+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:17:58.979172+0000","last_undegraded":"2024-09-19T09:17:58.979172+0000","last_fullsized":"2024-09-19T09:17:58.979172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981760+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:17:58.981760+0000","last_peered":"2024-09-19T09:17:58.981760+0000","last_clean":"2024-09-19T09:17:58.981760+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:17:58.981760+0000","last_undegraded":"2024-09-19T09:17:58.981760+0000","last_fullsized":"2024-09-19T09:17:58.981760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981803+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:17:58.981803+0000","last_peered":"2024-09-19T09:17:58.981803+0000","last_clean":"2024-09-19T09:17:58.981803+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:17:58.981803+0000","last_undegraded":"2024-09-19T09:17:58.981803+0000","last_fullsized":"2024-09-19T09:17:58.981803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967160+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:17:58.967160+0000","last_peered":"2024-09-19T09:17:58.967160+0000","last_clean":"2024-09-19T09:17:58.967160+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:17:58.967160+0000","last_undegraded":"2024-09-19T09:17:58.967160+0000","last_fullsized":"2024-09-19T09:17:58.967160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967152+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:17:58.967152+0000","last_peered":"2024-09-19T09:17:58.967152+0000","last_clean":"2024-09-19T09:17:58.967152+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:17:58.967152+0000","last_undegraded":"2024-09-19T09:17:58.967152+0000","last_fullsized":"2024-09-19T09:17:58.967152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970437+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:17:58.970437+0000","last_peered":"2024-09-19T09:17:58.970437+0000","last_clean":"2024-09-19T09:17:58.970437+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:17:58.970437+0000","last_undegraded":"2024-09-19T09:17:58.970437+0000","last_fullsized":"2024-09-19T09:17:58.970437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980591+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:17:58.980591+0000","last_peered":"2024-09-19T09:17:58.980591+0000","last_clean":"2024-09-19T09:17:58.980591+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:17:58.980591+0000","last_undegraded":"2024-09-19T09:17:58.980591+0000","last_fullsized":"2024-09-19T09:17:58.980591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981630+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:17:58.981630+0000","last_peered":"2024-09-19T09:17:58.981630+0000","last_clean":"2024-09-19T09:17:58.981630+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:17:58.981630+0000","last_undegraded":"2024-09-19T09:17:58.981630+0000","last_fullsized":"2024-09-19T09:17:58.981630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968614+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:17:58.968614+0000","last_peered":"2024-09-19T09:17:58.968614+0000","last_clean":"2024-09-19T09:17:58.968614+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:17:58.968614+0000","last_undegraded":"2024-09-19T09:17:58.968614+0000","last_fullsized":"2024-09-19T09:17:58.968614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961162+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:17:58.961162+0000","last_peered":"2024-09-19T09:17:58.961162+0000","last_clean":"2024-09-19T09:17:58.961162+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:17:58.961162+0000","last_undegraded":"2024-09-19T09:17:58.961162+0000","last_fullsized":"2024-09-19T09:17:58.961162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968911+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:17:58.968911+0000","last_peered":"2024-09-19T09:17:58.968911+0000","last_clean":"2024-09-19T09:17:58.968911+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:17:58.968911+0000","last_undegraded":"2024-09-19T09:17:58.968911+0000","last_fullsized":"2024-09-19T09:17:58.968911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981030+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:17:58.981030+0000","last_peered":"2024-09-19T09:17:58.981030+0000","last_clean":"2024-09-19T09:17:58.981030+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:17:58.981030+0000","last_undegraded":"2024-09-19T09:17:58.981030+0000","last_fullsized":"2024-09-19T09:17:58.981030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969254+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:17:58.969254+0000","last_peered":"2024-09-19T09:17:58.969254+0000","last_clean":"2024-09-19T09:17:58.969254+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:17:58.969254+0000","last_undegraded":"2024-09-19T09:17:58.969254+0000","last_fullsized":"2024-09-19T09:17:58.969254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979843+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:17:58.979843+0000","last_peered":"2024-09-19T09:17:58.979843+0000","last_clean":"2024-09-19T09:17:58.979843+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:17:58.979843+0000","last_undegraded":"2024-09-19T09:17:58.979843+0000","last_fullsized":"2024-09-19T09:17:58.979843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977631+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:17:58.977631+0000","last_peered":"2024-09-19T09:17:58.977631+0000","last_clean":"2024-09-19T09:17:58.977631+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:17:58.977631+0000","last_undegraded":"2024-09-19T09:17:58.977631+0000","last_fullsized":"2024-09-19T09:17:58.977631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980454+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:17:58.980454+0000","last_peered":"2024-09-19T09:17:58.980454+0000","last_clean":"2024-09-19T09:17:58.980454+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:17:58.980454+0000","last_undegraded":"2024-09-19T09:17:58.980454+0000","last_fullsized":"2024-09-19T09:17:58.980454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966717+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:17:58.966717+0000","last_peered":"2024-09-19T09:17:58.966717+0000","last_clean":"2024-09-19T09:17:58.966717+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:17:58.966717+0000","last_undegraded":"2024-09-19T09:17:58.966717+0000","last_fullsized":"2024-09-19T09:17:58.966717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970020+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:17:58.970020+0000","last_peered":"2024-09-19T09:17:58.970020+0000","last_clean":"2024-09-19T09:17:58.970020+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:17:58.970020+0000","last_undegraded":"2024-09-19T09:17:58.970020+0000","last_fullsized":"2024-09-19T09:17:58.970020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.957135+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:17:58.957135+0000","last_peered":"2024-09-19T09:17:58.957135+0000","last_clean":"2024-09-19T09:17:58.957135+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:17:58.957135+0000","last_undegraded":"2024-09-19T09:17:58.957135+0000","last_fullsized":"2024-09-19T09:17:58.957135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.184190+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:18:13.184190+0000","last_peered":"2024-09-19T09:18:13.184190+0000","last_clean":"2024-09-19T09:18:13.184190+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:18:13.184190+0000","last_undegraded":"2024-09-19T09:18:13.184190+0000","last_fullsized":"2024-09-19T09:18:13.184190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.965388+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:17:58.965388+0000","last_peered":"2024-09-19T09:17:58.965388+0000","last_clean":"2024-09-19T09:17:58.965388+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:17:58.965388+0000","last_undegraded":"2024-09-19T09:17:58.965388+0000","last_fullsized":"2024-09-19T09:17:58.965388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.740826+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:17:30.740826+0000","last_peered":"2024-09-19T09:17:30.740826+0000","last_clean":"2024-09-19T09:17:30.740826+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:17:30.740826+0000","last_undegraded":"2024-09-19T09:17:30.740826+0000","last_fullsized":"2024-09-19T09:17:30.740826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.699545+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:17:30.699545+0000","last_peered":"2024-09-19T09:17:30.699545+0000","last_clean":"2024-09-19T09:17:30.699545+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:17:30.699545+0000","last_undegraded":"2024-09-19T09:17:30.699545+0000","last_fullsized":"2024-09-19T09:17:30.699545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970622+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:17:58.970622+0000","last_peered":"2024-09-19T09:17:58.970622+0000","last_clean":"2024-09-19T09:17:58.970622+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:17:58.970622+0000","last_undegraded":"2024-09-19T09:17:58.970622+0000","last_fullsized":"2024-09-19T09:17:58.970622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701519+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:17:30.701519+0000","last_peered":"2024-09-19T09:17:30.701519+0000","last_clean":"2024-09-19T09:17:30.701519+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:17:30.701519+0000","last_undegraded":"2024-09-19T09:17:30.701519+0000","last_fullsized":"2024-09-19T09:17:30.701519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970260+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:17:58.970260+0000","last_peered":"2024-09-19T09:17:58.970260+0000","last_clean":"2024-09-19T09:17:58.970260+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:17:58.970260+0000","last_undegraded":"2024-09-19T09:17:58.970260+0000","last_fullsized":"2024-09-19T09:17:58.970260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'6","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:16.187198+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:18:16.187198+0000","last_peered":"2024-09-19T09:18:16.187198+0000","last_clean":"2024-09-19T09:18:16.187198+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:18:16.187198+0000","last_undegraded":"2024-09-19T09:18:16.187198+0000","last_fullsized":"2024-09-19T09:18:16.187198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.976566+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:17:58.976566+0000","last_peered":"2024-09-19T09:17:58.976566+0000","last_clean":"2024-09-19T09:17:58.976566+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:17:58.976566+0000","last_undegraded":"2024-09-19T09:17:58.976566+0000","last_fullsized":"2024-09-19T09:17:58.976566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701780+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:17:30.701780+0000","last_peered":"2024-09-19T09:17:30.701780+0000","last_clean":"2024-09-19T09:17:30.701780+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:17:30.701780+0000","last_undegraded":"2024-09-19T09:17:30.701780+0000","last_fullsized":"2024-09-19T09:17:30.701780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979267+0000","last_change":"2024-09-19T09:17:30.711986+0000","last_active":"2024-09-19T09:17:58.979267+0000","last_peered":"2024-09-19T09:17:58.979267+0000","last_clean":"2024-09-19T09:17:58.979267+0000","last_became_active":"2024-09-19T09:17:30.711751+0000","last_became_peered":"2024-09-19T09:17:30.711751+0000","last_unstale":"2024-09-19T09:17:58.979267+0000","last_undegraded":"2024-09-19T09:17:58.979267+0000","last_fullsized":"2024-09-19T09:17:58.979267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:18.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701396+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:17:30.701396+0000","last_peered":"2024-09-19T09:17:30.701396+0000","last_clean":"2024-09-19T09:17:30.701396+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:17:30.701396+0000","last_undegraded":"2024-09-19T09:17:30.701396+0000","last_fullsized":"2024-09-19T09:17:30.701396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979992+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:17:58.979992+0000","last_peered":"2024-09-19T09:17:58.979992+0000","last_clean":"2024-09-19T09:17:58.979992+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:17:58.979992+0000","last_undegraded":"2024-09-19T09:17:58.979992+0000","last_fullsized":"2024-09-19T09:17:58.979992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:16.187739+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:18:16.187739+0000","last_peered":"2024-09-19T09:18:16.187739+0000","last_clean":"2024-09-19T09:18:16.187739+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:18:16.187739+0000","last_undegraded":"2024-09-19T09:18:16.187739+0000","last_fullsized":"2024-09-19T09:18:16.187739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66043,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":214,"num_read_kb":171,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967581+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:17:58.967581+0000","last_peered":"2024-09-19T09:17:58.967581+0000","last_clean":"2024-09-19T09:17:58.967581+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:17:58.967581+0000","last_undegraded":"2024-09-19T09:17:58.967581+0000","last_fullsized":"2024-09-19T09:17:58.967581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701982+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:17:30.701982+0000","last_peered":"2024-09-19T09:17:30.701982+0000","last_clean":"2024-09-19T09:17:30.701982+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:17:30.701982+0000","last_undegraded":"2024-09-19T09:17:30.701982+0000","last_fullsized":"2024-09-19T09:17:30.701982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956062+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:17:58.956062+0000","last_peered":"2024-09-19T09:17:58.956062+0000","last_clean":"2024-09-19T09:17:58.956062+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:17:58.956062+0000","last_undegraded":"2024-09-19T09:17:58.956062+0000","last_fullsized":"2024-09-19T09:17:58.956062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701288+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:17:30.701288+0000","last_peered":"2024-09-19T09:17:30.701288+0000","last_clean":"2024-09-19T09:17:30.701288+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:17:30.701288+0000","last_undegraded":"2024-09-19T09:17:30.701288+0000","last_fullsized":"2024-09-19T09:17:30.701288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.971893+0000","last_change":"2024-09-19T09:17:30.706308+0000","last_active":"2024-09-19T09:17:58.971893+0000","last_peered":"2024-09-19T09:17:58.971893+0000","last_clean":"2024-09-19T09:17:58.971893+0000","last_became_active":"2024-09-19T09:17:30.705841+0000","last_became_peered":"2024-09-19T09:17:30.705841+0000","last_unstale":"2024-09-19T09:17:58.971893+0000","last_undegraded":"2024-09-19T09:17:58.971893+0000","last_fullsized":"2024-09-19T09:17:58.971893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.183394+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:18:13.183394+0000","last_peered":"2024-09-19T09:18:13.183394+0000","last_clean":"2024-09-19T09:18:13.183394+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:18:13.183394+0000","last_undegraded":"2024-09-19T09:18:13.183394+0000","last_fullsized":"2024-09-19T09:18:13.183394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969899+0000","last_change":"2024-09-19T09:17:30.742259+0000","last_active":"2024-09-19T09:17:58.969899+0000","last_peered":"2024-09-19T09:17:58.969899+0000","last_clean":"2024-09-19T09:17:58.969899+0000","last_became_active":"2024-09-19T09:17:30.741880+0000","last_became_peered":"2024-09-19T09:17:30.741880+0000","last_unstale":"2024-09-19T09:17:58.969899+0000","last_undegraded":"2024-09-19T09:17:58.969899+0000","last_fullsized":"2024-09-19T09:17:58.969899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:33.736292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706370+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:17:30.706370+0000","last_peered":"2024-09-19T09:17:30.706370+0000","last_clean":"2024-09-19T09:17:30.706370+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:17:30.706370+0000","last_undegraded":"2024-09-19T09:17:30.706370+0000","last_fullsized":"2024-09-19T09:17:30.706370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.974073+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:17:58.974073+0000","last_peered":"2024-09-19T09:17:58.974073+0000","last_clean":"2024-09-19T09:17:58.974073+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:17:58.974073+0000","last_undegraded":"2024-09-19T09:17:58.974073+0000","last_fullsized":"2024-09-19T09:17:58.974073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.716217+0000","last_change":"2024-09-19T09:17:30.715839+0000","last_active":"2024-09-19T09:17:30.716217+0000","last_peered":"2024-09-19T09:17:30.716217+0000","last_clean":"2024-09-19T09:17:30.716217+0000","last_became_active":"2024-09-19T09:17:30.707470+0000","last_became_peered":"2024-09-19T09:17:30.707470+0000","last_unstale":"2024-09-19T09:17:30.716217+0000","last_undegraded":"2024-09-19T09:17:30.716217+0000","last_fullsized":"2024-09-19T09:17:30.716217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.090063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969162+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:17:58.969162+0000","last_peered":"2024-09-19T09:17:58.969162+0000","last_clean":"2024-09-19T09:17:58.969162+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:17:58.969162+0000","last_undegraded":"2024-09-19T09:17:58.969162+0000","last_fullsized":"2024-09-19T09:17:58.969162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.719006+0000","last_change":"2024-09-19T09:17:30.719006+0000","last_active":"2024-09-19T09:17:30.719006+0000","last_peered":"2024-09-19T09:17:30.719006+0000","last_clean":"2024-09-19T09:17:30.719006+0000","last_became_active":"2024-09-19T09:17:30.709645+0000","last_became_peered":"2024-09-19T09:17:30.709645+0000","last_unstale":"2024-09-19T09:17:30.719006+0000","last_undegraded":"2024-09-19T09:17:30.719006+0000","last_fullsized":"2024-09-19T09:17:30.719006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:41.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977582+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:17:58.977582+0000","last_peered":"2024-09-19T09:17:58.977582+0000","last_clean":"2024-09-19T09:17:58.977582+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:17:58.977582+0000","last_undegraded":"2024-09-19T09:17:58.977582+0000","last_fullsized":"2024-09-19T09:17:58.977582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701511+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:17:30.701511+0000","last_peered":"2024-09-19T09:17:30.701511+0000","last_clean":"2024-09-19T09:17:30.701511+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:17:30.701511+0000","last_undegraded":"2024-09-19T09:17:30.701511+0000","last_fullsized":"2024-09-19T09:17:30.701511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968174+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:17:58.968174+0000","last_peered":"2024-09-19T09:17:58.968174+0000","last_clean":"2024-09-19T09:17:58.968174+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:17:58.968174+0000","last_undegraded":"2024-09-19T09:17:58.968174+0000","last_fullsized":"2024-09-19T09:17:58.968174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.183679+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:18:13.183679+0000","last_peered":"2024-09-19T09:18:13.183679+0000","last_clean":"2024-09-19T09:18:13.183679+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:18:13.183679+0000","last_undegraded":"2024-09-19T09:18:13.183679+0000","last_fullsized":"2024-09-19T09:18:13.183679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980166+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:17:58.980166+0000","last_peered":"2024-09-19T09:17:58.980166+0000","last_clean":"2024-09-19T09:17:58.980166+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:17:58.980166+0000","last_undegraded":"2024-09-19T09:17:58.980166+0000","last_fullsized":"2024-09-19T09:17:58.980166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702339+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:17:30.702339+0000","last_peered":"2024-09-19T09:17:30.702339+0000","last_clean":"2024-09-19T09:17:30.702339+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:17:30.702339+0000","last_undegraded":"2024-09-19T09:17:30.702339+0000","last_fullsized":"2024-09-19T09:17:30.702339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.707109+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:17:30.707109+0000","last_peered":"2024-09-19T09:17:30.707109+0000","last_clean":"2024-09-19T09:17:30.707109+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:17:30.707109+0000","last_undegraded":"2024-09-19T09:17:30.707109+0000","last_fullsized":"2024-09-19T09:17:30.707109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977434+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:17:58.977434+0000","last_peered":"2024-09-19T09:17:58.977434+0000","last_clean":"2024-09-19T09:17:58.977434+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:17:58.977434+0000","last_undegraded":"2024-09-19T09:17:58.977434+0000","last_fullsized":"2024-09-19T09:17:58.977434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702100+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:17:30.702100+0000","last_peered":"2024-09-19T09:17:30.702100+0000","last_clean":"2024-09-19T09:17:30.702100+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:17:30.702100+0000","last_undegraded":"2024-09-19T09:17:30.702100+0000","last_fullsized":"2024-09-19T09:17:30.702100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961956+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:17:58.961956+0000","last_peered":"2024-09-19T09:17:58.961956+0000","last_clean":"2024-09-19T09:17:58.961956+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.961956+0000","last_undegraded":"2024-09-19T09:17:58.961956+0000","last_fullsized":"2024-09-19T09:17:58.961956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:14.184089+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:18:14.184089+0000","last_peered":"2024-09-19T09:18:14.184089+0000","last_clean":"2024-09-19T09:18:14.184089+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:18:14.184089+0000","last_undegraded":"2024-09-19T09:18:14.184089+0000","last_fullsized":"2024-09-19T09:18:14.184089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963278+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:17:58.963278+0000","last_peered":"2024-09-19T09:17:58.963278+0000","last_clean":"2024-09-19T09:17:58.963278+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:17:58.963278+0000","last_undegraded":"2024-09-19T09:17:58.963278+0000","last_fullsized":"2024-09-19T09:17:58.963278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'8","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:14.185454+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:18:14.185454+0000","last_peered":"2024-09-19T09:18:14.185454+0000","last_clean":"2024-09-19T09:18:14.185454+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:18:14.185454+0000","last_undegraded":"2024-09-19T09:18:14.185454+0000","last_fullsized":"2024-09-19T09:18:14.185454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967435+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:17:58.967435+0000","last_peered":"2024-09-19T09:17:58.967435+0000","last_clean":"2024-09-19T09:17:58.967435+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:17:58.967435+0000","last_undegraded":"2024-09-19T09:17:58.967435+0000","last_fullsized":"2024-09-19T09:17:58.967435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.704404+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:17:30.704404+0000","last_peered":"2024-09-19T09:17:30.704404+0000","last_clean":"2024-09-19T09:17:30.704404+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:17:30.704404+0000","last_undegraded":"2024-09-19T09:17:30.704404+0000","last_fullsized":"2024-09-19T09:17:30.704404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970687+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:17:58.970687+0000","last_peered":"2024-09-19T09:17:58.970687+0000","last_clean":"2024-09-19T09:17:58.970687+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:17:58.970687+0000","last_undegraded":"2024-09-19T09:17:58.970687+0000","last_fullsized":"2024-09-19T09:17:58.970687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706919+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:17:30.706919+0000","last_peered":"2024-09-19T09:17:30.706919+0000","last_clean":"2024-09-19T09:17:30.706919+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:17:30.706919+0000","last_undegraded":"2024-09-19T09:17:30.706919+0000","last_fullsized":"2024-09-19T09:17:30.706919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.962302+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:17:58.962302+0000","last_peered":"2024-09-19T09:17:58.962302+0000","last_clean":"2024-09-19T09:17:58.962302+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:17:58.962302+0000","last_undegraded":"2024-09-19T09:17:58.962302+0000","last_fullsized":"2024-09-19T09:17:58.962302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:59.005140+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:17:59.005140+0000","last_peered":"2024-09-19T09:17:59.005140+0000","last_clean":"2024-09-19T09:17:59.005140+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:17:59.005140+0000","last_undegraded":"2024-09-19T09:17:59.005140+0000","last_fullsized":"2024-09-19T09:17:59.005140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970983+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:17:58.970983+0000","last_peered":"2024-09-19T09:17:58.970983+0000","last_clean":"2024-09-19T09:17:58.970983+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:17:58.970983+0000","last_undegraded":"2024-09-19T09:17:58.970983+0000","last_fullsized":"2024-09-19T09:17:58.970983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706710+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:17:30.706710+0000","last_peered":"2024-09-19T09:17:30.706710+0000","last_clean":"2024-09-19T09:17:30.706710+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:17:30.706710+0000","last_undegraded":"2024-09-19T09:17:30.706710+0000","last_fullsized":"2024-09-19T09:17:30.706710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979125+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:17:58.979125+0000","last_peered":"2024-09-19T09:17:58.979125+0000","last_clean":"2024-09-19T09:17:58.979125+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:17:58.979125+0000","last_undegraded":"2024-09-19T09:17:58.979125+0000","last_fullsized":"2024-09-19T09:17:58.979125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.700552+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:17:30.700552+0000","last_peered":"2024-09-19T09:17:30.700552+0000","last_clean":"2024-09-19T09:17:30.700552+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:17:30.700552+0000","last_undegraded":"2024-09-19T09:17:30.700552+0000","last_fullsized":"2024-09-19T09:17:30.700552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.933118+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:17:58.933118+0000","last_peered":"2024-09-19T09:17:58.933118+0000","last_clean":"2024-09-19T09:17:58.933118+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:17:58.933118+0000","last_undegraded":"2024-09-19T09:17:58.933118+0000","last_fullsized":"2024-09-19T09:17:58.933118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702269+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:17:30.702269+0000","last_peered":"2024-09-19T09:17:30.702269+0000","last_clean":"2024-09-19T09:17:30.702269+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:17:30.702269+0000","last_undegraded":"2024-09-19T09:17:30.702269+0000","last_fullsized":"2024-09-19T09:17:30.702269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975139+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:17:58.975139+0000","last_peered":"2024-09-19T09:17:58.975139+0000","last_clean":"2024-09-19T09:17:58.975139+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:17:58.975139+0000","last_undegraded":"2024-09-19T09:17:58.975139+0000","last_fullsized":"2024-09-19T09:17:58.975139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.722791+0000","last_change":"2024-09-19T09:17:30.722376+0000","last_active":"2024-09-19T09:17:30.722791+0000","last_peered":"2024-09-19T09:17:30.722791+0000","last_clean":"2024-09-19T09:17:30.722791+0000","last_became_active":"2024-09-19T09:17:30.709277+0000","last_became_peered":"2024-09-19T09:17:30.709277+0000","last_unstale":"2024-09-19T09:17:30.722791+0000","last_undegraded":"2024-09-19T09:17:30.722791+0000","last_fullsized":"2024-09-19T09:17:30.722791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.341264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980029+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:17:58.980029+0000","last_peered":"2024-09-19T09:17:58.980029+0000","last_clean":"2024-09-19T09:17:58.980029+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:17:58.980029+0000","last_undegraded":"2024-09-19T09:17:58.980029+0000","last_fullsized":"2024-09-19T09:17:58.980029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706536+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:17:30.706536+0000","last_peered":"2024-09-19T09:17:30.706536+0000","last_clean":"2024-09-19T09:17:30.706536+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:17:30.706536+0000","last_undegraded":"2024-09-19T09:17:30.706536+0000","last_fullsized":"2024-09-19T09:17:30.706536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979969+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:17:58.979969+0000","last_peered":"2024-09-19T09:17:58.979969+0000","last_clean":"2024-09-19T09:17:58.979969+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:17:58.979969+0000","last_undegraded":"2024-09-19T09:17:58.979969+0000","last_fullsized":"2024-09-19T09:17:58.979969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980085+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:17:58.980085+0000","last_peered":"2024-09-19T09:17:58.980085+0000","last_clean":"2024-09-19T09:17:58.980085+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:17:58.980085+0000","last_undegraded":"2024-09-19T09:17:58.980085+0000","last_fullsized":"2024-09-19T09:17:58.980085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706809+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:17:30.706809+0000","last_peered":"2024-09-19T09:17:30.706809+0000","last_clean":"2024-09-19T09:17:30.706809+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:17:30.706809+0000","last_undegraded":"2024-09-19T09:17:30.706809+0000","last_fullsized":"2024-09-19T09:17:30.706809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975767+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:17:58.975767+0000","last_peered":"2024-09-19T09:17:58.975767+0000","last_clean":"2024-09-19T09:17:58.975767+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:17:58.975767+0000","last_undegraded":"2024-09-19T09:17:58.975767+0000","last_fullsized":"2024-09-19T09:17:58.975767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'13","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706829+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:17:30.706829+0000","last_peered":"2024-09-19T09:17:30.706829+0000","last_clean":"2024-09-19T09:17:30.706829+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:17:30.706829+0000","last_undegraded":"2024-09-19T09:17:30.706829+0000","last_fullsized":"2024-09-19T09:17:30.706829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981137+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:17:58.981137+0000","last_peered":"2024-09-19T09:17:58.981137+0000","last_clean":"2024-09-19T09:17:58.981137+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:17:58.981137+0000","last_undegraded":"2024-09-19T09:17:58.981137+0000","last_fullsized":"2024-09-19T09:17:58.981137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702907+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:17:30.702907+0000","last_peered":"2024-09-19T09:17:30.702907+0000","last_clean":"2024-09-19T09:17:30.702907+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:17:30.702907+0000","last_undegraded":"2024-09-19T09:17:30.702907+0000","last_fullsized":"2024-09-19T09:17:30.702907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966920+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:17:58.966920+0000","last_peered":"2024-09-19T09:17:58.966920+0000","last_clean":"2024-09-19T09:17:58.966920+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:17:58.966920+0000","last_undegraded":"2024-09-19T09:17:58.966920+0000","last_fullsized":"2024-09-19T09:17:58.966920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:15.185984+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:18:15.185984+0000","last_peered":"2024-09-19T09:18:15.185984+0000","last_clean":"2024-09-19T09:18:15.185984+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:18:15.185984+0000","last_undegraded":"2024-09-19T09:18:15.185984+0000","last_fullsized":"2024-09-19T09:18:15.185984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74375,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1050,"num_read_kb":610,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":448245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1104761,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":447975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":1041500,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":448178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1040336,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":447197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":515580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":515134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:18:18.200 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:18:18.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:17 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1593678934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:18.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:17 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1593678934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 -- 172.21.15.46:0/843463144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0100a30 msgr2=0x7f13e0100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 --2- 172.21.15.46:0/843463144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0100a30 0x7f13e0100e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009900 tx=0x7f13d002a410 comp rx=0 tx=0).stop 2024-09-19T09:18:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 -- 172.21.15.46:0/843463144 shutdown_connections 2024-09-19T09:18:18.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 --2- 172.21.15.46:0/843463144 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e01025e0 0x7f13e0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 --2- 172.21.15.46:0/843463144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13e0101c20 0x7f13e01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 --2- 172.21.15.46:0/843463144 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0100a30 0x7f13e0100e30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 -- 172.21.15.46:0/843463144 >> 172.21.15.46:0/843463144 conn(0x7f13e00fc1b0 msgr2=0x7f13e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 -- 172.21.15.46:0/843463144 shutdown_connections 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.338+0000 7f13e6591640 1 -- 172.21.15.46:0/843463144 wait complete. 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 Processor -- start 2024-09-19T09:18:18.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 -- start start 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13e0100a30 0x7f13e0196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 0x7f13e0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e01025e0 0x7f13e019e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13e010c700 con 0x7f13e0101c20 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f13e010c580 con 0x7f13e0100a30 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13e6591640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f13e010c880 con 0x7f13e01025e0 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13df7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 0x7f13e0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13df7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 0x7f13e0197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52926/0 (socket says 172.21.15.46:52926) 2024-09-19T09:18:18.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.339+0000 7f13df7fe640 1 -- 172.21.15.46:0/269944032 learned_addr learned my addr 172.21.15.46:0/269944032 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13dffff640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13e0100a30 0x7f13e0196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13e4b2e640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e01025e0 0x7f13e019e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13df7fe640 1 -- 172.21.15.46:0/269944032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e01025e0 msgr2=0x7f13e019e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13df7fe640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e01025e0 0x7f13e019e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13df7fe640 1 -- 172.21.15.46:0/269944032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13e0100a30 msgr2=0x7f13e0196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13df7fe640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13e0100a30 0x7f13e0196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13df7fe640 1 -- 172.21.15.46:0/269944032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e019e970 con 0x7f13e0101c20 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13df7fe640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 0x7f13e0197290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c890 tx=0x7f13d400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004220 con 0x7f13e0101c20 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13d40043c0 con 0x7f13e0101c20 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d40049e0 con 0x7f13e0101c20 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e019ec60 con 0x7f13e0101c20 2024-09-19T09:18:18.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.340+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e019f1b0 con 0x7f13e0101c20 2024-09-19T09:18:18.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.341+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e0107e20 con 0x7f13e0101c20 2024-09-19T09:18:18.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.342+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f13d40079b0 con 0x7f13e0101c20 2024-09-19T09:18:18.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.343+0000 7f13dd7fa640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13c80a32d0 0x7f13c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.343+0000 7f13dffff640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13c80a32d0 0x7f13c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.343+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f13d40cfb50 con 0x7f13e0101c20 2024-09-19T09:18:18.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.343+0000 7f13dffff640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13c80a32d0 0x7f13c80a5790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13d002aa00 tx=0x7f13d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.346+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f13d4014030 con 0x7f13e0101c20 2024-09-19T09:18:18.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.518+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13e0062630 con 0x7f13c80a32d0 2024-09-19T09:18:18.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.524+0000 7f13dd7fa640 1 -- 172.21.15.46:0/269944032 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258982 (secure 0 0 0) 0x7f13e0062630 con 0x7f13c80a32d0 2024-09-19T09:18:18.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:18.529 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.527+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13c80a32d0 msgr2=0x7f13c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13c80a32d0 0x7f13c80a5790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f13d002aa00 tx=0x7f13d0031400 comp rx=0 tx=0).stop 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 msgr2=0x7f13e0197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 0x7f13e0197290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c890 tx=0x7f13d400cd50 comp rx=0 tx=0).stop 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 shutdown_connections 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13c80a32d0 0x7f13c80a5790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e0101c20 0x7f13e0197290 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13e01025e0 0x7f13e019e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 --2- 172.21.15.46:0/269944032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13e0100a30 0x7f13e0196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 >> 172.21.15.46:0/269944032 conn(0x7f13e00fc1b0 msgr2=0x7f13e0104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 shutdown_connections 2024-09-19T09:18:18.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.528+0000 7f13e6591640 1 -- 172.21.15.46:0/269944032 wait complete. 2024-09-19T09:18:18.539 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T09:18:16.982108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664977,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1176,"num_read_kb":719,"num_write":446,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348204,"kb_used_data":11436,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593620,"statfs":{"total":1151940427776,"available":1151583866880,"internally_reserved":0,"allocated":11710464,"data_stored":7352895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":82,"num_write":8,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003031"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981549+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:17:58.981549+0000","last_peered":"2024-09-19T09:17:58.981549+0000","last_clean":"2024-09-19T09:17:58.981549+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:17:58.981549+0000","last_undegraded":"2024-09-19T09:17:58.981549+0000","last_fullsized":"2024-09-19T09:17:58.981549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.978712+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:17:58.978712+0000","last_peered":"2024-09-19T09:17:58.978712+0000","last_clean":"2024-09-19T09:17:58.978712+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:17:58.978712+0000","last_undegraded":"2024-09-19T09:17:58.978712+0000","last_fullsized":"2024-09-19T09:17:58.978712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980087+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:17:58.980087+0000","last_peered":"2024-09-19T09:17:58.980087+0000","last_clean":"2024-09-19T09:17:58.980087+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.980087+0000","last_undegraded":"2024-09-19T09:17:58.980087+0000","last_fullsized":"2024-09-19T09:17:58.980087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963356+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:17:58.963356+0000","last_peered":"2024-09-19T09:17:58.963356+0000","last_clean":"2024-09-19T09:17:58.963356+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:17:58.963356+0000","last_undegraded":"2024-09-19T09:17:58.963356+0000","last_fullsized":"2024-09-19T09:17:58.963356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956263+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:17:58.956263+0000","last_peered":"2024-09-19T09:17:58.956263+0000","last_clean":"2024-09-19T09:17:58.956263+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:17:58.956263+0000","last_undegraded":"2024-09-19T09:17:58.956263+0000","last_fullsized":"2024-09-19T09:17:58.956263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970384+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:17:58.970384+0000","last_peered":"2024-09-19T09:17:58.970384+0000","last_clean":"2024-09-19T09:17:58.970384+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:17:58.970384+0000","last_undegraded":"2024-09-19T09:17:58.970384+0000","last_fullsized":"2024-09-19T09:17:58.970384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968788+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:17:58.968788+0000","last_peered":"2024-09-19T09:17:58.968788+0000","last_clean":"2024-09-19T09:17:58.968788+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:17:58.968788+0000","last_undegraded":"2024-09-19T09:17:58.968788+0000","last_fullsized":"2024-09-19T09:17:58.968788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969443+0000","last_change":"2024-09-19T09:17:30.741930+0000","last_active":"2024-09-19T09:17:58.969443+0000","last_peered":"2024-09-19T09:17:58.969443+0000","last_clean":"2024-09-19T09:17:58.969443+0000","last_became_active":"2024-09-19T09:17:30.741704+0000","last_became_peered":"2024-09-19T09:17:30.741704+0000","last_unstale":"2024-09-19T09:17:58.969443+0000","last_undegraded":"2024-09-19T09:17:58.969443+0000","last_fullsized":"2024-09-19T09:17:58.969443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:05.913992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981366+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:17:58.981366+0000","last_peered":"2024-09-19T09:17:58.981366+0000","last_clean":"2024-09-19T09:17:58.981366+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:17:58.981366+0000","last_undegraded":"2024-09-19T09:17:58.981366+0000","last_fullsized":"2024-09-19T09:17:58.981366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968579+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:17:58.968579+0000","last_peered":"2024-09-19T09:17:58.968579+0000","last_clean":"2024-09-19T09:17:58.968579+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:17:58.968579+0000","last_undegraded":"2024-09-19T09:17:58.968579+0000","last_fullsized":"2024-09-19T09:17:58.968579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980413+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:17:58.980413+0000","last_peered":"2024-09-19T09:17:58.980413+0000","last_clean":"2024-09-19T09:17:58.980413+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:17:58.980413+0000","last_undegraded":"2024-09-19T09:17:58.980413+0000","last_fullsized":"2024-09-19T09:17:58.980413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961145+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:17:58.961145+0000","last_peered":"2024-09-19T09:17:58.961145+0000","last_clean":"2024-09-19T09:17:58.961145+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:17:58.961145+0000","last_undegraded":"2024-09-19T09:17:58.961145+0000","last_fullsized":"2024-09-19T09:17:58.961145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967545+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:17:58.967545+0000","last_peered":"2024-09-19T09:17:58.967545+0000","last_clean":"2024-09-19T09:17:58.967545+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:17:58.967545+0000","last_undegraded":"2024-09-19T09:17:58.967545+0000","last_fullsized":"2024-09-19T09:17:58.967545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977708+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:17:58.977708+0000","last_peered":"2024-09-19T09:17:58.977708+0000","last_clean":"2024-09-19T09:17:58.977708+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:17:58.977708+0000","last_undegraded":"2024-09-19T09:17:58.977708+0000","last_fullsized":"2024-09-19T09:17:58.977708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979172+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:17:58.979172+0000","last_peered":"2024-09-19T09:17:58.979172+0000","last_clean":"2024-09-19T09:17:58.979172+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:17:58.979172+0000","last_undegraded":"2024-09-19T09:17:58.979172+0000","last_fullsized":"2024-09-19T09:17:58.979172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981760+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:17:58.981760+0000","last_peered":"2024-09-19T09:17:58.981760+0000","last_clean":"2024-09-19T09:17:58.981760+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:17:58.981760+0000","last_undegraded":"2024-09-19T09:17:58.981760+0000","last_fullsized":"2024-09-19T09:17:58.981760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981803+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:17:58.981803+0000","last_peered":"2024-09-19T09:17:58.981803+0000","last_clean":"2024-09-19T09:17:58.981803+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:17:58.981803+0000","last_undegraded":"2024-09-19T09:17:58.981803+0000","last_fullsized":"2024-09-19T09:17:58.981803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967160+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:17:58.967160+0000","last_peered":"2024-09-19T09:17:58.967160+0000","last_clean":"2024-09-19T09:17:58.967160+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:17:58.967160+0000","last_undegraded":"2024-09-19T09:17:58.967160+0000","last_fullsized":"2024-09-19T09:17:58.967160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967152+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:17:58.967152+0000","last_peered":"2024-09-19T09:17:58.967152+0000","last_clean":"2024-09-19T09:17:58.967152+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:17:58.967152+0000","last_undegraded":"2024-09-19T09:17:58.967152+0000","last_fullsized":"2024-09-19T09:17:58.967152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970437+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:17:58.970437+0000","last_peered":"2024-09-19T09:17:58.970437+0000","last_clean":"2024-09-19T09:17:58.970437+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:17:58.970437+0000","last_undegraded":"2024-09-19T09:17:58.970437+0000","last_fullsized":"2024-09-19T09:17:58.970437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980591+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:17:58.980591+0000","last_peered":"2024-09-19T09:17:58.980591+0000","last_clean":"2024-09-19T09:17:58.980591+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:17:58.980591+0000","last_undegraded":"2024-09-19T09:17:58.980591+0000","last_fullsized":"2024-09-19T09:17:58.980591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981630+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:17:58.981630+0000","last_peered":"2024-09-19T09:17:58.981630+0000","last_clean":"2024-09-19T09:17:58.981630+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:17:58.981630+0000","last_undegraded":"2024-09-19T09:17:58.981630+0000","last_fullsized":"2024-09-19T09:17:58.981630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968614+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:17:58.968614+0000","last_peered":"2024-09-19T09:17:58.968614+0000","last_clean":"2024-09-19T09:17:58.968614+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:17:58.968614+0000","last_undegraded":"2024-09-19T09:17:58.968614+0000","last_fullsized":"2024-09-19T09:17:58.968614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961162+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:17:58.961162+0000","last_peered":"2024-09-19T09:17:58.961162+0000","last_clean":"2024-09-19T09:17:58.961162+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:17:58.961162+0000","last_undegraded":"2024-09-19T09:17:58.961162+0000","last_fullsized":"2024-09-19T09:17:58.961162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968911+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:17:58.968911+0000","last_peered":"2024-09-19T09:17:58.968911+0000","last_clean":"2024-09-19T09:17:58.968911+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:17:58.968911+0000","last_undegraded":"2024-09-19T09:17:58.968911+0000","last_fullsized":"2024-09-19T09:17:58.968911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981030+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:17:58.981030+0000","last_peered":"2024-09-19T09:17:58.981030+0000","last_clean":"2024-09-19T09:17:58.981030+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:17:58.981030+0000","last_undegraded":"2024-09-19T09:17:58.981030+0000","last_fullsized":"2024-09-19T09:17:58.981030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969254+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:17:58.969254+0000","last_peered":"2024-09-19T09:17:58.969254+0000","last_clean":"2024-09-19T09:17:58.969254+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:17:58.969254+0000","last_undegraded":"2024-09-19T09:17:58.969254+0000","last_fullsized":"2024-09-19T09:17:58.969254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979843+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:17:58.979843+0000","last_peered":"2024-09-19T09:17:58.979843+0000","last_clean":"2024-09-19T09:17:58.979843+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:17:58.979843+0000","last_undegraded":"2024-09-19T09:17:58.979843+0000","last_fullsized":"2024-09-19T09:17:58.979843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977631+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:17:58.977631+0000","last_peered":"2024-09-19T09:17:58.977631+0000","last_clean":"2024-09-19T09:17:58.977631+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:17:58.977631+0000","last_undegraded":"2024-09-19T09:17:58.977631+0000","last_fullsized":"2024-09-19T09:17:58.977631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980454+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:17:58.980454+0000","last_peered":"2024-09-19T09:17:58.980454+0000","last_clean":"2024-09-19T09:17:58.980454+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:17:58.980454+0000","last_undegraded":"2024-09-19T09:17:58.980454+0000","last_fullsized":"2024-09-19T09:17:58.980454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966717+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:17:58.966717+0000","last_peered":"2024-09-19T09:17:58.966717+0000","last_clean":"2024-09-19T09:17:58.966717+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:17:58.966717+0000","last_undegraded":"2024-09-19T09:17:58.966717+0000","last_fullsized":"2024-09-19T09:17:58.966717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970020+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:17:58.970020+0000","last_peered":"2024-09-19T09:17:58.970020+0000","last_clean":"2024-09-19T09:17:58.970020+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:17:58.970020+0000","last_undegraded":"2024-09-19T09:17:58.970020+0000","last_fullsized":"2024-09-19T09:17:58.970020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.957135+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:17:58.957135+0000","last_peered":"2024-09-19T09:17:58.957135+0000","last_clean":"2024-09-19T09:17:58.957135+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:17:58.957135+0000","last_undegraded":"2024-09-19T09:17:58.957135+0000","last_fullsized":"2024-09-19T09:17:58.957135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.184190+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:18:13.184190+0000","last_peered":"2024-09-19T09:18:13.184190+0000","last_clean":"2024-09-19T09:18:13.184190+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:18:13.184190+0000","last_undegraded":"2024-09-19T09:18:13.184190+0000","last_fullsized":"2024-09-19T09:18:13.184190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.965388+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:17:58.965388+0000","last_peered":"2024-09-19T09:17:58.965388+0000","last_clean":"2024-09-19T09:17:58.965388+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:17:58.965388+0000","last_undegraded":"2024-09-19T09:17:58.965388+0000","last_fullsized":"2024-09-19T09:17:58.965388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.740826+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:17:30.740826+0000","last_peered":"2024-09-19T09:17:30.740826+0000","last_clean":"2024-09-19T09:17:30.740826+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:17:30.740826+0000","last_undegraded":"2024-09-19T09:17:30.740826+0000","last_fullsized":"2024-09-19T09:17:30.740826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.699545+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:17:30.699545+0000","last_peered":"2024-09-19T09:17:30.699545+0000","last_clean":"2024-09-19T09:17:30.699545+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:17:30.699545+0000","last_undegraded":"2024-09-19T09:17:30.699545+0000","last_fullsized":"2024-09-19T09:17:30.699545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970622+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:17:58.970622+0000","last_peered":"2024-09-19T09:17:58.970622+0000","last_clean":"2024-09-19T09:17:58.970622+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:17:58.970622+0000","last_undegraded":"2024-09-19T09:17:58.970622+0000","last_fullsized":"2024-09-19T09:17:58.970622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701519+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:17:30.701519+0000","last_peered":"2024-09-19T09:17:30.701519+0000","last_clean":"2024-09-19T09:17:30.701519+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:17:30.701519+0000","last_undegraded":"2024-09-19T09:17:30.701519+0000","last_fullsized":"2024-09-19T09:17:30.701519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970260+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:17:58.970260+0000","last_peered":"2024-09-19T09:17:58.970260+0000","last_clean":"2024-09-19T09:17:58.970260+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:17:58.970260+0000","last_undegraded":"2024-09-19T09:17:58.970260+0000","last_fullsized":"2024-09-19T09:17:58.970260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'6","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:16.187198+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:18:16.187198+0000","last_peered":"2024-09-19T09:18:16.187198+0000","last_clean":"2024-09-19T09:18:16.187198+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:18:16.187198+0000","last_undegraded":"2024-09-19T09:18:16.187198+0000","last_fullsized":"2024-09-19T09:18:16.187198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.976566+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:17:58.976566+0000","last_peered":"2024-09-19T09:17:58.976566+0000","last_clean":"2024-09-19T09:17:58.976566+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:17:58.976566+0000","last_undegraded":"2024-09-19T09:17:58.976566+0000","last_fullsized":"2024-09-19T09:17:58.976566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701780+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:17:30.701780+0000","last_peered":"2024-09-19T09:17:30.701780+0000","last_clean":"2024-09-19T09:17:30.701780+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:17:30.701780+0000","last_undegraded":"2024-09-19T09:17:30.701780+0000","last_fullsized":"2024-09-19T09:17:30.701780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979267+0000","last_change":"2024-09-19T09:17:30.711986+0000","last_active":"2024-09-19T09:17:58.979267+0000","last_peered":"2024-09-19T09:17:58.979267+0000","last_clean":"2024-09-19T09:17:58.979267+0000","last_became_active":"2024-09-19T09:17:30.711751+0000","last_became_peered":"2024-09-19T09:17:30.711751+0000","last_unstale":"2024-09-19T09:17:58.979267+0000","last_undegraded":"2024-09-19T09:17:58.979267+0000","last_fullsized":"2024-09-19T09:17:58.979267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:18.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701396+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:17:30.701396+0000","last_peered":"2024-09-19T09:17:30.701396+0000","last_clean":"2024-09-19T09:17:30.701396+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:17:30.701396+0000","last_undegraded":"2024-09-19T09:17:30.701396+0000","last_fullsized":"2024-09-19T09:17:30.701396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979992+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:17:58.979992+0000","last_peered":"2024-09-19T09:17:58.979992+0000","last_clean":"2024-09-19T09:17:58.979992+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:17:58.979992+0000","last_undegraded":"2024-09-19T09:17:58.979992+0000","last_fullsized":"2024-09-19T09:17:58.979992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:16.187739+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:18:16.187739+0000","last_peered":"2024-09-19T09:18:16.187739+0000","last_clean":"2024-09-19T09:18:16.187739+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:18:16.187739+0000","last_undegraded":"2024-09-19T09:18:16.187739+0000","last_fullsized":"2024-09-19T09:18:16.187739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66043,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":214,"num_read_kb":171,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967581+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:17:58.967581+0000","last_peered":"2024-09-19T09:17:58.967581+0000","last_clean":"2024-09-19T09:17:58.967581+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:17:58.967581+0000","last_undegraded":"2024-09-19T09:17:58.967581+0000","last_fullsized":"2024-09-19T09:17:58.967581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701982+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:17:30.701982+0000","last_peered":"2024-09-19T09:17:30.701982+0000","last_clean":"2024-09-19T09:17:30.701982+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:17:30.701982+0000","last_undegraded":"2024-09-19T09:17:30.701982+0000","last_fullsized":"2024-09-19T09:17:30.701982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956062+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:17:58.956062+0000","last_peered":"2024-09-19T09:17:58.956062+0000","last_clean":"2024-09-19T09:17:58.956062+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:17:58.956062+0000","last_undegraded":"2024-09-19T09:17:58.956062+0000","last_fullsized":"2024-09-19T09:17:58.956062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701288+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:17:30.701288+0000","last_peered":"2024-09-19T09:17:30.701288+0000","last_clean":"2024-09-19T09:17:30.701288+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:17:30.701288+0000","last_undegraded":"2024-09-19T09:17:30.701288+0000","last_fullsized":"2024-09-19T09:17:30.701288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.971893+0000","last_change":"2024-09-19T09:17:30.706308+0000","last_active":"2024-09-19T09:17:58.971893+0000","last_peered":"2024-09-19T09:17:58.971893+0000","last_clean":"2024-09-19T09:17:58.971893+0000","last_became_active":"2024-09-19T09:17:30.705841+0000","last_became_peered":"2024-09-19T09:17:30.705841+0000","last_unstale":"2024-09-19T09:17:58.971893+0000","last_undegraded":"2024-09-19T09:17:58.971893+0000","last_fullsized":"2024-09-19T09:17:58.971893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.183394+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:18:13.183394+0000","last_peered":"2024-09-19T09:18:13.183394+0000","last_clean":"2024-09-19T09:18:13.183394+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:18:13.183394+0000","last_undegraded":"2024-09-19T09:18:13.183394+0000","last_fullsized":"2024-09-19T09:18:13.183394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969899+0000","last_change":"2024-09-19T09:17:30.742259+0000","last_active":"2024-09-19T09:17:58.969899+0000","last_peered":"2024-09-19T09:17:58.969899+0000","last_clean":"2024-09-19T09:17:58.969899+0000","last_became_active":"2024-09-19T09:17:30.741880+0000","last_became_peered":"2024-09-19T09:17:30.741880+0000","last_unstale":"2024-09-19T09:17:58.969899+0000","last_undegraded":"2024-09-19T09:17:58.969899+0000","last_fullsized":"2024-09-19T09:17:58.969899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:33.736292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706370+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:17:30.706370+0000","last_peered":"2024-09-19T09:17:30.706370+0000","last_clean":"2024-09-19T09:17:30.706370+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:17:30.706370+0000","last_undegraded":"2024-09-19T09:17:30.706370+0000","last_fullsized":"2024-09-19T09:17:30.706370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.974073+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:17:58.974073+0000","last_peered":"2024-09-19T09:17:58.974073+0000","last_clean":"2024-09-19T09:17:58.974073+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:17:58.974073+0000","last_undegraded":"2024-09-19T09:17:58.974073+0000","last_fullsized":"2024-09-19T09:17:58.974073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.716217+0000","last_change":"2024-09-19T09:17:30.715839+0000","last_active":"2024-09-19T09:17:30.716217+0000","last_peered":"2024-09-19T09:17:30.716217+0000","last_clean":"2024-09-19T09:17:30.716217+0000","last_became_active":"2024-09-19T09:17:30.707470+0000","last_became_peered":"2024-09-19T09:17:30.707470+0000","last_unstale":"2024-09-19T09:17:30.716217+0000","last_undegraded":"2024-09-19T09:17:30.716217+0000","last_fullsized":"2024-09-19T09:17:30.716217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.090063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969162+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:17:58.969162+0000","last_peered":"2024-09-19T09:17:58.969162+0000","last_clean":"2024-09-19T09:17:58.969162+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:17:58.969162+0000","last_undegraded":"2024-09-19T09:17:58.969162+0000","last_fullsized":"2024-09-19T09:17:58.969162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.719006+0000","last_change":"2024-09-19T09:17:30.719006+0000","last_active":"2024-09-19T09:17:30.719006+0000","last_peered":"2024-09-19T09:17:30.719006+0000","last_clean":"2024-09-19T09:17:30.719006+0000","last_became_active":"2024-09-19T09:17:30.709645+0000","last_became_peered":"2024-09-19T09:17:30.709645+0000","last_unstale":"2024-09-19T09:17:30.719006+0000","last_undegraded":"2024-09-19T09:17:30.719006+0000","last_fullsized":"2024-09-19T09:17:30.719006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:41.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977582+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:17:58.977582+0000","last_peered":"2024-09-19T09:17:58.977582+0000","last_clean":"2024-09-19T09:17:58.977582+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:17:58.977582+0000","last_undegraded":"2024-09-19T09:17:58.977582+0000","last_fullsized":"2024-09-19T09:17:58.977582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701511+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:17:30.701511+0000","last_peered":"2024-09-19T09:17:30.701511+0000","last_clean":"2024-09-19T09:17:30.701511+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:17:30.701511+0000","last_undegraded":"2024-09-19T09:17:30.701511+0000","last_fullsized":"2024-09-19T09:17:30.701511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968174+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:17:58.968174+0000","last_peered":"2024-09-19T09:17:58.968174+0000","last_clean":"2024-09-19T09:17:58.968174+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:17:58.968174+0000","last_undegraded":"2024-09-19T09:17:58.968174+0000","last_fullsized":"2024-09-19T09:17:58.968174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.183679+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:18:13.183679+0000","last_peered":"2024-09-19T09:18:13.183679+0000","last_clean":"2024-09-19T09:18:13.183679+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:18:13.183679+0000","last_undegraded":"2024-09-19T09:18:13.183679+0000","last_fullsized":"2024-09-19T09:18:13.183679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980166+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:17:58.980166+0000","last_peered":"2024-09-19T09:17:58.980166+0000","last_clean":"2024-09-19T09:17:58.980166+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:17:58.980166+0000","last_undegraded":"2024-09-19T09:17:58.980166+0000","last_fullsized":"2024-09-19T09:17:58.980166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702339+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:17:30.702339+0000","last_peered":"2024-09-19T09:17:30.702339+0000","last_clean":"2024-09-19T09:17:30.702339+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:17:30.702339+0000","last_undegraded":"2024-09-19T09:17:30.702339+0000","last_fullsized":"2024-09-19T09:17:30.702339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.707109+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:17:30.707109+0000","last_peered":"2024-09-19T09:17:30.707109+0000","last_clean":"2024-09-19T09:17:30.707109+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:17:30.707109+0000","last_undegraded":"2024-09-19T09:17:30.707109+0000","last_fullsized":"2024-09-19T09:17:30.707109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977434+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:17:58.977434+0000","last_peered":"2024-09-19T09:17:58.977434+0000","last_clean":"2024-09-19T09:17:58.977434+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:17:58.977434+0000","last_undegraded":"2024-09-19T09:17:58.977434+0000","last_fullsized":"2024-09-19T09:17:58.977434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702100+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:17:30.702100+0000","last_peered":"2024-09-19T09:17:30.702100+0000","last_clean":"2024-09-19T09:17:30.702100+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:17:30.702100+0000","last_undegraded":"2024-09-19T09:17:30.702100+0000","last_fullsized":"2024-09-19T09:17:30.702100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961956+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:17:58.961956+0000","last_peered":"2024-09-19T09:17:58.961956+0000","last_clean":"2024-09-19T09:17:58.961956+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.961956+0000","last_undegraded":"2024-09-19T09:17:58.961956+0000","last_fullsized":"2024-09-19T09:17:58.961956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:14.184089+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:18:14.184089+0000","last_peered":"2024-09-19T09:18:14.184089+0000","last_clean":"2024-09-19T09:18:14.184089+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:18:14.184089+0000","last_undegraded":"2024-09-19T09:18:14.184089+0000","last_fullsized":"2024-09-19T09:18:14.184089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963278+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:17:58.963278+0000","last_peered":"2024-09-19T09:17:58.963278+0000","last_clean":"2024-09-19T09:17:58.963278+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:17:58.963278+0000","last_undegraded":"2024-09-19T09:17:58.963278+0000","last_fullsized":"2024-09-19T09:17:58.963278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'8","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:14.185454+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:18:14.185454+0000","last_peered":"2024-09-19T09:18:14.185454+0000","last_clean":"2024-09-19T09:18:14.185454+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:18:14.185454+0000","last_undegraded":"2024-09-19T09:18:14.185454+0000","last_fullsized":"2024-09-19T09:18:14.185454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967435+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:17:58.967435+0000","last_peered":"2024-09-19T09:17:58.967435+0000","last_clean":"2024-09-19T09:17:58.967435+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:17:58.967435+0000","last_undegraded":"2024-09-19T09:17:58.967435+0000","last_fullsized":"2024-09-19T09:17:58.967435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.704404+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:17:30.704404+0000","last_peered":"2024-09-19T09:17:30.704404+0000","last_clean":"2024-09-19T09:17:30.704404+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:17:30.704404+0000","last_undegraded":"2024-09-19T09:17:30.704404+0000","last_fullsized":"2024-09-19T09:17:30.704404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970687+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:17:58.970687+0000","last_peered":"2024-09-19T09:17:58.970687+0000","last_clean":"2024-09-19T09:17:58.970687+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:17:58.970687+0000","last_undegraded":"2024-09-19T09:17:58.970687+0000","last_fullsized":"2024-09-19T09:17:58.970687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706919+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:17:30.706919+0000","last_peered":"2024-09-19T09:17:30.706919+0000","last_clean":"2024-09-19T09:17:30.706919+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:17:30.706919+0000","last_undegraded":"2024-09-19T09:17:30.706919+0000","last_fullsized":"2024-09-19T09:17:30.706919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.962302+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:17:58.962302+0000","last_peered":"2024-09-19T09:17:58.962302+0000","last_clean":"2024-09-19T09:17:58.962302+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:17:58.962302+0000","last_undegraded":"2024-09-19T09:17:58.962302+0000","last_fullsized":"2024-09-19T09:17:58.962302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:59.005140+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:17:59.005140+0000","last_peered":"2024-09-19T09:17:59.005140+0000","last_clean":"2024-09-19T09:17:59.005140+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:17:59.005140+0000","last_undegraded":"2024-09-19T09:17:59.005140+0000","last_fullsized":"2024-09-19T09:17:59.005140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970983+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:17:58.970983+0000","last_peered":"2024-09-19T09:17:58.970983+0000","last_clean":"2024-09-19T09:17:58.970983+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:17:58.970983+0000","last_undegraded":"2024-09-19T09:17:58.970983+0000","last_fullsized":"2024-09-19T09:17:58.970983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706710+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:17:30.706710+0000","last_peered":"2024-09-19T09:17:30.706710+0000","last_clean":"2024-09-19T09:17:30.706710+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:17:30.706710+0000","last_undegraded":"2024-09-19T09:17:30.706710+0000","last_fullsized":"2024-09-19T09:17:30.706710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979125+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:17:58.979125+0000","last_peered":"2024-09-19T09:17:58.979125+0000","last_clean":"2024-09-19T09:17:58.979125+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:17:58.979125+0000","last_undegraded":"2024-09-19T09:17:58.979125+0000","last_fullsized":"2024-09-19T09:17:58.979125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.700552+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:17:30.700552+0000","last_peered":"2024-09-19T09:17:30.700552+0000","last_clean":"2024-09-19T09:17:30.700552+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:17:30.700552+0000","last_undegraded":"2024-09-19T09:17:30.700552+0000","last_fullsized":"2024-09-19T09:17:30.700552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.933118+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:17:58.933118+0000","last_peered":"2024-09-19T09:17:58.933118+0000","last_clean":"2024-09-19T09:17:58.933118+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:17:58.933118+0000","last_undegraded":"2024-09-19T09:17:58.933118+0000","last_fullsized":"2024-09-19T09:17:58.933118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702269+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:17:30.702269+0000","last_peered":"2024-09-19T09:17:30.702269+0000","last_clean":"2024-09-19T09:17:30.702269+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:17:30.702269+0000","last_undegraded":"2024-09-19T09:17:30.702269+0000","last_fullsized":"2024-09-19T09:17:30.702269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975139+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:17:58.975139+0000","last_peered":"2024-09-19T09:17:58.975139+0000","last_clean":"2024-09-19T09:17:58.975139+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:17:58.975139+0000","last_undegraded":"2024-09-19T09:17:58.975139+0000","last_fullsized":"2024-09-19T09:17:58.975139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.722791+0000","last_change":"2024-09-19T09:17:30.722376+0000","last_active":"2024-09-19T09:17:30.722791+0000","last_peered":"2024-09-19T09:17:30.722791+0000","last_clean":"2024-09-19T09:17:30.722791+0000","last_became_active":"2024-09-19T09:17:30.709277+0000","last_became_peered":"2024-09-19T09:17:30.709277+0000","last_unstale":"2024-09-19T09:17:30.722791+0000","last_undegraded":"2024-09-19T09:17:30.722791+0000","last_fullsized":"2024-09-19T09:17:30.722791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.341264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980029+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:17:58.980029+0000","last_peered":"2024-09-19T09:17:58.980029+0000","last_clean":"2024-09-19T09:17:58.980029+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:17:58.980029+0000","last_undegraded":"2024-09-19T09:17:58.980029+0000","last_fullsized":"2024-09-19T09:17:58.980029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706536+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:17:30.706536+0000","last_peered":"2024-09-19T09:17:30.706536+0000","last_clean":"2024-09-19T09:17:30.706536+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:17:30.706536+0000","last_undegraded":"2024-09-19T09:17:30.706536+0000","last_fullsized":"2024-09-19T09:17:30.706536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979969+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:17:58.979969+0000","last_peered":"2024-09-19T09:17:58.979969+0000","last_clean":"2024-09-19T09:17:58.979969+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:17:58.979969+0000","last_undegraded":"2024-09-19T09:17:58.979969+0000","last_fullsized":"2024-09-19T09:17:58.979969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980085+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:17:58.980085+0000","last_peered":"2024-09-19T09:17:58.980085+0000","last_clean":"2024-09-19T09:17:58.980085+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:17:58.980085+0000","last_undegraded":"2024-09-19T09:17:58.980085+0000","last_fullsized":"2024-09-19T09:17:58.980085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706809+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:17:30.706809+0000","last_peered":"2024-09-19T09:17:30.706809+0000","last_clean":"2024-09-19T09:17:30.706809+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:17:30.706809+0000","last_undegraded":"2024-09-19T09:17:30.706809+0000","last_fullsized":"2024-09-19T09:17:30.706809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975767+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:17:58.975767+0000","last_peered":"2024-09-19T09:17:58.975767+0000","last_clean":"2024-09-19T09:17:58.975767+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:17:58.975767+0000","last_undegraded":"2024-09-19T09:17:58.975767+0000","last_fullsized":"2024-09-19T09:17:58.975767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'13","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706829+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:17:30.706829+0000","last_peered":"2024-09-19T09:17:30.706829+0000","last_clean":"2024-09-19T09:17:30.706829+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:17:30.706829+0000","last_undegraded":"2024-09-19T09:17:30.706829+0000","last_fullsized":"2024-09-19T09:17:30.706829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981137+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:17:58.981137+0000","last_peered":"2024-09-19T09:17:58.981137+0000","last_clean":"2024-09-19T09:17:58.981137+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:17:58.981137+0000","last_undegraded":"2024-09-19T09:17:58.981137+0000","last_fullsized":"2024-09-19T09:17:58.981137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702907+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:17:30.702907+0000","last_peered":"2024-09-19T09:17:30.702907+0000","last_clean":"2024-09-19T09:17:30.702907+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:17:30.702907+0000","last_undegraded":"2024-09-19T09:17:30.702907+0000","last_fullsized":"2024-09-19T09:17:30.702907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966920+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:17:58.966920+0000","last_peered":"2024-09-19T09:17:58.966920+0000","last_clean":"2024-09-19T09:17:58.966920+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:17:58.966920+0000","last_undegraded":"2024-09-19T09:17:58.966920+0000","last_fullsized":"2024-09-19T09:17:58.966920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:15.185984+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:18:15.185984+0000","last_peered":"2024-09-19T09:18:15.185984+0000","last_clean":"2024-09-19T09:18:15.185984+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:18:15.185984+0000","last_undegraded":"2024-09-19T09:18:15.185984+0000","last_fullsized":"2024-09-19T09:18:15.185984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74375,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1050,"num_read_kb":610,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":448245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1104761,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":447975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":1041500,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":448178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1040336,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":447197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":515580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":515134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:18:18.544 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T09:18:18.544 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:18:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3587862768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc101c20 msgr2=0x7fa0cc1020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3587862768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc101c20 0x7fa0cc1020a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009900 tx=0x7fa0b402a410 comp rx=0 tx=0).stop 2024-09-19T09:18:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3587862768 shutdown_connections 2024-09-19T09:18:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3587862768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc101c20 0x7fa0cc1020a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3587862768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc1025e0 0x7fa0cc108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3587862768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc100a30 0x7fa0cc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3587862768 >> 172.21.15.46:0/3587862768 conn(0x7fa0cc0fc1b0 msgr2=0x7fa0cc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3587862768 shutdown_connections 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.683+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3587862768 wait complete. 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 Processor -- start 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 -- start start 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 0x7fa0cc197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc101c20 0x7fa0cc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc1025e0 0x7fa0cc19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc10d860 con 0x7fa0cc100a30 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc10d6e0 con 0x7fa0cc101c20 2024-09-19T09:18:18.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0d1e47640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa0cc10d9e0 con 0x7fa0cc1025e0 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 0x7fa0cc197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 0x7fa0cc197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33814/0 (socket says 172.21.15.46:33814) 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 -- 172.21.15.46:0/3209511405 learned_addr learned my addr 172.21.15.46:0/3209511405 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cbfff640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc1025e0 0x7fa0cc19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0caffd640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc101c20 0x7fa0cc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 -- 172.21.15.46:0/3209511405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc1025e0 msgr2=0x7fa0cc19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc1025e0 0x7fa0cc19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 -- 172.21.15.46:0/3209511405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc101c20 msgr2=0x7fa0cc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc101c20 0x7fa0cc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cb7fe640 1 -- 172.21.15.46:0/3209511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0cc19fa20 con 0x7fa0cc100a30 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0cbfff640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc1025e0 0x7fa0cc19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:18.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.684+0000 7fa0caffd640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc101c20 0x7fa0cc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.685+0000 7fa0cb7fe640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 0x7fa0cc197e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00eaa0 tx=0x7fa0bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.685+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc016070 con 0x7fa0cc100a30 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.685+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0bc003e50 con 0x7fa0cc100a30 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.685+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0cc19fd10 con 0x7fa0cc100a30 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.685+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc0116d0 con 0x7fa0cc100a30 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.685+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0cc1a01b0 con 0x7fa0cc100a30 2024-09-19T09:18:18.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.686+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0cc107d50 con 0x7fa0cc100a30 2024-09-19T09:18:18.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.687+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa0bc019070 con 0x7fa0cc100a30 2024-09-19T09:18:18.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.688+0000 7fa0c8ff9640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa0b80a32d0 0x7fa0b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.688+0000 7fa0caffd640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa0b80a32d0 0x7fa0b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.688+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa0bc0cf9a0 con 0x7fa0cc100a30 2024-09-19T09:18:18.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.688+0000 7fa0caffd640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa0b80a32d0 0x7fa0b80a5790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0b402a930 tx=0x7fa0b4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.692+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0bc09c6f0 con 0x7fa0cc100a30 2024-09-19T09:18:18.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.866+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0cc062630 con 0x7fa0b80a32d0 2024-09-19T09:18:18.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.873+0000 7fa0c8ff9640 1 -- 172.21.15.46:0/3209511405 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258982 (secure 0 0 0) 0x7fa0cc062630 con 0x7fa0b80a32d0 2024-09-19T09:18:18.876 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:18.877 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:18:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa0b80a32d0 msgr2=0x7fa0b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa0b80a32d0 0x7fa0b80a5790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0b402a930 tx=0x7fa0b4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 msgr2=0x7fa0cc197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 0x7fa0cc197e00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00eaa0 tx=0x7fa0bc00ef60 comp rx=0 tx=0).stop 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 shutdown_connections 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa0b80a32d0 0x7fa0b80a5790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa0cc1025e0 0x7fa0cc19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0cc101c20 0x7fa0cc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 --2- 172.21.15.46:0/3209511405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0cc100a30 0x7fa0cc197e00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 >> 172.21.15.46:0/3209511405 conn(0x7fa0cc0fc1b0 msgr2=0x7fa0cc104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 shutdown_connections 2024-09-19T09:18:18.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:18.876+0000 7fa0d1e47640 1 -- 172.21.15.46:0/3209511405 wait complete. 2024-09-19T09:18:18.888 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T09:18:16.982108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664977,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1176,"num_read_kb":719,"num_write":446,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348204,"kb_used_data":11436,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593620,"statfs":{"total":1151940427776,"available":1151583866880,"internally_reserved":0,"allocated":11710464,"data_stored":7352895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":82,"num_write":8,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003031"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981549+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:17:58.981549+0000","last_peered":"2024-09-19T09:17:58.981549+0000","last_clean":"2024-09-19T09:17:58.981549+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:17:58.981549+0000","last_undegraded":"2024-09-19T09:17:58.981549+0000","last_fullsized":"2024-09-19T09:17:58.981549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.978712+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:17:58.978712+0000","last_peered":"2024-09-19T09:17:58.978712+0000","last_clean":"2024-09-19T09:17:58.978712+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:17:58.978712+0000","last_undegraded":"2024-09-19T09:17:58.978712+0000","last_fullsized":"2024-09-19T09:17:58.978712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980087+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:17:58.980087+0000","last_peered":"2024-09-19T09:17:58.980087+0000","last_clean":"2024-09-19T09:17:58.980087+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.980087+0000","last_undegraded":"2024-09-19T09:17:58.980087+0000","last_fullsized":"2024-09-19T09:17:58.980087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963356+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:17:58.963356+0000","last_peered":"2024-09-19T09:17:58.963356+0000","last_clean":"2024-09-19T09:17:58.963356+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:17:58.963356+0000","last_undegraded":"2024-09-19T09:17:58.963356+0000","last_fullsized":"2024-09-19T09:17:58.963356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956263+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:17:58.956263+0000","last_peered":"2024-09-19T09:17:58.956263+0000","last_clean":"2024-09-19T09:17:58.956263+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:17:58.956263+0000","last_undegraded":"2024-09-19T09:17:58.956263+0000","last_fullsized":"2024-09-19T09:17:58.956263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970384+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:17:58.970384+0000","last_peered":"2024-09-19T09:17:58.970384+0000","last_clean":"2024-09-19T09:17:58.970384+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:17:58.970384+0000","last_undegraded":"2024-09-19T09:17:58.970384+0000","last_fullsized":"2024-09-19T09:17:58.970384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968788+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:17:58.968788+0000","last_peered":"2024-09-19T09:17:58.968788+0000","last_clean":"2024-09-19T09:17:58.968788+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:17:58.968788+0000","last_undegraded":"2024-09-19T09:17:58.968788+0000","last_fullsized":"2024-09-19T09:17:58.968788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969443+0000","last_change":"2024-09-19T09:17:30.741930+0000","last_active":"2024-09-19T09:17:58.969443+0000","last_peered":"2024-09-19T09:17:58.969443+0000","last_clean":"2024-09-19T09:17:58.969443+0000","last_became_active":"2024-09-19T09:17:30.741704+0000","last_became_peered":"2024-09-19T09:17:30.741704+0000","last_unstale":"2024-09-19T09:17:58.969443+0000","last_undegraded":"2024-09-19T09:17:58.969443+0000","last_fullsized":"2024-09-19T09:17:58.969443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:05.913992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981366+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:17:58.981366+0000","last_peered":"2024-09-19T09:17:58.981366+0000","last_clean":"2024-09-19T09:17:58.981366+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:17:58.981366+0000","last_undegraded":"2024-09-19T09:17:58.981366+0000","last_fullsized":"2024-09-19T09:17:58.981366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968579+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:17:58.968579+0000","last_peered":"2024-09-19T09:17:58.968579+0000","last_clean":"2024-09-19T09:17:58.968579+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:17:58.968579+0000","last_undegraded":"2024-09-19T09:17:58.968579+0000","last_fullsized":"2024-09-19T09:17:58.968579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980413+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:17:58.980413+0000","last_peered":"2024-09-19T09:17:58.980413+0000","last_clean":"2024-09-19T09:17:58.980413+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:17:58.980413+0000","last_undegraded":"2024-09-19T09:17:58.980413+0000","last_fullsized":"2024-09-19T09:17:58.980413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961145+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:17:58.961145+0000","last_peered":"2024-09-19T09:17:58.961145+0000","last_clean":"2024-09-19T09:17:58.961145+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:17:58.961145+0000","last_undegraded":"2024-09-19T09:17:58.961145+0000","last_fullsized":"2024-09-19T09:17:58.961145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967545+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:17:58.967545+0000","last_peered":"2024-09-19T09:17:58.967545+0000","last_clean":"2024-09-19T09:17:58.967545+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:17:58.967545+0000","last_undegraded":"2024-09-19T09:17:58.967545+0000","last_fullsized":"2024-09-19T09:17:58.967545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977708+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:17:58.977708+0000","last_peered":"2024-09-19T09:17:58.977708+0000","last_clean":"2024-09-19T09:17:58.977708+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:17:58.977708+0000","last_undegraded":"2024-09-19T09:17:58.977708+0000","last_fullsized":"2024-09-19T09:17:58.977708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979172+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:17:58.979172+0000","last_peered":"2024-09-19T09:17:58.979172+0000","last_clean":"2024-09-19T09:17:58.979172+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:17:58.979172+0000","last_undegraded":"2024-09-19T09:17:58.979172+0000","last_fullsized":"2024-09-19T09:17:58.979172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981760+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:17:58.981760+0000","last_peered":"2024-09-19T09:17:58.981760+0000","last_clean":"2024-09-19T09:17:58.981760+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:17:58.981760+0000","last_undegraded":"2024-09-19T09:17:58.981760+0000","last_fullsized":"2024-09-19T09:17:58.981760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981803+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:17:58.981803+0000","last_peered":"2024-09-19T09:17:58.981803+0000","last_clean":"2024-09-19T09:17:58.981803+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:17:58.981803+0000","last_undegraded":"2024-09-19T09:17:58.981803+0000","last_fullsized":"2024-09-19T09:17:58.981803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967160+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:17:58.967160+0000","last_peered":"2024-09-19T09:17:58.967160+0000","last_clean":"2024-09-19T09:17:58.967160+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:17:58.967160+0000","last_undegraded":"2024-09-19T09:17:58.967160+0000","last_fullsized":"2024-09-19T09:17:58.967160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967152+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:17:58.967152+0000","last_peered":"2024-09-19T09:17:58.967152+0000","last_clean":"2024-09-19T09:17:58.967152+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:17:58.967152+0000","last_undegraded":"2024-09-19T09:17:58.967152+0000","last_fullsized":"2024-09-19T09:17:58.967152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970437+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:17:58.970437+0000","last_peered":"2024-09-19T09:17:58.970437+0000","last_clean":"2024-09-19T09:17:58.970437+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:17:58.970437+0000","last_undegraded":"2024-09-19T09:17:58.970437+0000","last_fullsized":"2024-09-19T09:17:58.970437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980591+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:17:58.980591+0000","last_peered":"2024-09-19T09:17:58.980591+0000","last_clean":"2024-09-19T09:17:58.980591+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:17:58.980591+0000","last_undegraded":"2024-09-19T09:17:58.980591+0000","last_fullsized":"2024-09-19T09:17:58.980591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981630+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:17:58.981630+0000","last_peered":"2024-09-19T09:17:58.981630+0000","last_clean":"2024-09-19T09:17:58.981630+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:17:58.981630+0000","last_undegraded":"2024-09-19T09:17:58.981630+0000","last_fullsized":"2024-09-19T09:17:58.981630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968614+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:17:58.968614+0000","last_peered":"2024-09-19T09:17:58.968614+0000","last_clean":"2024-09-19T09:17:58.968614+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:17:58.968614+0000","last_undegraded":"2024-09-19T09:17:58.968614+0000","last_fullsized":"2024-09-19T09:17:58.968614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961162+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:17:58.961162+0000","last_peered":"2024-09-19T09:17:58.961162+0000","last_clean":"2024-09-19T09:17:58.961162+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:17:58.961162+0000","last_undegraded":"2024-09-19T09:17:58.961162+0000","last_fullsized":"2024-09-19T09:17:58.961162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968911+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:17:58.968911+0000","last_peered":"2024-09-19T09:17:58.968911+0000","last_clean":"2024-09-19T09:17:58.968911+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:17:58.968911+0000","last_undegraded":"2024-09-19T09:17:58.968911+0000","last_fullsized":"2024-09-19T09:17:58.968911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981030+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:17:58.981030+0000","last_peered":"2024-09-19T09:17:58.981030+0000","last_clean":"2024-09-19T09:17:58.981030+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:17:58.981030+0000","last_undegraded":"2024-09-19T09:17:58.981030+0000","last_fullsized":"2024-09-19T09:17:58.981030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969254+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:17:58.969254+0000","last_peered":"2024-09-19T09:17:58.969254+0000","last_clean":"2024-09-19T09:17:58.969254+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:17:58.969254+0000","last_undegraded":"2024-09-19T09:17:58.969254+0000","last_fullsized":"2024-09-19T09:17:58.969254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979843+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:17:58.979843+0000","last_peered":"2024-09-19T09:17:58.979843+0000","last_clean":"2024-09-19T09:17:58.979843+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:17:58.979843+0000","last_undegraded":"2024-09-19T09:17:58.979843+0000","last_fullsized":"2024-09-19T09:17:58.979843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977631+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:17:58.977631+0000","last_peered":"2024-09-19T09:17:58.977631+0000","last_clean":"2024-09-19T09:17:58.977631+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:17:58.977631+0000","last_undegraded":"2024-09-19T09:17:58.977631+0000","last_fullsized":"2024-09-19T09:17:58.977631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980454+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:17:58.980454+0000","last_peered":"2024-09-19T09:17:58.980454+0000","last_clean":"2024-09-19T09:17:58.980454+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:17:58.980454+0000","last_undegraded":"2024-09-19T09:17:58.980454+0000","last_fullsized":"2024-09-19T09:17:58.980454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966717+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:17:58.966717+0000","last_peered":"2024-09-19T09:17:58.966717+0000","last_clean":"2024-09-19T09:17:58.966717+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:17:58.966717+0000","last_undegraded":"2024-09-19T09:17:58.966717+0000","last_fullsized":"2024-09-19T09:17:58.966717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970020+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:17:58.970020+0000","last_peered":"2024-09-19T09:17:58.970020+0000","last_clean":"2024-09-19T09:17:58.970020+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:17:58.970020+0000","last_undegraded":"2024-09-19T09:17:58.970020+0000","last_fullsized":"2024-09-19T09:17:58.970020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.957135+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:17:58.957135+0000","last_peered":"2024-09-19T09:17:58.957135+0000","last_clean":"2024-09-19T09:17:58.957135+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:17:58.957135+0000","last_undegraded":"2024-09-19T09:17:58.957135+0000","last_fullsized":"2024-09-19T09:17:58.957135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.184190+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:18:13.184190+0000","last_peered":"2024-09-19T09:18:13.184190+0000","last_clean":"2024-09-19T09:18:13.184190+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:18:13.184190+0000","last_undegraded":"2024-09-19T09:18:13.184190+0000","last_fullsized":"2024-09-19T09:18:13.184190+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.965388+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:17:58.965388+0000","last_peered":"2024-09-19T09:17:58.965388+0000","last_clean":"2024-09-19T09:17:58.965388+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:17:58.965388+0000","last_undegraded":"2024-09-19T09:17:58.965388+0000","last_fullsized":"2024-09-19T09:17:58.965388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.740826+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:17:30.740826+0000","last_peered":"2024-09-19T09:17:30.740826+0000","last_clean":"2024-09-19T09:17:30.740826+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:17:30.740826+0000","last_undegraded":"2024-09-19T09:17:30.740826+0000","last_fullsized":"2024-09-19T09:17:30.740826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.699545+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:17:30.699545+0000","last_peered":"2024-09-19T09:17:30.699545+0000","last_clean":"2024-09-19T09:17:30.699545+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:17:30.699545+0000","last_undegraded":"2024-09-19T09:17:30.699545+0000","last_fullsized":"2024-09-19T09:17:30.699545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970622+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:17:58.970622+0000","last_peered":"2024-09-19T09:17:58.970622+0000","last_clean":"2024-09-19T09:17:58.970622+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:17:58.970622+0000","last_undegraded":"2024-09-19T09:17:58.970622+0000","last_fullsized":"2024-09-19T09:17:58.970622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701519+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:17:30.701519+0000","last_peered":"2024-09-19T09:17:30.701519+0000","last_clean":"2024-09-19T09:17:30.701519+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:17:30.701519+0000","last_undegraded":"2024-09-19T09:17:30.701519+0000","last_fullsized":"2024-09-19T09:17:30.701519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970260+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:17:58.970260+0000","last_peered":"2024-09-19T09:17:58.970260+0000","last_clean":"2024-09-19T09:17:58.970260+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:17:58.970260+0000","last_undegraded":"2024-09-19T09:17:58.970260+0000","last_fullsized":"2024-09-19T09:17:58.970260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'6","reported_seq":230,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:16.187198+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:18:16.187198+0000","last_peered":"2024-09-19T09:18:16.187198+0000","last_clean":"2024-09-19T09:18:16.187198+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:18:16.187198+0000","last_undegraded":"2024-09-19T09:18:16.187198+0000","last_fullsized":"2024-09-19T09:18:16.187198+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.976566+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:17:58.976566+0000","last_peered":"2024-09-19T09:17:58.976566+0000","last_clean":"2024-09-19T09:17:58.976566+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:17:58.976566+0000","last_undegraded":"2024-09-19T09:17:58.976566+0000","last_fullsized":"2024-09-19T09:17:58.976566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701780+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:17:30.701780+0000","last_peered":"2024-09-19T09:17:30.701780+0000","last_clean":"2024-09-19T09:17:30.701780+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:17:30.701780+0000","last_undegraded":"2024-09-19T09:17:30.701780+0000","last_fullsized":"2024-09-19T09:17:30.701780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979267+0000","last_change":"2024-09-19T09:17:30.711986+0000","last_active":"2024-09-19T09:17:58.979267+0000","last_peered":"2024-09-19T09:17:58.979267+0000","last_clean":"2024-09-19T09:17:58.979267+0000","last_became_active":"2024-09-19T09:17:30.711751+0000","last_became_peered":"2024-09-19T09:17:30.711751+0000","last_unstale":"2024-09-19T09:17:58.979267+0000","last_undegraded":"2024-09-19T09:17:58.979267+0000","last_fullsized":"2024-09-19T09:17:58.979267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:18.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701396+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:17:30.701396+0000","last_peered":"2024-09-19T09:17:30.701396+0000","last_clean":"2024-09-19T09:17:30.701396+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:17:30.701396+0000","last_undegraded":"2024-09-19T09:17:30.701396+0000","last_fullsized":"2024-09-19T09:17:30.701396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979992+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:17:58.979992+0000","last_peered":"2024-09-19T09:17:58.979992+0000","last_clean":"2024-09-19T09:17:58.979992+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:17:58.979992+0000","last_undegraded":"2024-09-19T09:17:58.979992+0000","last_fullsized":"2024-09-19T09:17:58.979992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":273,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:16.187739+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:18:16.187739+0000","last_peered":"2024-09-19T09:18:16.187739+0000","last_clean":"2024-09-19T09:18:16.187739+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:18:16.187739+0000","last_undegraded":"2024-09-19T09:18:16.187739+0000","last_fullsized":"2024-09-19T09:18:16.187739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66043,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":214,"num_read_kb":171,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967581+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:17:58.967581+0000","last_peered":"2024-09-19T09:17:58.967581+0000","last_clean":"2024-09-19T09:17:58.967581+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:17:58.967581+0000","last_undegraded":"2024-09-19T09:17:58.967581+0000","last_fullsized":"2024-09-19T09:17:58.967581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701982+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:17:30.701982+0000","last_peered":"2024-09-19T09:17:30.701982+0000","last_clean":"2024-09-19T09:17:30.701982+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:17:30.701982+0000","last_undegraded":"2024-09-19T09:17:30.701982+0000","last_fullsized":"2024-09-19T09:17:30.701982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956062+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:17:58.956062+0000","last_peered":"2024-09-19T09:17:58.956062+0000","last_clean":"2024-09-19T09:17:58.956062+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:17:58.956062+0000","last_undegraded":"2024-09-19T09:17:58.956062+0000","last_fullsized":"2024-09-19T09:17:58.956062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701288+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:17:30.701288+0000","last_peered":"2024-09-19T09:17:30.701288+0000","last_clean":"2024-09-19T09:17:30.701288+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:17:30.701288+0000","last_undegraded":"2024-09-19T09:17:30.701288+0000","last_fullsized":"2024-09-19T09:17:30.701288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.971893+0000","last_change":"2024-09-19T09:17:30.706308+0000","last_active":"2024-09-19T09:17:58.971893+0000","last_peered":"2024-09-19T09:17:58.971893+0000","last_clean":"2024-09-19T09:17:58.971893+0000","last_became_active":"2024-09-19T09:17:30.705841+0000","last_became_peered":"2024-09-19T09:17:30.705841+0000","last_unstale":"2024-09-19T09:17:58.971893+0000","last_undegraded":"2024-09-19T09:17:58.971893+0000","last_fullsized":"2024-09-19T09:17:58.971893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.183394+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:18:13.183394+0000","last_peered":"2024-09-19T09:18:13.183394+0000","last_clean":"2024-09-19T09:18:13.183394+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:18:13.183394+0000","last_undegraded":"2024-09-19T09:18:13.183394+0000","last_fullsized":"2024-09-19T09:18:13.183394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969899+0000","last_change":"2024-09-19T09:17:30.742259+0000","last_active":"2024-09-19T09:17:58.969899+0000","last_peered":"2024-09-19T09:17:58.969899+0000","last_clean":"2024-09-19T09:17:58.969899+0000","last_became_active":"2024-09-19T09:17:30.741880+0000","last_became_peered":"2024-09-19T09:17:30.741880+0000","last_unstale":"2024-09-19T09:17:58.969899+0000","last_undegraded":"2024-09-19T09:17:58.969899+0000","last_fullsized":"2024-09-19T09:17:58.969899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:33.736292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706370+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:17:30.706370+0000","last_peered":"2024-09-19T09:17:30.706370+0000","last_clean":"2024-09-19T09:17:30.706370+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:17:30.706370+0000","last_undegraded":"2024-09-19T09:17:30.706370+0000","last_fullsized":"2024-09-19T09:17:30.706370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.974073+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:17:58.974073+0000","last_peered":"2024-09-19T09:17:58.974073+0000","last_clean":"2024-09-19T09:17:58.974073+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:17:58.974073+0000","last_undegraded":"2024-09-19T09:17:58.974073+0000","last_fullsized":"2024-09-19T09:17:58.974073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.716217+0000","last_change":"2024-09-19T09:17:30.715839+0000","last_active":"2024-09-19T09:17:30.716217+0000","last_peered":"2024-09-19T09:17:30.716217+0000","last_clean":"2024-09-19T09:17:30.716217+0000","last_became_active":"2024-09-19T09:17:30.707470+0000","last_became_peered":"2024-09-19T09:17:30.707470+0000","last_unstale":"2024-09-19T09:17:30.716217+0000","last_undegraded":"2024-09-19T09:17:30.716217+0000","last_fullsized":"2024-09-19T09:17:30.716217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.090063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969162+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:17:58.969162+0000","last_peered":"2024-09-19T09:17:58.969162+0000","last_clean":"2024-09-19T09:17:58.969162+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:17:58.969162+0000","last_undegraded":"2024-09-19T09:17:58.969162+0000","last_fullsized":"2024-09-19T09:17:58.969162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.719006+0000","last_change":"2024-09-19T09:17:30.719006+0000","last_active":"2024-09-19T09:17:30.719006+0000","last_peered":"2024-09-19T09:17:30.719006+0000","last_clean":"2024-09-19T09:17:30.719006+0000","last_became_active":"2024-09-19T09:17:30.709645+0000","last_became_peered":"2024-09-19T09:17:30.709645+0000","last_unstale":"2024-09-19T09:17:30.719006+0000","last_undegraded":"2024-09-19T09:17:30.719006+0000","last_fullsized":"2024-09-19T09:17:30.719006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:41.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977582+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:17:58.977582+0000","last_peered":"2024-09-19T09:17:58.977582+0000","last_clean":"2024-09-19T09:17:58.977582+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:17:58.977582+0000","last_undegraded":"2024-09-19T09:17:58.977582+0000","last_fullsized":"2024-09-19T09:17:58.977582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701511+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:17:30.701511+0000","last_peered":"2024-09-19T09:17:30.701511+0000","last_clean":"2024-09-19T09:17:30.701511+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:17:30.701511+0000","last_undegraded":"2024-09-19T09:17:30.701511+0000","last_fullsized":"2024-09-19T09:17:30.701511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968174+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:17:58.968174+0000","last_peered":"2024-09-19T09:17:58.968174+0000","last_clean":"2024-09-19T09:17:58.968174+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:17:58.968174+0000","last_undegraded":"2024-09-19T09:17:58.968174+0000","last_fullsized":"2024-09-19T09:17:58.968174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":132,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:13.183679+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:18:13.183679+0000","last_peered":"2024-09-19T09:18:13.183679+0000","last_clean":"2024-09-19T09:18:13.183679+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:18:13.183679+0000","last_undegraded":"2024-09-19T09:18:13.183679+0000","last_fullsized":"2024-09-19T09:18:13.183679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980166+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:17:58.980166+0000","last_peered":"2024-09-19T09:17:58.980166+0000","last_clean":"2024-09-19T09:17:58.980166+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:17:58.980166+0000","last_undegraded":"2024-09-19T09:17:58.980166+0000","last_fullsized":"2024-09-19T09:17:58.980166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702339+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:17:30.702339+0000","last_peered":"2024-09-19T09:17:30.702339+0000","last_clean":"2024-09-19T09:17:30.702339+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:17:30.702339+0000","last_undegraded":"2024-09-19T09:17:30.702339+0000","last_fullsized":"2024-09-19T09:17:30.702339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.707109+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:17:30.707109+0000","last_peered":"2024-09-19T09:17:30.707109+0000","last_clean":"2024-09-19T09:17:30.707109+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:17:30.707109+0000","last_undegraded":"2024-09-19T09:17:30.707109+0000","last_fullsized":"2024-09-19T09:17:30.707109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977434+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:17:58.977434+0000","last_peered":"2024-09-19T09:17:58.977434+0000","last_clean":"2024-09-19T09:17:58.977434+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:17:58.977434+0000","last_undegraded":"2024-09-19T09:17:58.977434+0000","last_fullsized":"2024-09-19T09:17:58.977434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702100+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:17:30.702100+0000","last_peered":"2024-09-19T09:17:30.702100+0000","last_clean":"2024-09-19T09:17:30.702100+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:17:30.702100+0000","last_undegraded":"2024-09-19T09:17:30.702100+0000","last_fullsized":"2024-09-19T09:17:30.702100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961956+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:17:58.961956+0000","last_peered":"2024-09-19T09:17:58.961956+0000","last_clean":"2024-09-19T09:17:58.961956+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.961956+0000","last_undegraded":"2024-09-19T09:17:58.961956+0000","last_fullsized":"2024-09-19T09:17:58.961956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:14.184089+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:18:14.184089+0000","last_peered":"2024-09-19T09:18:14.184089+0000","last_clean":"2024-09-19T09:18:14.184089+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:18:14.184089+0000","last_undegraded":"2024-09-19T09:18:14.184089+0000","last_fullsized":"2024-09-19T09:18:14.184089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963278+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:17:58.963278+0000","last_peered":"2024-09-19T09:17:58.963278+0000","last_clean":"2024-09-19T09:17:58.963278+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:17:58.963278+0000","last_undegraded":"2024-09-19T09:17:58.963278+0000","last_fullsized":"2024-09-19T09:17:58.963278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'8","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:14.185454+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:18:14.185454+0000","last_peered":"2024-09-19T09:18:14.185454+0000","last_clean":"2024-09-19T09:18:14.185454+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:18:14.185454+0000","last_undegraded":"2024-09-19T09:18:14.185454+0000","last_fullsized":"2024-09-19T09:18:14.185454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967435+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:17:58.967435+0000","last_peered":"2024-09-19T09:17:58.967435+0000","last_clean":"2024-09-19T09:17:58.967435+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:17:58.967435+0000","last_undegraded":"2024-09-19T09:17:58.967435+0000","last_fullsized":"2024-09-19T09:17:58.967435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.704404+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:17:30.704404+0000","last_peered":"2024-09-19T09:17:30.704404+0000","last_clean":"2024-09-19T09:17:30.704404+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:17:30.704404+0000","last_undegraded":"2024-09-19T09:17:30.704404+0000","last_fullsized":"2024-09-19T09:17:30.704404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970687+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:17:58.970687+0000","last_peered":"2024-09-19T09:17:58.970687+0000","last_clean":"2024-09-19T09:17:58.970687+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:17:58.970687+0000","last_undegraded":"2024-09-19T09:17:58.970687+0000","last_fullsized":"2024-09-19T09:17:58.970687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706919+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:17:30.706919+0000","last_peered":"2024-09-19T09:17:30.706919+0000","last_clean":"2024-09-19T09:17:30.706919+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:17:30.706919+0000","last_undegraded":"2024-09-19T09:17:30.706919+0000","last_fullsized":"2024-09-19T09:17:30.706919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.962302+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:17:58.962302+0000","last_peered":"2024-09-19T09:17:58.962302+0000","last_clean":"2024-09-19T09:17:58.962302+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:17:58.962302+0000","last_undegraded":"2024-09-19T09:17:58.962302+0000","last_fullsized":"2024-09-19T09:17:58.962302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:59.005140+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:17:59.005140+0000","last_peered":"2024-09-19T09:17:59.005140+0000","last_clean":"2024-09-19T09:17:59.005140+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:17:59.005140+0000","last_undegraded":"2024-09-19T09:17:59.005140+0000","last_fullsized":"2024-09-19T09:17:59.005140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970983+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:17:58.970983+0000","last_peered":"2024-09-19T09:17:58.970983+0000","last_clean":"2024-09-19T09:17:58.970983+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:17:58.970983+0000","last_undegraded":"2024-09-19T09:17:58.970983+0000","last_fullsized":"2024-09-19T09:17:58.970983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706710+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:17:30.706710+0000","last_peered":"2024-09-19T09:17:30.706710+0000","last_clean":"2024-09-19T09:17:30.706710+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:17:30.706710+0000","last_undegraded":"2024-09-19T09:17:30.706710+0000","last_fullsized":"2024-09-19T09:17:30.706710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979125+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:17:58.979125+0000","last_peered":"2024-09-19T09:17:58.979125+0000","last_clean":"2024-09-19T09:17:58.979125+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:17:58.979125+0000","last_undegraded":"2024-09-19T09:17:58.979125+0000","last_fullsized":"2024-09-19T09:17:58.979125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.700552+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:17:30.700552+0000","last_peered":"2024-09-19T09:17:30.700552+0000","last_clean":"2024-09-19T09:17:30.700552+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:17:30.700552+0000","last_undegraded":"2024-09-19T09:17:30.700552+0000","last_fullsized":"2024-09-19T09:17:30.700552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.933118+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:17:58.933118+0000","last_peered":"2024-09-19T09:17:58.933118+0000","last_clean":"2024-09-19T09:17:58.933118+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:17:58.933118+0000","last_undegraded":"2024-09-19T09:17:58.933118+0000","last_fullsized":"2024-09-19T09:17:58.933118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702269+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:17:30.702269+0000","last_peered":"2024-09-19T09:17:30.702269+0000","last_clean":"2024-09-19T09:17:30.702269+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:17:30.702269+0000","last_undegraded":"2024-09-19T09:17:30.702269+0000","last_fullsized":"2024-09-19T09:17:30.702269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975139+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:17:58.975139+0000","last_peered":"2024-09-19T09:17:58.975139+0000","last_clean":"2024-09-19T09:17:58.975139+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:17:58.975139+0000","last_undegraded":"2024-09-19T09:17:58.975139+0000","last_fullsized":"2024-09-19T09:17:58.975139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.722791+0000","last_change":"2024-09-19T09:17:30.722376+0000","last_active":"2024-09-19T09:17:30.722791+0000","last_peered":"2024-09-19T09:17:30.722791+0000","last_clean":"2024-09-19T09:17:30.722791+0000","last_became_active":"2024-09-19T09:17:30.709277+0000","last_became_peered":"2024-09-19T09:17:30.709277+0000","last_unstale":"2024-09-19T09:17:30.722791+0000","last_undegraded":"2024-09-19T09:17:30.722791+0000","last_fullsized":"2024-09-19T09:17:30.722791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.341264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980029+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:17:58.980029+0000","last_peered":"2024-09-19T09:17:58.980029+0000","last_clean":"2024-09-19T09:17:58.980029+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:17:58.980029+0000","last_undegraded":"2024-09-19T09:17:58.980029+0000","last_fullsized":"2024-09-19T09:17:58.980029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706536+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:17:30.706536+0000","last_peered":"2024-09-19T09:17:30.706536+0000","last_clean":"2024-09-19T09:17:30.706536+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:17:30.706536+0000","last_undegraded":"2024-09-19T09:17:30.706536+0000","last_fullsized":"2024-09-19T09:17:30.706536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979969+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:17:58.979969+0000","last_peered":"2024-09-19T09:17:58.979969+0000","last_clean":"2024-09-19T09:17:58.979969+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:17:58.979969+0000","last_undegraded":"2024-09-19T09:17:58.979969+0000","last_fullsized":"2024-09-19T09:17:58.979969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980085+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:17:58.980085+0000","last_peered":"2024-09-19T09:17:58.980085+0000","last_clean":"2024-09-19T09:17:58.980085+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:17:58.980085+0000","last_undegraded":"2024-09-19T09:17:58.980085+0000","last_fullsized":"2024-09-19T09:17:58.980085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706809+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:17:30.706809+0000","last_peered":"2024-09-19T09:17:30.706809+0000","last_clean":"2024-09-19T09:17:30.706809+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:17:30.706809+0000","last_undegraded":"2024-09-19T09:17:30.706809+0000","last_fullsized":"2024-09-19T09:17:30.706809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975767+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:17:58.975767+0000","last_peered":"2024-09-19T09:17:58.975767+0000","last_clean":"2024-09-19T09:17:58.975767+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:17:58.975767+0000","last_undegraded":"2024-09-19T09:17:58.975767+0000","last_fullsized":"2024-09-19T09:17:58.975767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'13","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706829+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:17:30.706829+0000","last_peered":"2024-09-19T09:17:30.706829+0000","last_clean":"2024-09-19T09:17:30.706829+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:17:30.706829+0000","last_undegraded":"2024-09-19T09:17:30.706829+0000","last_fullsized":"2024-09-19T09:17:30.706829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981137+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:17:58.981137+0000","last_peered":"2024-09-19T09:17:58.981137+0000","last_clean":"2024-09-19T09:17:58.981137+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:17:58.981137+0000","last_undegraded":"2024-09-19T09:17:58.981137+0000","last_fullsized":"2024-09-19T09:17:58.981137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702907+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:17:30.702907+0000","last_peered":"2024-09-19T09:17:30.702907+0000","last_clean":"2024-09-19T09:17:30.702907+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:17:30.702907+0000","last_undegraded":"2024-09-19T09:17:30.702907+0000","last_fullsized":"2024-09-19T09:17:30.702907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966920+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:17:58.966920+0000","last_peered":"2024-09-19T09:17:58.966920+0000","last_clean":"2024-09-19T09:17:58.966920+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:17:58.966920+0000","last_undegraded":"2024-09-19T09:17:58.966920+0000","last_fullsized":"2024-09-19T09:17:58.966920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:15.185984+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:18:15.185984+0000","last_peered":"2024-09-19T09:18:15.185984+0000","last_clean":"2024-09-19T09:18:15.185984+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:18:15.185984+0000","last_undegraded":"2024-09-19T09:18:15.185984+0000","last_fullsized":"2024-09-19T09:18:15.185984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74375,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1050,"num_read_kb":610,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514532,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":448245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1104761,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939695,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":447975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":1041500,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":448178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1040336,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":447197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215180,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":515580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":515134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:18:18.892 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:19.183 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:19.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:18 smithi115 ceph-mon[35055]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:18:19.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:18 smithi046 ceph-mon[31203]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:18:19.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:18 smithi099 ceph-mon[35256]: pgmap v338: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T09:18:19.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 -- 172.21.15.46:0/2930883696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 msgr2=0x7f32c41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 --2- 172.21.15.46:0/2930883696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c41067e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009900 tx=0x7f32b802a410 comp rx=0 tx=0).stop 2024-09-19T09:18:19.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 -- 172.21.15.46:0/2930883696 shutdown_connections 2024-09-19T09:18:19.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 --2- 172.21.15.46:0/2930883696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c41067e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 --2- 172.21.15.46:0/2930883696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c4106f10 0x7f32c410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 --2- 172.21.15.46:0/2930883696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 0x7f32c41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 -- 172.21.15.46:0/2930883696 >> 172.21.15.46:0/2930883696 conn(0x7f32c40fd8c0 msgr2=0x7f32c40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.630+0000 7f32cb30b640 1 -- 172.21.15.46:0/2930883696 shutdown_connections 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.631+0000 7f32cb30b640 1 -- 172.21.15.46:0/2930883696 wait complete. 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.631+0000 7f32cb30b640 1 Processor -- start 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.631+0000 7f32cb30b640 1 -- start start 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32cb30b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 0x7f32c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32cb30b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32cb30b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c4106f10 0x7f32c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32cb30b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4111f70 con 0x7f32c4102790 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32cb30b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f32c4111df0 con 0x7f32c4101de0 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32cb30b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f32c41120f0 con 0x7f32c4106f10 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33832/0 (socket says 172.21.15.46:33832) 2024-09-19T09:18:19.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 -- 172.21.15.46:0/1833468511 learned_addr learned my addr 172.21.15.46:0/1833468511 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c90a7640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 0x7f32c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c98a8640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c4106f10 0x7f32c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 -- 172.21.15.46:0/1833468511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c4106f10 msgr2=0x7f32c4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c4106f10 0x7f32c4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 -- 172.21.15.46:0/1833468511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 msgr2=0x7f32c40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 0x7f32c40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 -- 172.21.15.46:0/1833468511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c41a6900 con 0x7f32c4102790 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c90a7640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 0x7f32c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32c88a6640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c4074a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.632+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b803f030 con 0x7f32c4102790 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.633+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b8003ce0 con 0x7f32c4102790 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.633+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c41a6b90 con 0x7f32c4102790 2024-09-19T09:18:19.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.633+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b8035070 con 0x7f32c4102790 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.633+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c41a70c0 con 0x7f32c4102790 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.634+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c41021c0 con 0x7f32c4102790 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.635+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f32b8042030 con 0x7f32c4102790 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.636+0000 7f32b67fc640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f32b00a32c0 0x7f32b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.636+0000 7f32c90a7640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f32b00a32c0 0x7f32b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.636+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f32b80efcf0 con 0x7f32c4102790 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.636+0000 7f32c90a7640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f32b00a32c0 0x7f32b00a5780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f32c000bfd0 tx=0x7f32c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.640+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32b80f4070 con 0x7f32c4102790 2024-09-19T09:18:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.852+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32c4109b60 con 0x7f32c4102790 2024-09-19T09:18:19.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.853+0000 7f32b67fc640 1 -- 172.21.15.46:0/1833468511 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f32b80bc4b0 con 0x7f32c4102790 2024-09-19T09:18:19.854 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:19.854 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:18:19.854 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:18:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f32b00a32c0 msgr2=0x7f32b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f32b00a32c0 0x7f32b00a5780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f32c000bfd0 tx=0x7f32c000b390 comp rx=0 tx=0).stop 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 msgr2=0x7f32c4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c4074a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006010 tx=0x7f32b80042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 shutdown_connections 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f32b00a32c0 0x7f32b00a5780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32c4102790 0x7f32c4074a30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32c4106f10 0x7f32c4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 --2- 172.21.15.46:0/1833468511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c4101de0 0x7f32c40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 >> 172.21.15.46:0/1833468511 conn(0x7f32c40fd8c0 msgr2=0x7f32c40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 shutdown_connections 2024-09-19T09:18:19.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:19.855+0000 7f32cb30b640 1 -- 172.21.15.46:0/1833468511 wait complete. 2024-09-19T09:18:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:19 smithi046 ceph-mon[31203]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:19 smithi046 ceph-mon[31203]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:19.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:19 smithi046 ceph-mon[31203]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:19 smithi115 ceph-mon[35055]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:19 smithi115 ceph-mon[35055]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:19 smithi115 ceph-mon[35055]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:19 smithi099 ceph-mon[35256]: from='client.15234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:19 smithi099 ceph-mon[35256]: from='client.15240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:19 smithi099 ceph-mon[35256]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:20.644 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:18:20.904 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:20 smithi046 ceph-mon[31203]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-19T09:18:20.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:20 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1833468511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:21.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:20 smithi115 ceph-mon[35055]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-19T09:18:21.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:20 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1833468511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:21.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:20 smithi099 ceph-mon[35256]: pgmap v339: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-19T09:18:21.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:20 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1833468511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 -- 172.21.15.46:0/618707055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 msgr2=0x7fa20c100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 --2- 172.21.15.46:0/618707055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c100d90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa204009900 tx=0x7fa20402a410 comp rx=0 tx=0).stop 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 -- 172.21.15.46:0/618707055 shutdown_connections 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 --2- 172.21.15.46:0/618707055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 0x7fa20c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 --2- 172.21.15.46:0/618707055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c101360 0x7fa20c10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 --2- 172.21.15.46:0/618707055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c100d90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 -- 172.21.15.46:0/618707055 >> 172.21.15.46:0/618707055 conn(0x7fa20c0fc7d0 msgr2=0x7fa20c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 -- 172.21.15.46:0/618707055 shutdown_connections 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 -- 172.21.15.46:0/618707055 wait complete. 2024-09-19T09:18:21.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.378+0000 7fa2146e4640 1 Processor -- start 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 -- start start 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c101360 0x7fa20c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 0x7fa20c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c114210 con 0x7fa20c1009b0 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c114090 con 0x7fa20c10e4d0 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa2146e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c114390 con 0x7fa20c101360 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33854/0 (socket says 172.21.15.46:33854) 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 -- 172.21.15.46:0/796285183 learned_addr learned my addr 172.21.15.46:0/796285183 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa211c7f640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c101360 0x7fa20c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212c81640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 0x7fa20c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 -- 172.21.15.46:0/796285183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c101360 msgr2=0x7fa20c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c101360 0x7fa20c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 -- 172.21.15.46:0/796285183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 msgr2=0x7fa20c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 0x7fa20c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 -- 172.21.15.46:0/796285183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c19f6a0 con 0x7fa20c1009b0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212c81640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 0x7fa20c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.379+0000 7fa212480640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c19a6f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa204006010 tx=0x7fa2040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.380+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa20403f030 con 0x7fa20c1009b0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.380+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa204003ce0 con 0x7fa20c1009b0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.380+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c19f930 con 0x7fa20c1009b0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.380+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204035070 con 0x7fa20c1009b0 2024-09-19T09:18:21.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.380+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20c1a7270 con 0x7fa20c1009b0 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.381+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20c06a7f0 con 0x7fa20c1009b0 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.382+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa204042030 con 0x7fa20c1009b0 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.383+0000 7fa20b7fe640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa1f40a32c0 0x7fa1f40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.383+0000 7fa211c7f640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa1f40a32c0 0x7fa1f40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.383+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa2040efed0 con 0x7fa20c1009b0 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.383+0000 7fa211c7f640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa1f40a32c0 0x7fa1f40a5780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa20c10e980 tx=0x7fa20000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:21.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.387+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2040bcc80 con 0x7fa20c1009b0 2024-09-19T09:18:21.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.565+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa20c109660 con 0x7fa20c1009b0 2024-09-19T09:18:21.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.567+0000 7fa20b7fe640 1 -- 172.21.15.46:0/796285183 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22631 (secure 0 0 0) 0x7fa2040bc580 con 0x7fa20c1009b0 2024-09-19T09:18:21.568 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:21.568 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:17:30.696589+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa1f40a32c0 msgr2=0x7fa1f40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa1f40a32c0 0x7fa1f40a5780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa20c10e980 tx=0x7fa20000b390 comp rx=0 tx=0).stop 2024-09-19T09:18:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 msgr2=0x7fa20c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c19a6f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa204006010 tx=0x7fa2040042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 shutdown_connections 2024-09-19T09:18:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa1f40a32c0 0x7fa1f40a5780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c10e4d0 0x7fa20c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa20c101360 0x7fa20c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 --2- 172.21.15.46:0/796285183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa20c1009b0 0x7fa20c19a6f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 >> 172.21.15.46:0/796285183 conn(0x7fa20c0fc7d0 msgr2=0x7fa20c10f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 shutdown_connections 2024-09-19T09:18:21.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:21.570+0000 7fa2146e4640 1 -- 172.21.15.46:0/796285183 wait complete. 2024-09-19T09:18:22.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:21 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/796285183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:21 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/796285183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:22.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:21 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/796285183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:22.343 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T09:18:22.343 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T09:18:22.354 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:18:22.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T09:18:22.354 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T09:18:22.354 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:18:22.355 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:18:22.357 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T09:18:22.378 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:18:22.378 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:18:22.623 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:22.645 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:22.912 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:22 smithi046 ceph-mon[31203]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:18:23.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:22 smithi115 ceph-mon[35055]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:18:23.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:22 smithi099 ceph-mon[35256]: pgmap v340: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:18:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.394+0000 7f0b05388640 1 -- 172.21.15.46:0/3420197869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 msgr2=0x7f0b00104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.394+0000 7f0b05388640 1 --2- 172.21.15.46:0/3420197869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b00104e80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0af400aa10 tx=0x7f0af402b720 comp rx=0 tx=0).stop 2024-09-19T09:18:23.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 -- 172.21.15.46:0/3420197869 shutdown_connections 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 --2- 172.21.15.46:0/3420197869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b00104e80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 --2- 172.21.15.46:0/3420197869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001055b0 0x7f0b0010d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 --2- 172.21.15.46:0/3420197869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b00100480 0x7f0b00100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 -- 172.21.15.46:0/3420197869 >> 172.21.15.46:0/3420197869 conn(0x7f0b00077210 msgr2=0x7f0b000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 -- 172.21.15.46:0/3420197869 shutdown_connections 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 -- 172.21.15.46:0/3420197869 wait complete. 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.395+0000 7f0b05388640 1 Processor -- start 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 -- start start 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b00100480 0x7f0b00196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b001968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001055b0 0x7f0b0019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0010fd90 con 0x7f0b00100e30 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0010fc10 con 0x7f0b001055b0 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0b05388640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0010ff10 con 0x7f0b00100480 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b001968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b001968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33884/0 (socket says 172.21.15.46:33884) 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 -- 172.21.15.46:0/569728288 learned_addr learned my addr 172.21.15.46:0/569728288 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001055b0 0x7f0b0019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afeffd640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b00100480 0x7f0b00196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 -- 172.21.15.46:0/569728288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b00100480 msgr2=0x7f0b00196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b00100480 0x7f0b00196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 -- 172.21.15.46:0/569728288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001055b0 msgr2=0x7f0b0019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001055b0 0x7f0b0019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.396+0000 7f0afe7fc640 1 -- 172.21.15.46:0/569728288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0019b340 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.397+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b001968d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0af4006010 tx=0x7f0af40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.397+0000 7f0ae7fff640 1 -- 172.21.15.46:0/569728288 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4040070 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.397+0000 7f0ae7fff640 1 -- 172.21.15.46:0/569728288 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af403c460 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.397+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0019b5d0 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.397+0000 7f0ae7fff640 1 -- 172.21.15.46:0/569728288 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4036030 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.397+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b001a2f10 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.399+0000 7f0ae7fff640 1 -- 172.21.15.46:0/569728288 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0af4043070 con 0x7f0b00100e30 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 Processor -- start 2024-09-19T09:18:23.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 -- start start 2024-09-19T09:18:23.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b0edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b1ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b1e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556826a74280 con 0x556826b0e9e0 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556826a1bb10 con 0x556826b1bf50 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0b07761740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556826a70240 con 0x556826b0f300 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0ae7fff640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ae80a32c0 0x7f0ae80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b0edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b0edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33892/0 (socket says 172.21.15.46:33892) 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 -- 172.21.15.46:0/1785426315 learned_addr learned my addr 172.21.15.46:0/1785426315 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ae80a32c0 0x7f0ae80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0afeffd640 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b1ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0ae7fff640 1 -- 172.21.15.46:0/569728288 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0af40f1260 con 0x7f0b00100e30 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b1e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 -- 172.21.15.46:0/1785426315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 msgr2=0x556826b1ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b1ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 -- 172.21.15.46:0/1785426315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 msgr2=0x556826b1e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b1e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.400+0000 7f0aff7fe640 1 -- 172.21.15.46:0/1785426315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556826a281f0 con 0x556826b0e9e0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.401+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b0edc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0af8012d00 tx=0x7f0af8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d733e77bc83343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.401+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ae80a32c0 0x7f0ae80a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0af8010c40 tx=0x7f0af8017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.401+0000 7f0ae57fa640 1 -- 172.21.15.46:0/1785426315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8024070 con 0x556826b0e9e0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.401+0000 7f0ae57fa640 1 -- 172.21.15.46:0/1785426315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af8012520 con 0x556826b0e9e0 2024-09-19T09:18:23.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.401+0000 7f0ae57fa640 1 -- 172.21.15.46:0/1785426315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8005280 con 0x556826b0e9e0 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 -- 172.21.15.46:0/1785426315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 msgr2=0x556826b0edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b0edc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0af8012d00 tx=0x7f0af8010740 comp rx=0 tx=0).stop 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 -- 172.21.15.46:0/1785426315 shutdown_connections 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b1e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b1ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 --2- 172.21.15.46:0/1785426315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b0edc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 -- 172.21.15.46:0/1785426315 >> 172.21.15.46:0/1785426315 conn(0x556826b0b0f0 msgr2=0x556826b0b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 -- 172.21.15.46:0/1785426315 shutdown_connections 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 -- 172.21.15.46:0/1785426315 wait complete. 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 -- start start 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.402+0000 7f0b07761740 1 Processor -- start 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b1b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b16d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b17440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556826b1eb20 con 0x556826b0e9e0 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556826a2ef10 con 0x556826b1bf50 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556826b1eca0 con 0x556826b0f300 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0b07761740 10 client.0 _ll_register_callbacks cb 0x5568269f7a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b16d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b16d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:54902/0 (socket says 172.21.15.46:54902) 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0afe7fc640 1 -- 172.21.15.46:0/3199439778 learned_addr learned my addr 172.21.15.46:0/3199439778 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b17440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0afeffd640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b1b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0aff7fe640 1 -- 172.21.15.46:0/3199439778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 msgr2=0x556826b16d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b16d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0aff7fe640 1 -- 172.21.15.46:0/3199439778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 msgr2=0x556826b1b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.403+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b1b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0aff7fe640 1 -- 172.21.15.46:0/3199439778 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568267e56a0 con 0x556826b1bf50 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b17440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0af8004980 tx=0x7f0af8009fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c9aa02924dda0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0ae2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/3199439778 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af802e070 con 0x556826b1bf50 2024-09-19T09:18:23.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af8012520 con 0x556826b1bf50 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/3199439778 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0af8005700 con 0x556826b1bf50 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/3199439778 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0af8024040 con 0x556826b1bf50 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0b07761740 10 client.24908 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556826b30e90 con 0x556826b1bf50 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.404+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/3199439778 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af8012520 con 0x556826b1bf50 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/3199439778 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0af8020430 con 0x556826b1bf50 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0b07761740 10 client.24908 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0b07761740 10 client.24908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0b07761740 20 client.24908 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0b07761740 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b322a0 0x556826b34690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0b07761740 4 client.24908 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556826a817f0 con 0x556826b322a0 2024-09-19T09:18:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0afeffd640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b322a0 0x556826b34690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0ae2ff5640 10 client.24908 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.405+0000 7f0afeffd640 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b322a0 0x556826b34690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5ae56605a9b7302 server_cookie=1f5b7a5ce010a00 in_seq=0 out_seq=0 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.406+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/3199439778 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556826a817f0 con 0x556826b322a0 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.406+0000 7f0ae2ff5640 10 client.24908 handle_command_reply: tid=0 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.406+0000 7f0b07761740 1 client.24908 shutdown 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 msgr2=0x556826b17440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b17440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0af8004980 tx=0x7f0af8009fb0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 shutdown_connections 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b322a0 0x556826b34690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b1bf50 0x556826b17440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b0f300 0x556826b16d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 --2- 172.21.15.46:0/3199439778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0e9e0 0x556826b1b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0ae2ff5640 0 client.24908 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 >> 172.21.15.46:0/3199439778 conn(0x556826b0b0f0 msgr2=0x556826b10db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 shutdown_connections 2024-09-19T09:18:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 1 -- 172.21.15.46:0/3199439778 wait complete. 2024-09-19T09:18:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.407+0000 7f0b07761740 20 client.24908 trim_cache size 0 max 16384 2024-09-19T09:18:23.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.424+0000 7f0b07761740 1 Processor -- start 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.424+0000 7f0b07761740 1 -- start start 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.424+0000 7f0b07761740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b0a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.424+0000 7f0b07761740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b39c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0b07761740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b3a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0b07761740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001ab2a0 con 0x556826b0f300 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0b07761740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001acde0 con 0x556826b0e9e0 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0b07761740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001ab970 con 0x556826b1bf50 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b39c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b0a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b39c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33904/0 (socket says 172.21.15.46:33904) 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afe7fc640 1 -- 172.21.15.46:0/996414411 learned_addr learned my addr 172.21.15.46:0/996414411 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b3a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 -- 172.21.15.46:0/996414411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 msgr2=0x556826b3a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b3a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 -- 172.21.15.46:0/996414411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 msgr2=0x556826b39c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b39c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 -- 172.21.15.46:0/996414411 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556826b34a00 con 0x556826b0e9e0 2024-09-19T09:18:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b39c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.425+0000 7f0afeffd640 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b0a160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x556826b1ec10 tx=0x7f0af0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408f2095e70d3488 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0ae4ff9640 1 -- 172.21.15.46:0/996414411 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0022070 con 0x556826b0e9e0 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0ae4ff9640 1 -- 172.21.15.46:0/996414411 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af00047a0 con 0x556826b0e9e0 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0ae4ff9640 1 -- 172.21.15.46:0/996414411 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af001e8d0 con 0x556826b0e9e0 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 -- 172.21.15.46:0/996414411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 msgr2=0x556826b0a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b0a160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x556826b1ec10 tx=0x7f0af0005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 -- 172.21.15.46:0/996414411 shutdown_connections 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b39c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b3a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 --2- 172.21.15.46:0/996414411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b0a160 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 -- 172.21.15.46:0/996414411 >> 172.21.15.46:0/996414411 conn(0x556826b0b0f0 msgr2=0x556826b09a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 -- 172.21.15.46:0/996414411 shutdown_connections 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.426+0000 7f0b07761740 1 -- 172.21.15.46:0/996414411 wait complete. 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 -- start start 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 Processor -- start 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b29ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b2a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b2a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001ac710 con 0x556826b0f300 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001ac040 con 0x556826b0e9e0 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001a92a0 con 0x556826b1bf50 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0b07761740 10 client.0 _ll_register_callbacks cb 0x7f0af00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b2a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b2a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33906/0 (socket says 172.21.15.46:33906) 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 -- 172.21.15.46:0/2028294511 learned_addr learned my addr 172.21.15.46:0/2028294511 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b2a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afeffd640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b29ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 -- 172.21.15.46:0/2028294511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 msgr2=0x556826b2a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b2a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 -- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 msgr2=0x556826b29ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b29ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0afe7fc640 1 -- 172.21.15.46:0/2028294511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556826b9be00 con 0x556826b0f300 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.427+0000 7f0aff7fe640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b2a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0afe7fc640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b2a400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0af40c5f90 tx=0x7f0af40bbe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece93b33d4ba7e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0ae2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:23.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/2028294511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af40d5020 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/2028294511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0af40b9f70 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af00047a0 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/2028294511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0af404a040 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 10 client.15276 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556826b9d1b0 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/2028294511 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af00047a0 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/2028294511 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0af400b040 con 0x556826b0f300 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 10 client.15276 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 10 client.15276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 20 client.15276 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b9d9b0 0x556826b9fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 4 client.15276 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:18:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.428+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556826a7bd00 con 0x556826b9d9b0 2024-09-19T09:18:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.429+0000 7f0afeffd640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b9d9b0 0x556826b9fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.429+0000 7f0afeffd640 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b9d9b0 0x556826b9fdd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=365f76171106a2b8 server_cookie=c9d14d5df11ad6ad in_seq=0 out_seq=0 2024-09-19T09:18:23.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.429+0000 7f0ae2ff5640 10 client.15276 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0ae2ff5640 1 -- 172.21.15.46:0/2028294511 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556826a7bd00 con 0x556826b9d9b0 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0ae2ff5640 10 client.15276 handle_command_reply: tid=0 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 client.15276 shutdown 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 msgr2=0x556826b2a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b2a400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0af40c5f90 tx=0x7f0af40bbe10 comp rx=0 tx=0).stop 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 shutdown_connections 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556826b9d9b0 0x556826b9fdd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556826b0f300 0x556826b2a400 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556826b1bf50 0x556826b2a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 --2- 172.21.15.46:0/2028294511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556826b0e9e0 0x556826b29ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 >> 172.21.15.46:0/2028294511 conn(0x556826b0b0f0 msgr2=0x556826b0a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0ae2ff5640 0 client.15276 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 shutdown_connections 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 1 -- 172.21.15.46:0/2028294511 wait complete. 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.430+0000 7f0b07761740 20 client.15276 trim_cache size 0 max 16384 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "af90782d-f316-4337-80f9-f278e275c354", 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-19T09:18:23.436 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ae80a32c0 msgr2=0x7f0ae80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ae80a32c0 0x7f0ae80a5780 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0af8010c40 tx=0x7f0af8017000 comp rx=0 tx=0).stop 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 msgr2=0x7f0b001968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b001968d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0af4006010 tx=0x7f0af40042f0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 shutdown_connections 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ae80a32c0 0x7f0ae80a5780 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b00100e30 0x7f0b001968d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b001055b0 0x7f0b0019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 --2- 172.21.15.46:0/569728288 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0b00100480 0x7f0b00196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 >> 172.21.15.46:0/569728288 conn(0x7f0b00077210 msgr2=0x7f0b000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 shutdown_connections 2024-09-19T09:18:23.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.431+0000 7f0b05388640 1 -- 172.21.15.46:0/569728288 wait complete. 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 -- 172.21.15.46:0/2786380999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be41002f0 msgr2=0x7f7be41006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2786380999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be41002f0 0x7f7be41006d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009930 tx=0x7f7bd402a420 comp rx=0 tx=0).stop 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 -- 172.21.15.46:0/2786380999 shutdown_connections 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2786380999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4106f50 0x7f7be410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2786380999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be4100ca0 0x7f7be4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2786380999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be41002f0 0x7f7be41006d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.660+0000 7f7bea48b640 1 -- 172.21.15.46:0/2786380999 >> 172.21.15.46:0/2786380999 conn(0x7f7be4077210 msgr2=0x7f7be40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 -- 172.21.15.46:0/2786380999 shutdown_connections 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 -- 172.21.15.46:0/2786380999 wait complete. 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 Processor -- start 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 -- start start 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be41002f0 0x7f7be4101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4100ca0 0x7f7be41017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 0x7f7be4101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4111fa0 con 0x7f7be4106f50 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4111e20 con 0x7f7be4100ca0 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7bea48b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4112120 con 0x7f7be41002f0 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.661+0000 7f7be8a28640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 0x7f7be4101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 0x7f7be4101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33930/0 (socket says 172.21.15.46:33930) 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 -- 172.21.15.46:0/2616228448 learned_addr learned my addr 172.21.15.46:0/2616228448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7bdbfff640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4100ca0 0x7f7be41017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be3fff640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be41002f0 0x7f7be4101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 -- 172.21.15.46:0/2616228448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be41002f0 msgr2=0x7f7be4101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be41002f0 0x7f7be4101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 -- 172.21.15.46:0/2616228448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4100ca0 msgr2=0x7f7be41017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4100ca0 0x7f7be41017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 -- 172.21.15.46:0/2616228448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be41a6980 con 0x7f7be4106f50 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be3fff640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be41002f0 0x7f7be4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be8a28640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 0x7f7be4101cf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00cce0 tx=0x7f7bdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00f450 con 0x7f7be4106f50 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be41a6c70 con 0x7f7be4106f50 2024-09-19T09:18:23.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bdc00fad0 con 0x7f7be4106f50 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc018c10 con 0x7f7be4106f50 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.662+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be41a7160 con 0x7f7be4106f50 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.663+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be41006d0 con 0x7f7be4106f50 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.665+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7bdc00f5f0 con 0x7f7be4106f50 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.666+0000 7f7be1ffb640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7bd00a3240 0x7f7bd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.666+0000 7f7be3fff640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7bd00a3240 0x7f7bd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.666+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7bdc0cff60 con 0x7f7be4106f50 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.666+0000 7f7be3fff640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7bd00a3240 0x7f7bd00a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4000c00 tx=0x7f7bd4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.669+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7bdc014030 con 0x7f7be4106f50 2024-09-19T09:18:23.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.843+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7be4062630 con 0x7f7bd00a3240 2024-09-19T09:18:23.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.849+0000 7f7be1ffb640 1 -- 172.21.15.46:0/2616228448 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258982 (secure 0 0 0) 0x7f7be4062630 con 0x7f7bd00a3240 2024-09-19T09:18:23.852 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:18:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7bd00a3240 msgr2=0x7f7bd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7bd00a3240 0x7f7bd00a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4000c00 tx=0x7f7bd4005a20 comp rx=0 tx=0).stop 2024-09-19T09:18:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 msgr2=0x7f7be4101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 0x7f7be4101cf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc00cce0 tx=0x7f7bdc00a620 comp rx=0 tx=0).stop 2024-09-19T09:18:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 shutdown_connections 2024-09-19T09:18:23.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7bd00a3240 0x7f7bd00a5700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7be4106f50 0x7f7be4101cf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7be4100ca0 0x7f7be41017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 --2- 172.21.15.46:0/2616228448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7be41002f0 0x7f7be4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 >> 172.21.15.46:0/2616228448 conn(0x7f7be4077210 msgr2=0x7f7be4105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 shutdown_connections 2024-09-19T09:18:23.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:23.852+0000 7f7bea48b640 1 -- 172.21.15.46:0/2616228448 wait complete. 2024-09-19T09:18:24.385 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:18:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:24 smithi046 ceph-mon[31203]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:18:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:24 smithi046 ceph-mon[31203]: scrub queued for path: / 2024-09-19T09:18:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:24 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:18:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:24 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:18:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:24 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:18:24.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:24 smithi046 ceph-mon[31203]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:25.035 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-19T09:18:22.983404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664977,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1226,"num_read_kb":744,"num_write":446,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348204,"kb_used_data":11436,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593620,"statfs":{"total":1151940427776,"available":1151583866880,"internally_reserved":0,"allocated":11710464,"data_stored":7352895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":77,"num_write":8,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002715"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981549+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:17:58.981549+0000","last_peered":"2024-09-19T09:17:58.981549+0000","last_clean":"2024-09-19T09:17:58.981549+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:17:58.981549+0000","last_undegraded":"2024-09-19T09:17:58.981549+0000","last_fullsized":"2024-09-19T09:17:58.981549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.978712+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:17:58.978712+0000","last_peered":"2024-09-19T09:17:58.978712+0000","last_clean":"2024-09-19T09:17:58.978712+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:17:58.978712+0000","last_undegraded":"2024-09-19T09:17:58.978712+0000","last_fullsized":"2024-09-19T09:17:58.978712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980087+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:17:58.980087+0000","last_peered":"2024-09-19T09:17:58.980087+0000","last_clean":"2024-09-19T09:17:58.980087+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.980087+0000","last_undegraded":"2024-09-19T09:17:58.980087+0000","last_fullsized":"2024-09-19T09:17:58.980087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963356+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:17:58.963356+0000","last_peered":"2024-09-19T09:17:58.963356+0000","last_clean":"2024-09-19T09:17:58.963356+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:17:58.963356+0000","last_undegraded":"2024-09-19T09:17:58.963356+0000","last_fullsized":"2024-09-19T09:17:58.963356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956263+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:17:58.956263+0000","last_peered":"2024-09-19T09:17:58.956263+0000","last_clean":"2024-09-19T09:17:58.956263+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:17:58.956263+0000","last_undegraded":"2024-09-19T09:17:58.956263+0000","last_fullsized":"2024-09-19T09:17:58.956263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970384+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:17:58.970384+0000","last_peered":"2024-09-19T09:17:58.970384+0000","last_clean":"2024-09-19T09:17:58.970384+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:17:58.970384+0000","last_undegraded":"2024-09-19T09:17:58.970384+0000","last_fullsized":"2024-09-19T09:17:58.970384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968788+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:17:58.968788+0000","last_peered":"2024-09-19T09:17:58.968788+0000","last_clean":"2024-09-19T09:17:58.968788+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:17:58.968788+0000","last_undegraded":"2024-09-19T09:17:58.968788+0000","last_fullsized":"2024-09-19T09:17:58.968788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969443+0000","last_change":"2024-09-19T09:17:30.741930+0000","last_active":"2024-09-19T09:17:58.969443+0000","last_peered":"2024-09-19T09:17:58.969443+0000","last_clean":"2024-09-19T09:17:58.969443+0000","last_became_active":"2024-09-19T09:17:30.741704+0000","last_became_peered":"2024-09-19T09:17:30.741704+0000","last_unstale":"2024-09-19T09:17:58.969443+0000","last_undegraded":"2024-09-19T09:17:58.969443+0000","last_fullsized":"2024-09-19T09:17:58.969443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:05.913992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981366+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:17:58.981366+0000","last_peered":"2024-09-19T09:17:58.981366+0000","last_clean":"2024-09-19T09:17:58.981366+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:17:58.981366+0000","last_undegraded":"2024-09-19T09:17:58.981366+0000","last_fullsized":"2024-09-19T09:17:58.981366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968579+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:17:58.968579+0000","last_peered":"2024-09-19T09:17:58.968579+0000","last_clean":"2024-09-19T09:17:58.968579+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:17:58.968579+0000","last_undegraded":"2024-09-19T09:17:58.968579+0000","last_fullsized":"2024-09-19T09:17:58.968579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980413+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:17:58.980413+0000","last_peered":"2024-09-19T09:17:58.980413+0000","last_clean":"2024-09-19T09:17:58.980413+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:17:58.980413+0000","last_undegraded":"2024-09-19T09:17:58.980413+0000","last_fullsized":"2024-09-19T09:17:58.980413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961145+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:17:58.961145+0000","last_peered":"2024-09-19T09:17:58.961145+0000","last_clean":"2024-09-19T09:17:58.961145+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:17:58.961145+0000","last_undegraded":"2024-09-19T09:17:58.961145+0000","last_fullsized":"2024-09-19T09:17:58.961145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967545+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:17:58.967545+0000","last_peered":"2024-09-19T09:17:58.967545+0000","last_clean":"2024-09-19T09:17:58.967545+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:17:58.967545+0000","last_undegraded":"2024-09-19T09:17:58.967545+0000","last_fullsized":"2024-09-19T09:17:58.967545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977708+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:17:58.977708+0000","last_peered":"2024-09-19T09:17:58.977708+0000","last_clean":"2024-09-19T09:17:58.977708+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:17:58.977708+0000","last_undegraded":"2024-09-19T09:17:58.977708+0000","last_fullsized":"2024-09-19T09:17:58.977708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979172+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:17:58.979172+0000","last_peered":"2024-09-19T09:17:58.979172+0000","last_clean":"2024-09-19T09:17:58.979172+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:17:58.979172+0000","last_undegraded":"2024-09-19T09:17:58.979172+0000","last_fullsized":"2024-09-19T09:17:58.979172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981760+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:17:58.981760+0000","last_peered":"2024-09-19T09:17:58.981760+0000","last_clean":"2024-09-19T09:17:58.981760+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:17:58.981760+0000","last_undegraded":"2024-09-19T09:17:58.981760+0000","last_fullsized":"2024-09-19T09:17:58.981760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981803+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:17:58.981803+0000","last_peered":"2024-09-19T09:17:58.981803+0000","last_clean":"2024-09-19T09:17:58.981803+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:17:58.981803+0000","last_undegraded":"2024-09-19T09:17:58.981803+0000","last_fullsized":"2024-09-19T09:17:58.981803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967160+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:17:58.967160+0000","last_peered":"2024-09-19T09:17:58.967160+0000","last_clean":"2024-09-19T09:17:58.967160+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:17:58.967160+0000","last_undegraded":"2024-09-19T09:17:58.967160+0000","last_fullsized":"2024-09-19T09:17:58.967160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967152+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:17:58.967152+0000","last_peered":"2024-09-19T09:17:58.967152+0000","last_clean":"2024-09-19T09:17:58.967152+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:17:58.967152+0000","last_undegraded":"2024-09-19T09:17:58.967152+0000","last_fullsized":"2024-09-19T09:17:58.967152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970437+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:17:58.970437+0000","last_peered":"2024-09-19T09:17:58.970437+0000","last_clean":"2024-09-19T09:17:58.970437+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:17:58.970437+0000","last_undegraded":"2024-09-19T09:17:58.970437+0000","last_fullsized":"2024-09-19T09:17:58.970437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980591+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:17:58.980591+0000","last_peered":"2024-09-19T09:17:58.980591+0000","last_clean":"2024-09-19T09:17:58.980591+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:17:58.980591+0000","last_undegraded":"2024-09-19T09:17:58.980591+0000","last_fullsized":"2024-09-19T09:17:58.980591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981630+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:17:58.981630+0000","last_peered":"2024-09-19T09:17:58.981630+0000","last_clean":"2024-09-19T09:17:58.981630+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:17:58.981630+0000","last_undegraded":"2024-09-19T09:17:58.981630+0000","last_fullsized":"2024-09-19T09:17:58.981630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968614+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:17:58.968614+0000","last_peered":"2024-09-19T09:17:58.968614+0000","last_clean":"2024-09-19T09:17:58.968614+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:17:58.968614+0000","last_undegraded":"2024-09-19T09:17:58.968614+0000","last_fullsized":"2024-09-19T09:17:58.968614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961162+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:17:58.961162+0000","last_peered":"2024-09-19T09:17:58.961162+0000","last_clean":"2024-09-19T09:17:58.961162+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:17:58.961162+0000","last_undegraded":"2024-09-19T09:17:58.961162+0000","last_fullsized":"2024-09-19T09:17:58.961162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968911+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:17:58.968911+0000","last_peered":"2024-09-19T09:17:58.968911+0000","last_clean":"2024-09-19T09:17:58.968911+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:17:58.968911+0000","last_undegraded":"2024-09-19T09:17:58.968911+0000","last_fullsized":"2024-09-19T09:17:58.968911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981030+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:17:58.981030+0000","last_peered":"2024-09-19T09:17:58.981030+0000","last_clean":"2024-09-19T09:17:58.981030+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:17:58.981030+0000","last_undegraded":"2024-09-19T09:17:58.981030+0000","last_fullsized":"2024-09-19T09:17:58.981030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969254+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:17:58.969254+0000","last_peered":"2024-09-19T09:17:58.969254+0000","last_clean":"2024-09-19T09:17:58.969254+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:17:58.969254+0000","last_undegraded":"2024-09-19T09:17:58.969254+0000","last_fullsized":"2024-09-19T09:17:58.969254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979843+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:17:58.979843+0000","last_peered":"2024-09-19T09:17:58.979843+0000","last_clean":"2024-09-19T09:17:58.979843+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:17:58.979843+0000","last_undegraded":"2024-09-19T09:17:58.979843+0000","last_fullsized":"2024-09-19T09:17:58.979843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977631+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:17:58.977631+0000","last_peered":"2024-09-19T09:17:58.977631+0000","last_clean":"2024-09-19T09:17:58.977631+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:17:58.977631+0000","last_undegraded":"2024-09-19T09:17:58.977631+0000","last_fullsized":"2024-09-19T09:17:58.977631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980454+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:17:58.980454+0000","last_peered":"2024-09-19T09:17:58.980454+0000","last_clean":"2024-09-19T09:17:58.980454+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:17:58.980454+0000","last_undegraded":"2024-09-19T09:17:58.980454+0000","last_fullsized":"2024-09-19T09:17:58.980454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966717+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:17:58.966717+0000","last_peered":"2024-09-19T09:17:58.966717+0000","last_clean":"2024-09-19T09:17:58.966717+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:17:58.966717+0000","last_undegraded":"2024-09-19T09:17:58.966717+0000","last_fullsized":"2024-09-19T09:17:58.966717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970020+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:17:58.970020+0000","last_peered":"2024-09-19T09:17:58.970020+0000","last_clean":"2024-09-19T09:17:58.970020+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:17:58.970020+0000","last_undegraded":"2024-09-19T09:17:58.970020+0000","last_fullsized":"2024-09-19T09:17:58.970020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.957135+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:17:58.957135+0000","last_peered":"2024-09-19T09:17:58.957135+0000","last_clean":"2024-09-19T09:17:58.957135+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:17:58.957135+0000","last_undegraded":"2024-09-19T09:17:58.957135+0000","last_fullsized":"2024-09-19T09:17:58.957135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:18.190697+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:18:18.190697+0000","last_peered":"2024-09-19T09:18:18.190697+0000","last_clean":"2024-09-19T09:18:18.190697+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:18:18.190697+0000","last_undegraded":"2024-09-19T09:18:18.190697+0000","last_fullsized":"2024-09-19T09:18:18.190697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.965388+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:17:58.965388+0000","last_peered":"2024-09-19T09:17:58.965388+0000","last_clean":"2024-09-19T09:17:58.965388+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:17:58.965388+0000","last_undegraded":"2024-09-19T09:17:58.965388+0000","last_fullsized":"2024-09-19T09:17:58.965388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.740826+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:17:30.740826+0000","last_peered":"2024-09-19T09:17:30.740826+0000","last_clean":"2024-09-19T09:17:30.740826+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:17:30.740826+0000","last_undegraded":"2024-09-19T09:17:30.740826+0000","last_fullsized":"2024-09-19T09:17:30.740826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.699545+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:17:30.699545+0000","last_peered":"2024-09-19T09:17:30.699545+0000","last_clean":"2024-09-19T09:17:30.699545+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:17:30.699545+0000","last_undegraded":"2024-09-19T09:17:30.699545+0000","last_fullsized":"2024-09-19T09:17:30.699545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970622+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:17:58.970622+0000","last_peered":"2024-09-19T09:17:58.970622+0000","last_clean":"2024-09-19T09:17:58.970622+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:17:58.970622+0000","last_undegraded":"2024-09-19T09:17:58.970622+0000","last_fullsized":"2024-09-19T09:17:58.970622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701519+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:17:30.701519+0000","last_peered":"2024-09-19T09:17:30.701519+0000","last_clean":"2024-09-19T09:17:30.701519+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:17:30.701519+0000","last_undegraded":"2024-09-19T09:17:30.701519+0000","last_fullsized":"2024-09-19T09:17:30.701519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970260+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:17:58.970260+0000","last_peered":"2024-09-19T09:17:58.970260+0000","last_clean":"2024-09-19T09:17:58.970260+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:17:58.970260+0000","last_undegraded":"2024-09-19T09:17:58.970260+0000","last_fullsized":"2024-09-19T09:17:58.970260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'6","reported_seq":240,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:21.193693+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:18:21.193693+0000","last_peered":"2024-09-19T09:18:21.193693+0000","last_clean":"2024-09-19T09:18:21.193693+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:18:21.193693+0000","last_undegraded":"2024-09-19T09:18:21.193693+0000","last_fullsized":"2024-09-19T09:18:21.193693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.976566+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:17:58.976566+0000","last_peered":"2024-09-19T09:17:58.976566+0000","last_clean":"2024-09-19T09:17:58.976566+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:17:58.976566+0000","last_undegraded":"2024-09-19T09:17:58.976566+0000","last_fullsized":"2024-09-19T09:17:58.976566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701780+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:17:30.701780+0000","last_peered":"2024-09-19T09:17:30.701780+0000","last_clean":"2024-09-19T09:17:30.701780+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:17:30.701780+0000","last_undegraded":"2024-09-19T09:17:30.701780+0000","last_fullsized":"2024-09-19T09:17:30.701780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979267+0000","last_change":"2024-09-19T09:17:30.711986+0000","last_active":"2024-09-19T09:17:58.979267+0000","last_peered":"2024-09-19T09:17:58.979267+0000","last_clean":"2024-09-19T09:17:58.979267+0000","last_became_active":"2024-09-19T09:17:30.711751+0000","last_became_peered":"2024-09-19T09:17:30.711751+0000","last_unstale":"2024-09-19T09:17:58.979267+0000","last_undegraded":"2024-09-19T09:17:58.979267+0000","last_fullsized":"2024-09-19T09:17:58.979267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:18.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701396+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:17:30.701396+0000","last_peered":"2024-09-19T09:17:30.701396+0000","last_clean":"2024-09-19T09:17:30.701396+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:17:30.701396+0000","last_undegraded":"2024-09-19T09:17:30.701396+0000","last_fullsized":"2024-09-19T09:17:30.701396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979992+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:17:58.979992+0000","last_peered":"2024-09-19T09:17:58.979992+0000","last_clean":"2024-09-19T09:17:58.979992+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:17:58.979992+0000","last_undegraded":"2024-09-19T09:17:58.979992+0000","last_fullsized":"2024-09-19T09:17:58.979992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":283,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:21.193696+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:18:21.193696+0000","last_peered":"2024-09-19T09:18:21.193696+0000","last_clean":"2024-09-19T09:18:21.193696+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:18:21.193696+0000","last_undegraded":"2024-09-19T09:18:21.193696+0000","last_fullsized":"2024-09-19T09:18:21.193696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66043,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":176,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967581+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:17:58.967581+0000","last_peered":"2024-09-19T09:17:58.967581+0000","last_clean":"2024-09-19T09:17:58.967581+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:17:58.967581+0000","last_undegraded":"2024-09-19T09:17:58.967581+0000","last_fullsized":"2024-09-19T09:17:58.967581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701982+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:17:30.701982+0000","last_peered":"2024-09-19T09:17:30.701982+0000","last_clean":"2024-09-19T09:17:30.701982+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:17:30.701982+0000","last_undegraded":"2024-09-19T09:17:30.701982+0000","last_fullsized":"2024-09-19T09:17:30.701982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956062+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:17:58.956062+0000","last_peered":"2024-09-19T09:17:58.956062+0000","last_clean":"2024-09-19T09:17:58.956062+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:17:58.956062+0000","last_undegraded":"2024-09-19T09:17:58.956062+0000","last_fullsized":"2024-09-19T09:17:58.956062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701288+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:17:30.701288+0000","last_peered":"2024-09-19T09:17:30.701288+0000","last_clean":"2024-09-19T09:17:30.701288+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:17:30.701288+0000","last_undegraded":"2024-09-19T09:17:30.701288+0000","last_fullsized":"2024-09-19T09:17:30.701288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.971893+0000","last_change":"2024-09-19T09:17:30.706308+0000","last_active":"2024-09-19T09:17:58.971893+0000","last_peered":"2024-09-19T09:17:58.971893+0000","last_clean":"2024-09-19T09:17:58.971893+0000","last_became_active":"2024-09-19T09:17:30.705841+0000","last_became_peered":"2024-09-19T09:17:30.705841+0000","last_unstale":"2024-09-19T09:17:58.971893+0000","last_undegraded":"2024-09-19T09:17:58.971893+0000","last_fullsized":"2024-09-19T09:17:58.971893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:18.190114+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:18:18.190114+0000","last_peered":"2024-09-19T09:18:18.190114+0000","last_clean":"2024-09-19T09:18:18.190114+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:18:18.190114+0000","last_undegraded":"2024-09-19T09:18:18.190114+0000","last_fullsized":"2024-09-19T09:18:18.190114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969899+0000","last_change":"2024-09-19T09:17:30.742259+0000","last_active":"2024-09-19T09:17:58.969899+0000","last_peered":"2024-09-19T09:17:58.969899+0000","last_clean":"2024-09-19T09:17:58.969899+0000","last_became_active":"2024-09-19T09:17:30.741880+0000","last_became_peered":"2024-09-19T09:17:30.741880+0000","last_unstale":"2024-09-19T09:17:58.969899+0000","last_undegraded":"2024-09-19T09:17:58.969899+0000","last_fullsized":"2024-09-19T09:17:58.969899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:33.736292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706370+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:17:30.706370+0000","last_peered":"2024-09-19T09:17:30.706370+0000","last_clean":"2024-09-19T09:17:30.706370+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:17:30.706370+0000","last_undegraded":"2024-09-19T09:17:30.706370+0000","last_fullsized":"2024-09-19T09:17:30.706370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.974073+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:17:58.974073+0000","last_peered":"2024-09-19T09:17:58.974073+0000","last_clean":"2024-09-19T09:17:58.974073+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:17:58.974073+0000","last_undegraded":"2024-09-19T09:17:58.974073+0000","last_fullsized":"2024-09-19T09:17:58.974073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.716217+0000","last_change":"2024-09-19T09:17:30.715839+0000","last_active":"2024-09-19T09:17:30.716217+0000","last_peered":"2024-09-19T09:17:30.716217+0000","last_clean":"2024-09-19T09:17:30.716217+0000","last_became_active":"2024-09-19T09:17:30.707470+0000","last_became_peered":"2024-09-19T09:17:30.707470+0000","last_unstale":"2024-09-19T09:17:30.716217+0000","last_undegraded":"2024-09-19T09:17:30.716217+0000","last_fullsized":"2024-09-19T09:17:30.716217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.090063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969162+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:17:58.969162+0000","last_peered":"2024-09-19T09:17:58.969162+0000","last_clean":"2024-09-19T09:17:58.969162+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:17:58.969162+0000","last_undegraded":"2024-09-19T09:17:58.969162+0000","last_fullsized":"2024-09-19T09:17:58.969162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.719006+0000","last_change":"2024-09-19T09:17:30.719006+0000","last_active":"2024-09-19T09:17:30.719006+0000","last_peered":"2024-09-19T09:17:30.719006+0000","last_clean":"2024-09-19T09:17:30.719006+0000","last_became_active":"2024-09-19T09:17:30.709645+0000","last_became_peered":"2024-09-19T09:17:30.709645+0000","last_unstale":"2024-09-19T09:17:30.719006+0000","last_undegraded":"2024-09-19T09:17:30.719006+0000","last_fullsized":"2024-09-19T09:17:30.719006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:41.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977582+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:17:58.977582+0000","last_peered":"2024-09-19T09:17:58.977582+0000","last_clean":"2024-09-19T09:17:58.977582+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:17:58.977582+0000","last_undegraded":"2024-09-19T09:17:58.977582+0000","last_fullsized":"2024-09-19T09:17:58.977582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701511+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:17:30.701511+0000","last_peered":"2024-09-19T09:17:30.701511+0000","last_clean":"2024-09-19T09:17:30.701511+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:17:30.701511+0000","last_undegraded":"2024-09-19T09:17:30.701511+0000","last_fullsized":"2024-09-19T09:17:30.701511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968174+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:17:58.968174+0000","last_peered":"2024-09-19T09:17:58.968174+0000","last_clean":"2024-09-19T09:17:58.968174+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:17:58.968174+0000","last_undegraded":"2024-09-19T09:17:58.968174+0000","last_fullsized":"2024-09-19T09:17:58.968174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:18.190201+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:18:18.190201+0000","last_peered":"2024-09-19T09:18:18.190201+0000","last_clean":"2024-09-19T09:18:18.190201+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:18:18.190201+0000","last_undegraded":"2024-09-19T09:18:18.190201+0000","last_fullsized":"2024-09-19T09:18:18.190201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980166+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:17:58.980166+0000","last_peered":"2024-09-19T09:17:58.980166+0000","last_clean":"2024-09-19T09:17:58.980166+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:17:58.980166+0000","last_undegraded":"2024-09-19T09:17:58.980166+0000","last_fullsized":"2024-09-19T09:17:58.980166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702339+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:17:30.702339+0000","last_peered":"2024-09-19T09:17:30.702339+0000","last_clean":"2024-09-19T09:17:30.702339+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:17:30.702339+0000","last_undegraded":"2024-09-19T09:17:30.702339+0000","last_fullsized":"2024-09-19T09:17:30.702339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.707109+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:17:30.707109+0000","last_peered":"2024-09-19T09:17:30.707109+0000","last_clean":"2024-09-19T09:17:30.707109+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:17:30.707109+0000","last_undegraded":"2024-09-19T09:17:30.707109+0000","last_fullsized":"2024-09-19T09:17:30.707109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977434+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:17:58.977434+0000","last_peered":"2024-09-19T09:17:58.977434+0000","last_clean":"2024-09-19T09:17:58.977434+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:17:58.977434+0000","last_undegraded":"2024-09-19T09:17:58.977434+0000","last_fullsized":"2024-09-19T09:17:58.977434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702100+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:17:30.702100+0000","last_peered":"2024-09-19T09:17:30.702100+0000","last_clean":"2024-09-19T09:17:30.702100+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:17:30.702100+0000","last_undegraded":"2024-09-19T09:17:30.702100+0000","last_fullsized":"2024-09-19T09:17:30.702100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961956+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:17:58.961956+0000","last_peered":"2024-09-19T09:17:58.961956+0000","last_clean":"2024-09-19T09:17:58.961956+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.961956+0000","last_undegraded":"2024-09-19T09:17:58.961956+0000","last_fullsized":"2024-09-19T09:17:58.961956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:19.190880+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:18:19.190880+0000","last_peered":"2024-09-19T09:18:19.190880+0000","last_clean":"2024-09-19T09:18:19.190880+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:18:19.190880+0000","last_undegraded":"2024-09-19T09:18:19.190880+0000","last_fullsized":"2024-09-19T09:18:19.190880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963278+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:17:58.963278+0000","last_peered":"2024-09-19T09:17:58.963278+0000","last_clean":"2024-09-19T09:17:58.963278+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:17:58.963278+0000","last_undegraded":"2024-09-19T09:17:58.963278+0000","last_fullsized":"2024-09-19T09:17:58.963278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'8","reported_seq":139,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:19.191201+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:18:19.191201+0000","last_peered":"2024-09-19T09:18:19.191201+0000","last_clean":"2024-09-19T09:18:19.191201+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:18:19.191201+0000","last_undegraded":"2024-09-19T09:18:19.191201+0000","last_fullsized":"2024-09-19T09:18:19.191201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967435+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:17:58.967435+0000","last_peered":"2024-09-19T09:17:58.967435+0000","last_clean":"2024-09-19T09:17:58.967435+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:17:58.967435+0000","last_undegraded":"2024-09-19T09:17:58.967435+0000","last_fullsized":"2024-09-19T09:17:58.967435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.704404+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:17:30.704404+0000","last_peered":"2024-09-19T09:17:30.704404+0000","last_clean":"2024-09-19T09:17:30.704404+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:17:30.704404+0000","last_undegraded":"2024-09-19T09:17:30.704404+0000","last_fullsized":"2024-09-19T09:17:30.704404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970687+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:17:58.970687+0000","last_peered":"2024-09-19T09:17:58.970687+0000","last_clean":"2024-09-19T09:17:58.970687+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:17:58.970687+0000","last_undegraded":"2024-09-19T09:17:58.970687+0000","last_fullsized":"2024-09-19T09:17:58.970687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706919+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:17:30.706919+0000","last_peered":"2024-09-19T09:17:30.706919+0000","last_clean":"2024-09-19T09:17:30.706919+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:17:30.706919+0000","last_undegraded":"2024-09-19T09:17:30.706919+0000","last_fullsized":"2024-09-19T09:17:30.706919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.962302+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:17:58.962302+0000","last_peered":"2024-09-19T09:17:58.962302+0000","last_clean":"2024-09-19T09:17:58.962302+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:17:58.962302+0000","last_undegraded":"2024-09-19T09:17:58.962302+0000","last_fullsized":"2024-09-19T09:17:58.962302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:59.005140+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:17:59.005140+0000","last_peered":"2024-09-19T09:17:59.005140+0000","last_clean":"2024-09-19T09:17:59.005140+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:17:59.005140+0000","last_undegraded":"2024-09-19T09:17:59.005140+0000","last_fullsized":"2024-09-19T09:17:59.005140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970983+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:17:58.970983+0000","last_peered":"2024-09-19T09:17:58.970983+0000","last_clean":"2024-09-19T09:17:58.970983+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:17:58.970983+0000","last_undegraded":"2024-09-19T09:17:58.970983+0000","last_fullsized":"2024-09-19T09:17:58.970983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706710+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:17:30.706710+0000","last_peered":"2024-09-19T09:17:30.706710+0000","last_clean":"2024-09-19T09:17:30.706710+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:17:30.706710+0000","last_undegraded":"2024-09-19T09:17:30.706710+0000","last_fullsized":"2024-09-19T09:17:30.706710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979125+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:17:58.979125+0000","last_peered":"2024-09-19T09:17:58.979125+0000","last_clean":"2024-09-19T09:17:58.979125+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:17:58.979125+0000","last_undegraded":"2024-09-19T09:17:58.979125+0000","last_fullsized":"2024-09-19T09:17:58.979125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.700552+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:17:30.700552+0000","last_peered":"2024-09-19T09:17:30.700552+0000","last_clean":"2024-09-19T09:17:30.700552+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:17:30.700552+0000","last_undegraded":"2024-09-19T09:17:30.700552+0000","last_fullsized":"2024-09-19T09:17:30.700552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.933118+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:17:58.933118+0000","last_peered":"2024-09-19T09:17:58.933118+0000","last_clean":"2024-09-19T09:17:58.933118+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:17:58.933118+0000","last_undegraded":"2024-09-19T09:17:58.933118+0000","last_fullsized":"2024-09-19T09:17:58.933118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702269+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:17:30.702269+0000","last_peered":"2024-09-19T09:17:30.702269+0000","last_clean":"2024-09-19T09:17:30.702269+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:17:30.702269+0000","last_undegraded":"2024-09-19T09:17:30.702269+0000","last_fullsized":"2024-09-19T09:17:30.702269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975139+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:17:58.975139+0000","last_peered":"2024-09-19T09:17:58.975139+0000","last_clean":"2024-09-19T09:17:58.975139+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:17:58.975139+0000","last_undegraded":"2024-09-19T09:17:58.975139+0000","last_fullsized":"2024-09-19T09:17:58.975139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.722791+0000","last_change":"2024-09-19T09:17:30.722376+0000","last_active":"2024-09-19T09:17:30.722791+0000","last_peered":"2024-09-19T09:17:30.722791+0000","last_clean":"2024-09-19T09:17:30.722791+0000","last_became_active":"2024-09-19T09:17:30.709277+0000","last_became_peered":"2024-09-19T09:17:30.709277+0000","last_unstale":"2024-09-19T09:17:30.722791+0000","last_undegraded":"2024-09-19T09:17:30.722791+0000","last_fullsized":"2024-09-19T09:17:30.722791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.341264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980029+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:17:58.980029+0000","last_peered":"2024-09-19T09:17:58.980029+0000","last_clean":"2024-09-19T09:17:58.980029+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:17:58.980029+0000","last_undegraded":"2024-09-19T09:17:58.980029+0000","last_fullsized":"2024-09-19T09:17:58.980029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706536+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:17:30.706536+0000","last_peered":"2024-09-19T09:17:30.706536+0000","last_clean":"2024-09-19T09:17:30.706536+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:17:30.706536+0000","last_undegraded":"2024-09-19T09:17:30.706536+0000","last_fullsized":"2024-09-19T09:17:30.706536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979969+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:17:58.979969+0000","last_peered":"2024-09-19T09:17:58.979969+0000","last_clean":"2024-09-19T09:17:58.979969+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:17:58.979969+0000","last_undegraded":"2024-09-19T09:17:58.979969+0000","last_fullsized":"2024-09-19T09:17:58.979969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980085+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:17:58.980085+0000","last_peered":"2024-09-19T09:17:58.980085+0000","last_clean":"2024-09-19T09:17:58.980085+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:17:58.980085+0000","last_undegraded":"2024-09-19T09:17:58.980085+0000","last_fullsized":"2024-09-19T09:17:58.980085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706809+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:17:30.706809+0000","last_peered":"2024-09-19T09:17:30.706809+0000","last_clean":"2024-09-19T09:17:30.706809+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:17:30.706809+0000","last_undegraded":"2024-09-19T09:17:30.706809+0000","last_fullsized":"2024-09-19T09:17:30.706809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975767+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:17:58.975767+0000","last_peered":"2024-09-19T09:17:58.975767+0000","last_clean":"2024-09-19T09:17:58.975767+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:17:58.975767+0000","last_undegraded":"2024-09-19T09:17:58.975767+0000","last_fullsized":"2024-09-19T09:17:58.975767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'13","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706829+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:17:30.706829+0000","last_peered":"2024-09-19T09:17:30.706829+0000","last_clean":"2024-09-19T09:17:30.706829+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:17:30.706829+0000","last_undegraded":"2024-09-19T09:17:30.706829+0000","last_fullsized":"2024-09-19T09:17:30.706829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981137+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:17:58.981137+0000","last_peered":"2024-09-19T09:17:58.981137+0000","last_clean":"2024-09-19T09:17:58.981137+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:17:58.981137+0000","last_undegraded":"2024-09-19T09:17:58.981137+0000","last_fullsized":"2024-09-19T09:17:58.981137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702907+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:17:30.702907+0000","last_peered":"2024-09-19T09:17:30.702907+0000","last_clean":"2024-09-19T09:17:30.702907+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:17:30.702907+0000","last_undegraded":"2024-09-19T09:17:30.702907+0000","last_fullsized":"2024-09-19T09:17:30.702907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966920+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:17:58.966920+0000","last_peered":"2024-09-19T09:17:58.966920+0000","last_clean":"2024-09-19T09:17:58.966920+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:17:58.966920+0000","last_undegraded":"2024-09-19T09:17:58.966920+0000","last_fullsized":"2024-09-19T09:17:58.966920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:20.192226+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:18:20.192226+0000","last_peered":"2024-09-19T09:18:20.192226+0000","last_clean":"2024-09-19T09:18:20.192226+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:18:20.192226+0000","last_undegraded":"2024-09-19T09:18:20.192226+0000","last_fullsized":"2024-09-19T09:18:20.192226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74375,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1100,"num_read_kb":635,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":448245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1104761,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201333,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":447975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":1041500,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":448178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1040336,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986249,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":447197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215181,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":515580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":515134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:18:25.040 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:18:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:25.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:24 smithi115 ceph-mon[35055]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:18:25.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:24 smithi115 ceph-mon[35055]: scrub queued for path: / 2024-09-19T09:18:25.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:24 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:18:25.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:24 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:18:25.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:24 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:18:25.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:24 smithi115 ceph-mon[35055]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:24 smithi099 ceph-mon[35256]: pgmap v341: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:24 smithi099 ceph-mon[35256]: scrub queued for path: / 2024-09-19T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:24 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:24 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:24 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:18:25.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:24 smithi099 ceph-mon[35256]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 -- 172.21.15.46:0/3135312165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768102ef0 msgr2=0x7ff76810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 --2- 172.21.15.46:0/3135312165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768102ef0 0x7ff76810da40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff760009ca0 tx=0x7ff76002a950 comp rx=0 tx=0).stop 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 -- 172.21.15.46:0/3135312165 shutdown_connections 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 --2- 172.21.15.46:0/3135312165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768102ef0 0x7ff76810da40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 --2- 172.21.15.46:0/3135312165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102570 0x7ff7681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 --2- 172.21.15.46:0/3135312165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768100e20 0x7ff768101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 -- 172.21.15.46:0/3135312165 >> 172.21.15.46:0/3135312165 conn(0x7ff7680fc7d0 msgr2=0x7ff7680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 -- 172.21.15.46:0/3135312165 shutdown_connections 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.558+0000 7ff76effe640 1 -- 172.21.15.46:0/3135312165 wait complete. 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 Processor -- start 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 -- start start 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 0x7ff768198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768102570 0x7ff768198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102ef0 0x7ff76819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff768110f80 con 0x7ff768100e20 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff768110e00 con 0x7ff768102ef0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76effe640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff768111100 con 0x7ff768102570 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 0x7ff768198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 0x7ff768198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33950/0 (socket says 172.21.15.46:33950) 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff76cd9a640 1 -- 172.21.15.46:0/655355405 learned_addr learned my addr 172.21.15.46:0/655355405 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.559+0000 7ff767fff640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768102570 0x7ff768198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76d59b640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102ef0 0x7ff76819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76cd9a640 1 -- 172.21.15.46:0/655355405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768102570 msgr2=0x7ff768198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768102570 0x7ff768198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76cd9a640 1 -- 172.21.15.46:0/655355405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102ef0 msgr2=0x7ff76819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102ef0 0x7ff76819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76cd9a640 1 -- 172.21.15.46:0/655355405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76819d4e0 con 0x7ff768100e20 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff767fff640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768102570 0x7ff768198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76d59b640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102ef0 0x7ff76819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 0x7ff768198530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e9f0 tx=0x7ff75c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff765ffb640 1 -- 172.21.15.46:0/655355405 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c00cd80 con 0x7ff768100e20 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76819d7d0 con 0x7ff768100e20 2024-09-19T09:18:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff765ffb640 1 -- 172.21.15.46:0/655355405 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c005500 con 0x7ff768100e20 2024-09-19T09:18:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff765ffb640 1 -- 172.21.15.46:0/655355405 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c010690 con 0x7ff768100e20 2024-09-19T09:18:25.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.560+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7681a50b0 con 0x7ff768100e20 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.563+0000 7ff765ffb640 1 -- 172.21.15.46:0/655355405 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff75c0046c0 con 0x7ff768100e20 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.563+0000 7ff765ffb640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff7580a3240 0x7ff7580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff767fff640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff7580a3240 0x7ff7580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff765ffb640 1 -- 172.21.15.46:0/655355405 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff75c0cfe40 con 0x7ff768100e20 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 Processor -- start 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff767fff640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff7580a3240 0x7ff7580a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff768105310 tx=0x7ff754005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 -- start start 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d84a0 0x5574451d8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x5574451e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451e3680 0x5574451e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55744513e2e0 con 0x5574451e3680 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5574450e5ce0 con 0x5574451d84a0 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.564+0000 7ff7713d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55744513a2a0 con 0x5574451d8dc0 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76d59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451e3680 0x5574451e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76d59b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451e3680 0x5574451e5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33960/0 (socket says 172.21.15.46:33960) 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76d59b640 1 -- 172.21.15.46:0/1730345117 learned_addr learned my addr 172.21.15.46:0/1730345117 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d84a0 0x5574451d8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff767fff640 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x5574451e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1730345117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 msgr2=0x5574451e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x5574451e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1730345117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451e3680 msgr2=0x5574451e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451e3680 0x5574451e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1730345117 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574450ca440 con 0x5574451d84a0 2024-09-19T09:18:25.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d84a0 0x5574451d8880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0cd970 tx=0x7ff75c09bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b4116726f4dd4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.565+0000 7ff752ffd640 1 -- 172.21.15.46:0/1730345117 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b4020 con 0x5574451d84a0 2024-09-19T09:18:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff752ffd640 1 -- 172.21.15.46:0/1730345117 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c09c490 con 0x5574451d84a0 2024-09-19T09:18:25.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff752ffd640 1 -- 172.21.15.46:0/1730345117 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b5260 con 0x5574451d84a0 2024-09-19T09:18:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 -- 172.21.15.46:0/1730345117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d84a0 msgr2=0x5574451d8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d84a0 0x5574451d8880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0cd970 tx=0x7ff75c09bfd0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 -- 172.21.15.46:0/1730345117 shutdown_connections 2024-09-19T09:18:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451e3680 0x5574451e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x5574451e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1730345117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d84a0 0x5574451d8880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 -- 172.21.15.46:0/1730345117 >> 172.21.15.46:0/1730345117 conn(0x5574451d4a30 msgr2=0x5574451d4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 -- 172.21.15.46:0/1730345117 shutdown_connections 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.566+0000 7ff7713d7740 1 -- 172.21.15.46:0/1730345117 wait complete. 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 -- start start 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 Processor -- start 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451e0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451e0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5574451e6250 con 0x5574451d84a0 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5574450f9050 con 0x5574451d8dc0 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5574451e63d0 con 0x5574451e3680 2024-09-19T09:18:25.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.567+0000 7ff7713d7740 10 client.0 _ll_register_callbacks cb 0x557445139160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff76d59b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff76d59b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451e0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:55000/0 (socket says 172.21.15.46:55000) 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff76d59b640 1 -- 172.21.15.46:0/4065803136 learned_addr learned my addr 172.21.15.46:0/4065803136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 -- 172.21.15.46:0/4065803136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 msgr2=0x5574451e0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451e0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 -- 172.21.15.46:0/4065803136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 msgr2=0x5574451e2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451e2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 -- 172.21.15.46:0/4065803136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557444eaf3c0 con 0x5574451d8dc0 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff767fff640 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451e0240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff754009fd0 tx=0x7ff754004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e77044a55998063a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff747fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff747fff640 1 -- 172.21.15.46:0/4065803136 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754012860 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff747fff640 1 -- 172.21.15.46:0/4065803136 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff754012a00 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.568+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75c09c490 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff747fff640 1 -- 172.21.15.46:0/4065803136 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff754011e90 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 10 client.24926 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574451f1c30 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff747fff640 1 -- 172.21.15.46:0/4065803136 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c09c490 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff747fff640 1 -- 172.21.15.46:0/4065803136 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff754021410 con 0x5574451d8dc0 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 10 client.24926 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 10 client.24926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 20 client.24926 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5574451f3140 0x5574451f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 4 client.24926 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:25.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.569+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55744514b850 con 0x5574451f3140 2024-09-19T09:18:25.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.570+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5574451f3140 0x5574451f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.576 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.570+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5574451f3140 0x5574451f55e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ee99840786f6581 server_cookie=bcacb0b4e85a820b in_seq=0 out_seq=0 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.570+0000 7ff747fff640 10 client.24926 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff747fff640 1 -- 172.21.15.46:0/4065803136 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55744514b850 con 0x5574451f3140 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff747fff640 10 client.24926 handle_command_reply: tid=0 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 client.24926 shutdown 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 msgr2=0x5574451e0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451e0240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff754009fd0 tx=0x7ff754004730 comp rx=0 tx=0).stop 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 shutdown_connections 2024-09-19T09:18:25.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5574451f3140 0x5574451f55e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451e0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451e0240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4065803136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff747fff640 0 client.24926 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 >> 172.21.15.46:0/4065803136 conn(0x5574451d4a30 msgr2=0x5574451da710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 shutdown_connections 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 1 -- 172.21.15.46:0/4065803136 wait complete. 2024-09-19T09:18:25.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.571+0000 7ff7713d7740 20 client.24926 trim_cache size 0 max 16384 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 Processor -- start 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 -- start start 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff7681ad5b0 con 0x5574451d84a0 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff7681af0f0 con 0x5574451d8dc0 2024-09-19T09:18:25.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff7713d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff7681adc80 con 0x5574451e3680 2024-09-19T09:18:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451ef4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33984/0 (socket says 172.21.15.46:33984) 2024-09-19T09:18:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.589+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1007537798 learned_addr learned my addr 172.21.15.46:0/1007537798 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff767fff640 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76d59b640 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1007537798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 msgr2=0x5574451fb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451fb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1007537798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 msgr2=0x5574451faeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451faeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76cd9a640 1 -- 172.21.15.46:0/1007537798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574451e3300 con 0x5574451d84a0 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff767fff640 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451ef4b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff75c098e60 tx=0x7ff75c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6710dd936c767c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff7527fc640 1 -- 172.21.15.46:0/1007537798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0ba070 con 0x5574451d84a0 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff7527fc640 1 -- 172.21.15.46:0/1007537798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c09c490 con 0x5574451d84a0 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.590+0000 7ff7527fc640 1 -- 172.21.15.46:0/1007537798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b4040 con 0x5574451d84a0 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.591+0000 7ff7713d7740 1 -- 172.21.15.46:0/1007537798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 msgr2=0x5574451ef4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.591+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451ef4b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff75c098e60 tx=0x7ff75c004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 -- 172.21.15.46:0/1007537798 shutdown_connections 2024-09-19T09:18:25.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451e3680 0x5574451fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451d8dc0 0x5574451faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 --2- 172.21.15.46:0/1007537798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x5574451ef4b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 -- 172.21.15.46:0/1007537798 >> 172.21.15.46:0/1007537798 conn(0x5574451d4a30 msgr2=0x5574451e22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 -- 172.21.15.46:0/1007537798 shutdown_connections 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 -- 172.21.15.46:0/1007537798 wait complete. 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 -- start start 2024-09-19T09:18:25.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.592+0000 7ff7713d7740 1 Processor -- start 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x557445256240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x557445256780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451e3680 0x5574451ea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff7681aea20 con 0x5574451d84a0 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff7681ae350 con 0x5574451e3680 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff7681ab590 con 0x5574451d8dc0 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff7713d7740 10 client.0 _ll_register_callbacks cb 0x7ff754011de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x557445256240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x557445256240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33986/0 (socket says 172.21.15.46:33986) 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 -- 172.21.15.46:0/4134788821 learned_addr learned my addr 172.21.15.46:0/4134788821 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76d59b640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451e3680 0x5574451ea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff767fff640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x557445256780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 -- 172.21.15.46:0/4134788821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 msgr2=0x557445256780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x557445256780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 -- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451e3680 msgr2=0x5574451ea620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451e3680 0x5574451ea620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76cd9a640 1 -- 172.21.15.46:0/4134788821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574451eab60 con 0x5574451d84a0 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.593+0000 7ff76d59b640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451e3680 0x5574451ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff76cd9a640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x557445256240 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0b8040 tx=0x7ff75c0a0840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff59b4feb7c4b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff747fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff747fff640 1 -- 172.21.15.46:0/4134788821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b4070 con 0x5574451d84a0 2024-09-19T09:18:25.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff747fff640 1 -- 172.21.15.46:0/4134788821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff75c067270 con 0x5574451d84a0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75c09c490 con 0x5574451d84a0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff747fff640 1 -- 172.21.15.46:0/4134788821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff75c0ba050 con 0x5574451d84a0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff7713d7740 10 client.15300 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5574451ebe70 con 0x5574451d84a0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.594+0000 7ff747fff640 1 -- 172.21.15.46:0/4134788821 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c066070 con 0x5574451d84a0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff747fff640 1 -- 172.21.15.46:0/4134788821 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff75c09b970 con 0x5574451d84a0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff7713d7740 10 client.15300 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff7713d7740 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff7713d7740 20 client.15300 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557445262290 0x557445264680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff7713d7740 4 client.15300 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff75c09c490 con 0x557445262290 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.595+0000 7ff767fff640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557445262290 0x557445264680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff767fff640 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557445262290 0x557445264680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4702eb3705716d8 server_cookie=b7ed5b0420322502 in_seq=0 out_seq=0 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff747fff640 10 client.15300 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff747fff640 1 -- 172.21.15.46:0/4134788821 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7ff75c09c490 con 0x557445262290 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff747fff640 10 client.15300 handle_command_reply: tid=0 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 client.15300 shutdown 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 msgr2=0x557445256240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x557445256240 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0b8040 tx=0x7ff75c0a0840 comp rx=0 tx=0).stop 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 shutdown_connections 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557445262290 0x557445264680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff747fff640 0 client.15300 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5574451e3680 0x5574451ea620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5574451d8dc0 0x557445256780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 --2- 172.21.15.46:0/4134788821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5574451d84a0 0x557445256240 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 >> 172.21.15.46:0/4134788821 conn(0x5574451d4a30 msgr2=0x5574451de9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 shutdown_connections 2024-09-19T09:18:25.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 1 -- 172.21.15.46:0/4134788821 wait complete. 2024-09-19T09:18:25.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.596+0000 7ff7713d7740 20 client.15300 trim_cache size 0 max 16384 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: "af90782d-f316-4337-80f9-f278e275c354": { 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "af90782d-f316-4337-80f9-f278e275c354", 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:18:25.605 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff7580a3240 msgr2=0x7ff7580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff7580a3240 0x7ff7580a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff768105310 tx=0x7ff754005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 msgr2=0x7ff768198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 0x7ff768198530 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00e9f0 tx=0x7ff75c00edf0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 shutdown_connections 2024-09-19T09:18:25.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff7580a3240 0x7ff7580a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff768102ef0 0x7ff76819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff768102570 0x7ff768198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 --2- 172.21.15.46:0/655355405 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff768100e20 0x7ff768198530 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.597+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 >> 172.21.15.46:0/655355405 conn(0x7ff7680fc7d0 msgr2=0x7ff76806a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.598+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 shutdown_connections 2024-09-19T09:18:25.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:25.598+0000 7ff76effe640 1 -- 172.21.15.46:0/655355405 wait complete. 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1949013437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4100a80 msgr2=0x7fc6b4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1949013437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4100a80 0x7fc6b4100ee0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009930 tx=0x7fc6a802a420 comp rx=0 tx=0).stop 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1949013437 shutdown_connections 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1949013437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4100a80 0x7fc6b4100ee0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1949013437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b4101420 0x7fc6b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1949013437 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b4106a80 0x7fc6b4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1949013437 >> 172.21.15.46:0/1949013437 conn(0x7fc6b40fc7a0 msgr2=0x7fc6b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1949013437 shutdown_connections 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.293+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1949013437 wait complete. 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 Processor -- start 2024-09-19T09:18:26.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 -- start start 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b4100a80 0x7fc6b41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 0x7fc6b41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b4106a80 0x7fc6b419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4111fa0 con 0x7fc6b4101420 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4111e20 con 0x7fc6b4100a80 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6ba97b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4112120 con 0x7fc6b4106a80 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 0x7fc6b41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6b37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 0x7fc6b41989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34004/0 (socket says 172.21.15.46:34004) 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6b37fe640 1 -- 172.21.15.46:0/1632126503 learned_addr learned my addr 172.21.15.46:0/1632126503 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:26.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.294+0000 7fc6b3fff640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b4100a80 0x7fc6b41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b8f18640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b4106a80 0x7fc6b419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b37fe640 1 -- 172.21.15.46:0/1632126503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b4106a80 msgr2=0x7fc6b419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b37fe640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b4106a80 0x7fc6b419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b37fe640 1 -- 172.21.15.46:0/1632126503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b4100a80 msgr2=0x7fc6b41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b37fe640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b4100a80 0x7fc6b41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b37fe640 1 -- 172.21.15.46:0/1632126503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b419d450 con 0x7fc6b4101420 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b37fe640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 0x7fc6b41989e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009230 tx=0x7fc6a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a803f030 con 0x7fc6b4101420 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a8003ad0 con 0x7fc6b4101420 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8035070 con 0x7fc6b4101420 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b419d6e0 con 0x7fc6b4101420 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.295+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b419db70 con 0x7fc6b4101420 2024-09-19T09:18:26.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.296+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b4100ee0 con 0x7fc6b4101420 2024-09-19T09:18:26.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.297+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc6a8042030 con 0x7fc6b4101420 2024-09-19T09:18:26.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.298+0000 7fc6b17fa640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc69c0a3240 0x7fc69c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.298+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc6a80f01a0 con 0x7fc6b4101420 2024-09-19T09:18:26.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.298+0000 7fc6b3fff640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc69c0a3240 0x7fc69c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.299+0000 7fc6b3fff640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc69c0a3240 0x7fc69c0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4005fd0 tx=0x7fc6a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.301+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc6a80bc840 con 0x7fc6b4101420 2024-09-19T09:18:26.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.474+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6b4062630 con 0x7fc69c0a3240 2024-09-19T09:18:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.480+0000 7fc6b17fa640 1 -- 172.21.15.46:0/1632126503 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258982 (secure 0 0 0) 0x7fc6b4062630 con 0x7fc69c0a3240 2024-09-19T09:18:26.483 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:18:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc69c0a3240 msgr2=0x7fc69c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc69c0a3240 0x7fc69c0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4005fd0 tx=0x7fc6a400b390 comp rx=0 tx=0).stop 2024-09-19T09:18:26.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 msgr2=0x7fc6b41989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 0x7fc6b41989e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009230 tx=0x7fc6a8004270 comp rx=0 tx=0).stop 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 shutdown_connections 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc69c0a3240 0x7fc69c0a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6b4101420 0x7fc6b41989e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6b4106a80 0x7fc6b419cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 --2- 172.21.15.46:0/1632126503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc6b4100a80 0x7fc6b41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 >> 172.21.15.46:0/1632126503 conn(0x7fc6b40fc7a0 msgr2=0x7fc6b40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 shutdown_connections 2024-09-19T09:18:26.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:26.484+0000 7fc6ba97b640 1 -- 172.21.15.46:0/1632126503 wait complete. 2024-09-19T09:18:26.837 INFO:tasks.cephfs.filesystem:scrub status for tag:af90782d-f316-4337-80f9-f278e275c354 - {'path': '/', 'tag': 'af90782d-f316-4337-80f9-f278e275c354', 'options': 'recursive,force'} 2024-09-19T09:18:27.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:26 smithi115 ceph-mon[35055]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:18:27.229 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:26 smithi046 ceph-mon[31203]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:18:27.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:26 smithi099 ceph-mon[35256]: pgmap v342: 97 pgs: 97 active+clean; 649 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T09:18:27.555 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-19T09:18:24.983807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664977,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1236,"num_read_kb":744,"num_write":446,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348204,"kb_used_data":11436,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593620,"statfs":{"total":1151940427776,"available":1151583866880,"internally_reserved":0,"allocated":11710464,"data_stored":7352895,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":57,"num_write":8,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002509"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981549+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:17:58.981549+0000","last_peered":"2024-09-19T09:17:58.981549+0000","last_clean":"2024-09-19T09:17:58.981549+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:17:58.981549+0000","last_undegraded":"2024-09-19T09:17:58.981549+0000","last_fullsized":"2024-09-19T09:17:58.981549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.978712+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:17:58.978712+0000","last_peered":"2024-09-19T09:17:58.978712+0000","last_clean":"2024-09-19T09:17:58.978712+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:17:58.978712+0000","last_undegraded":"2024-09-19T09:17:58.978712+0000","last_fullsized":"2024-09-19T09:17:58.978712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980087+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:17:58.980087+0000","last_peered":"2024-09-19T09:17:58.980087+0000","last_clean":"2024-09-19T09:17:58.980087+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.980087+0000","last_undegraded":"2024-09-19T09:17:58.980087+0000","last_fullsized":"2024-09-19T09:17:58.980087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963459+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:17:58.963459+0000","last_peered":"2024-09-19T09:17:58.963459+0000","last_clean":"2024-09-19T09:17:58.963459+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:17:58.963459+0000","last_undegraded":"2024-09-19T09:17:58.963459+0000","last_fullsized":"2024-09-19T09:17:58.963459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956263+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:17:58.956263+0000","last_peered":"2024-09-19T09:17:58.956263+0000","last_clean":"2024-09-19T09:17:58.956263+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:17:58.956263+0000","last_undegraded":"2024-09-19T09:17:58.956263+0000","last_fullsized":"2024-09-19T09:17:58.956263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970384+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:17:58.970384+0000","last_peered":"2024-09-19T09:17:58.970384+0000","last_clean":"2024-09-19T09:17:58.970384+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:17:58.970384+0000","last_undegraded":"2024-09-19T09:17:58.970384+0000","last_fullsized":"2024-09-19T09:17:58.970384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968788+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:17:58.968788+0000","last_peered":"2024-09-19T09:17:58.968788+0000","last_clean":"2024-09-19T09:17:58.968788+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:17:58.968788+0000","last_undegraded":"2024-09-19T09:17:58.968788+0000","last_fullsized":"2024-09-19T09:17:58.968788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969443+0000","last_change":"2024-09-19T09:17:30.741930+0000","last_active":"2024-09-19T09:17:58.969443+0000","last_peered":"2024-09-19T09:17:58.969443+0000","last_clean":"2024-09-19T09:17:58.969443+0000","last_became_active":"2024-09-19T09:17:30.741704+0000","last_became_peered":"2024-09-19T09:17:30.741704+0000","last_unstale":"2024-09-19T09:17:58.969443+0000","last_undegraded":"2024-09-19T09:17:58.969443+0000","last_fullsized":"2024-09-19T09:17:58.969443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:05.913992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981366+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:17:58.981366+0000","last_peered":"2024-09-19T09:17:58.981366+0000","last_clean":"2024-09-19T09:17:58.981366+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:17:58.981366+0000","last_undegraded":"2024-09-19T09:17:58.981366+0000","last_fullsized":"2024-09-19T09:17:58.981366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968579+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:17:58.968579+0000","last_peered":"2024-09-19T09:17:58.968579+0000","last_clean":"2024-09-19T09:17:58.968579+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:17:58.968579+0000","last_undegraded":"2024-09-19T09:17:58.968579+0000","last_fullsized":"2024-09-19T09:17:58.968579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980413+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:17:58.980413+0000","last_peered":"2024-09-19T09:17:58.980413+0000","last_clean":"2024-09-19T09:17:58.980413+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:17:58.980413+0000","last_undegraded":"2024-09-19T09:17:58.980413+0000","last_fullsized":"2024-09-19T09:17:58.980413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961145+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:17:58.961145+0000","last_peered":"2024-09-19T09:17:58.961145+0000","last_clean":"2024-09-19T09:17:58.961145+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:17:58.961145+0000","last_undegraded":"2024-09-19T09:17:58.961145+0000","last_fullsized":"2024-09-19T09:17:58.961145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967545+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:17:58.967545+0000","last_peered":"2024-09-19T09:17:58.967545+0000","last_clean":"2024-09-19T09:17:58.967545+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:17:58.967545+0000","last_undegraded":"2024-09-19T09:17:58.967545+0000","last_fullsized":"2024-09-19T09:17:58.967545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977708+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:17:58.977708+0000","last_peered":"2024-09-19T09:17:58.977708+0000","last_clean":"2024-09-19T09:17:58.977708+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:17:58.977708+0000","last_undegraded":"2024-09-19T09:17:58.977708+0000","last_fullsized":"2024-09-19T09:17:58.977708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979172+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:17:58.979172+0000","last_peered":"2024-09-19T09:17:58.979172+0000","last_clean":"2024-09-19T09:17:58.979172+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:17:58.979172+0000","last_undegraded":"2024-09-19T09:17:58.979172+0000","last_fullsized":"2024-09-19T09:17:58.979172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981760+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:17:58.981760+0000","last_peered":"2024-09-19T09:17:58.981760+0000","last_clean":"2024-09-19T09:17:58.981760+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:17:58.981760+0000","last_undegraded":"2024-09-19T09:17:58.981760+0000","last_fullsized":"2024-09-19T09:17:58.981760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981803+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:17:58.981803+0000","last_peered":"2024-09-19T09:17:58.981803+0000","last_clean":"2024-09-19T09:17:58.981803+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:17:58.981803+0000","last_undegraded":"2024-09-19T09:17:58.981803+0000","last_fullsized":"2024-09-19T09:17:58.981803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967160+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:17:58.967160+0000","last_peered":"2024-09-19T09:17:58.967160+0000","last_clean":"2024-09-19T09:17:58.967160+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:17:58.967160+0000","last_undegraded":"2024-09-19T09:17:58.967160+0000","last_fullsized":"2024-09-19T09:17:58.967160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967152+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:17:58.967152+0000","last_peered":"2024-09-19T09:17:58.967152+0000","last_clean":"2024-09-19T09:17:58.967152+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:17:58.967152+0000","last_undegraded":"2024-09-19T09:17:58.967152+0000","last_fullsized":"2024-09-19T09:17:58.967152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970437+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:17:58.970437+0000","last_peered":"2024-09-19T09:17:58.970437+0000","last_clean":"2024-09-19T09:17:58.970437+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:17:58.970437+0000","last_undegraded":"2024-09-19T09:17:58.970437+0000","last_fullsized":"2024-09-19T09:17:58.970437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980591+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:17:58.980591+0000","last_peered":"2024-09-19T09:17:58.980591+0000","last_clean":"2024-09-19T09:17:58.980591+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:17:58.980591+0000","last_undegraded":"2024-09-19T09:17:58.980591+0000","last_fullsized":"2024-09-19T09:17:58.980591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981630+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:17:58.981630+0000","last_peered":"2024-09-19T09:17:58.981630+0000","last_clean":"2024-09-19T09:17:58.981630+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:17:58.981630+0000","last_undegraded":"2024-09-19T09:17:58.981630+0000","last_fullsized":"2024-09-19T09:17:58.981630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968614+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:17:58.968614+0000","last_peered":"2024-09-19T09:17:58.968614+0000","last_clean":"2024-09-19T09:17:58.968614+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:17:58.968614+0000","last_undegraded":"2024-09-19T09:17:58.968614+0000","last_fullsized":"2024-09-19T09:17:58.968614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961162+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:17:58.961162+0000","last_peered":"2024-09-19T09:17:58.961162+0000","last_clean":"2024-09-19T09:17:58.961162+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:17:58.961162+0000","last_undegraded":"2024-09-19T09:17:58.961162+0000","last_fullsized":"2024-09-19T09:17:58.961162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968911+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:17:58.968911+0000","last_peered":"2024-09-19T09:17:58.968911+0000","last_clean":"2024-09-19T09:17:58.968911+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:17:58.968911+0000","last_undegraded":"2024-09-19T09:17:58.968911+0000","last_fullsized":"2024-09-19T09:17:58.968911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981030+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:17:58.981030+0000","last_peered":"2024-09-19T09:17:58.981030+0000","last_clean":"2024-09-19T09:17:58.981030+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:17:58.981030+0000","last_undegraded":"2024-09-19T09:17:58.981030+0000","last_fullsized":"2024-09-19T09:17:58.981030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969254+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:17:58.969254+0000","last_peered":"2024-09-19T09:17:58.969254+0000","last_clean":"2024-09-19T09:17:58.969254+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:17:58.969254+0000","last_undegraded":"2024-09-19T09:17:58.969254+0000","last_fullsized":"2024-09-19T09:17:58.969254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979843+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:17:58.979843+0000","last_peered":"2024-09-19T09:17:58.979843+0000","last_clean":"2024-09-19T09:17:58.979843+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:17:58.979843+0000","last_undegraded":"2024-09-19T09:17:58.979843+0000","last_fullsized":"2024-09-19T09:17:58.979843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977631+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:17:58.977631+0000","last_peered":"2024-09-19T09:17:58.977631+0000","last_clean":"2024-09-19T09:17:58.977631+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:17:58.977631+0000","last_undegraded":"2024-09-19T09:17:58.977631+0000","last_fullsized":"2024-09-19T09:17:58.977631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980454+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:17:58.980454+0000","last_peered":"2024-09-19T09:17:58.980454+0000","last_clean":"2024-09-19T09:17:58.980454+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:17:58.980454+0000","last_undegraded":"2024-09-19T09:17:58.980454+0000","last_fullsized":"2024-09-19T09:17:58.980454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966717+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:17:58.966717+0000","last_peered":"2024-09-19T09:17:58.966717+0000","last_clean":"2024-09-19T09:17:58.966717+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:17:58.966717+0000","last_undegraded":"2024-09-19T09:17:58.966717+0000","last_fullsized":"2024-09-19T09:17:58.966717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970020+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:17:58.970020+0000","last_peered":"2024-09-19T09:17:58.970020+0000","last_clean":"2024-09-19T09:17:58.970020+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:17:58.970020+0000","last_undegraded":"2024-09-19T09:17:58.970020+0000","last_fullsized":"2024-09-19T09:17:58.970020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.957135+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:17:58.957135+0000","last_peered":"2024-09-19T09:17:58.957135+0000","last_clean":"2024-09-19T09:17:58.957135+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:17:58.957135+0000","last_undegraded":"2024-09-19T09:17:58.957135+0000","last_fullsized":"2024-09-19T09:17:58.957135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:23.197107+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:18:23.197107+0000","last_peered":"2024-09-19T09:18:23.197107+0000","last_clean":"2024-09-19T09:18:23.197107+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:18:23.197107+0000","last_undegraded":"2024-09-19T09:18:23.197107+0000","last_fullsized":"2024-09-19T09:18:23.197107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.965388+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:17:58.965388+0000","last_peered":"2024-09-19T09:17:58.965388+0000","last_clean":"2024-09-19T09:17:58.965388+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:17:58.965388+0000","last_undegraded":"2024-09-19T09:17:58.965388+0000","last_fullsized":"2024-09-19T09:17:58.965388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.740826+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:17:30.740826+0000","last_peered":"2024-09-19T09:17:30.740826+0000","last_clean":"2024-09-19T09:17:30.740826+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:17:30.740826+0000","last_undegraded":"2024-09-19T09:17:30.740826+0000","last_fullsized":"2024-09-19T09:17:30.740826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.699545+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:17:30.699545+0000","last_peered":"2024-09-19T09:17:30.699545+0000","last_clean":"2024-09-19T09:17:30.699545+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:17:30.699545+0000","last_undegraded":"2024-09-19T09:17:30.699545+0000","last_fullsized":"2024-09-19T09:17:30.699545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970622+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:17:58.970622+0000","last_peered":"2024-09-19T09:17:58.970622+0000","last_clean":"2024-09-19T09:17:58.970622+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:17:58.970622+0000","last_undegraded":"2024-09-19T09:17:58.970622+0000","last_fullsized":"2024-09-19T09:17:58.970622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701519+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:17:30.701519+0000","last_peered":"2024-09-19T09:17:30.701519+0000","last_clean":"2024-09-19T09:17:30.701519+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:17:30.701519+0000","last_undegraded":"2024-09-19T09:17:30.701519+0000","last_fullsized":"2024-09-19T09:17:30.701519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970260+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:17:58.970260+0000","last_peered":"2024-09-19T09:17:58.970260+0000","last_clean":"2024-09-19T09:17:58.970260+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:17:58.970260+0000","last_undegraded":"2024-09-19T09:17:58.970260+0000","last_fullsized":"2024-09-19T09:17:58.970260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'6","reported_seq":240,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:21.193693+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:18:21.193693+0000","last_peered":"2024-09-19T09:18:21.193693+0000","last_clean":"2024-09-19T09:18:21.193693+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:18:21.193693+0000","last_undegraded":"2024-09-19T09:18:21.193693+0000","last_fullsized":"2024-09-19T09:18:21.193693+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.976566+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:17:58.976566+0000","last_peered":"2024-09-19T09:17:58.976566+0000","last_clean":"2024-09-19T09:17:58.976566+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:17:58.976566+0000","last_undegraded":"2024-09-19T09:17:58.976566+0000","last_fullsized":"2024-09-19T09:17:58.976566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701780+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:17:30.701780+0000","last_peered":"2024-09-19T09:17:30.701780+0000","last_clean":"2024-09-19T09:17:30.701780+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:17:30.701780+0000","last_undegraded":"2024-09-19T09:17:30.701780+0000","last_fullsized":"2024-09-19T09:17:30.701780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979267+0000","last_change":"2024-09-19T09:17:30.711986+0000","last_active":"2024-09-19T09:17:58.979267+0000","last_peered":"2024-09-19T09:17:58.979267+0000","last_clean":"2024-09-19T09:17:58.979267+0000","last_became_active":"2024-09-19T09:17:30.711751+0000","last_became_peered":"2024-09-19T09:17:30.711751+0000","last_unstale":"2024-09-19T09:17:58.979267+0000","last_undegraded":"2024-09-19T09:17:58.979267+0000","last_fullsized":"2024-09-19T09:17:58.979267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:18.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701396+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:17:30.701396+0000","last_peered":"2024-09-19T09:17:30.701396+0000","last_clean":"2024-09-19T09:17:30.701396+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:17:30.701396+0000","last_undegraded":"2024-09-19T09:17:30.701396+0000","last_fullsized":"2024-09-19T09:17:30.701396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979992+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:17:58.979992+0000","last_peered":"2024-09-19T09:17:58.979992+0000","last_clean":"2024-09-19T09:17:58.979992+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:17:58.979992+0000","last_undegraded":"2024-09-19T09:17:58.979992+0000","last_fullsized":"2024-09-19T09:17:58.979992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'37","reported_seq":283,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:21.193696+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:18:21.193696+0000","last_peered":"2024-09-19T09:18:21.193696+0000","last_clean":"2024-09-19T09:18:21.193696+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:18:21.193696+0000","last_undegraded":"2024-09-19T09:18:21.193696+0000","last_fullsized":"2024-09-19T09:18:21.193696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66043,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":224,"num_read_kb":176,"num_write":39,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967581+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:17:58.967581+0000","last_peered":"2024-09-19T09:17:58.967581+0000","last_clean":"2024-09-19T09:17:58.967581+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:17:58.967581+0000","last_undegraded":"2024-09-19T09:17:58.967581+0000","last_fullsized":"2024-09-19T09:17:58.967581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701982+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:17:30.701982+0000","last_peered":"2024-09-19T09:17:30.701982+0000","last_clean":"2024-09-19T09:17:30.701982+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:17:30.701982+0000","last_undegraded":"2024-09-19T09:17:30.701982+0000","last_fullsized":"2024-09-19T09:17:30.701982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956062+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:17:58.956062+0000","last_peered":"2024-09-19T09:17:58.956062+0000","last_clean":"2024-09-19T09:17:58.956062+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:17:58.956062+0000","last_undegraded":"2024-09-19T09:17:58.956062+0000","last_fullsized":"2024-09-19T09:17:58.956062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701288+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:17:30.701288+0000","last_peered":"2024-09-19T09:17:30.701288+0000","last_clean":"2024-09-19T09:17:30.701288+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:17:30.701288+0000","last_undegraded":"2024-09-19T09:17:30.701288+0000","last_fullsized":"2024-09-19T09:17:30.701288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.971893+0000","last_change":"2024-09-19T09:17:30.706308+0000","last_active":"2024-09-19T09:17:58.971893+0000","last_peered":"2024-09-19T09:17:58.971893+0000","last_clean":"2024-09-19T09:17:58.971893+0000","last_became_active":"2024-09-19T09:17:30.705841+0000","last_became_peered":"2024-09-19T09:17:30.705841+0000","last_unstale":"2024-09-19T09:17:58.971893+0000","last_undegraded":"2024-09-19T09:17:58.971893+0000","last_fullsized":"2024-09-19T09:17:58.971893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:23.196866+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:18:23.196866+0000","last_peered":"2024-09-19T09:18:23.196866+0000","last_clean":"2024-09-19T09:18:23.196866+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:18:23.196866+0000","last_undegraded":"2024-09-19T09:18:23.196866+0000","last_fullsized":"2024-09-19T09:18:23.196866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969899+0000","last_change":"2024-09-19T09:17:30.742259+0000","last_active":"2024-09-19T09:17:58.969899+0000","last_peered":"2024-09-19T09:17:58.969899+0000","last_clean":"2024-09-19T09:17:58.969899+0000","last_became_active":"2024-09-19T09:17:30.741880+0000","last_became_peered":"2024-09-19T09:17:30.741880+0000","last_unstale":"2024-09-19T09:17:58.969899+0000","last_undegraded":"2024-09-19T09:17:58.969899+0000","last_fullsized":"2024-09-19T09:17:58.969899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:33.736292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706370+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:17:30.706370+0000","last_peered":"2024-09-19T09:17:30.706370+0000","last_clean":"2024-09-19T09:17:30.706370+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:17:30.706370+0000","last_undegraded":"2024-09-19T09:17:30.706370+0000","last_fullsized":"2024-09-19T09:17:30.706370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.974073+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:17:58.974073+0000","last_peered":"2024-09-19T09:17:58.974073+0000","last_clean":"2024-09-19T09:17:58.974073+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:17:58.974073+0000","last_undegraded":"2024-09-19T09:17:58.974073+0000","last_fullsized":"2024-09-19T09:17:58.974073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.716217+0000","last_change":"2024-09-19T09:17:30.715839+0000","last_active":"2024-09-19T09:17:30.716217+0000","last_peered":"2024-09-19T09:17:30.716217+0000","last_clean":"2024-09-19T09:17:30.716217+0000","last_became_active":"2024-09-19T09:17:30.707470+0000","last_became_peered":"2024-09-19T09:17:30.707470+0000","last_unstale":"2024-09-19T09:17:30.716217+0000","last_undegraded":"2024-09-19T09:17:30.716217+0000","last_fullsized":"2024-09-19T09:17:30.716217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.090063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969162+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:17:58.969162+0000","last_peered":"2024-09-19T09:17:58.969162+0000","last_clean":"2024-09-19T09:17:58.969162+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:17:58.969162+0000","last_undegraded":"2024-09-19T09:17:58.969162+0000","last_fullsized":"2024-09-19T09:17:58.969162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.719006+0000","last_change":"2024-09-19T09:17:30.719006+0000","last_active":"2024-09-19T09:17:30.719006+0000","last_peered":"2024-09-19T09:17:30.719006+0000","last_clean":"2024-09-19T09:17:30.719006+0000","last_became_active":"2024-09-19T09:17:30.709645+0000","last_became_peered":"2024-09-19T09:17:30.709645+0000","last_unstale":"2024-09-19T09:17:30.719006+0000","last_undegraded":"2024-09-19T09:17:30.719006+0000","last_fullsized":"2024-09-19T09:17:30.719006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:41.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977582+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:17:58.977582+0000","last_peered":"2024-09-19T09:17:58.977582+0000","last_clean":"2024-09-19T09:17:58.977582+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:17:58.977582+0000","last_undegraded":"2024-09-19T09:17:58.977582+0000","last_fullsized":"2024-09-19T09:17:58.977582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701511+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:17:30.701511+0000","last_peered":"2024-09-19T09:17:30.701511+0000","last_clean":"2024-09-19T09:17:30.701511+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:17:30.701511+0000","last_undegraded":"2024-09-19T09:17:30.701511+0000","last_fullsized":"2024-09-19T09:17:30.701511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968174+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:17:58.968174+0000","last_peered":"2024-09-19T09:17:58.968174+0000","last_clean":"2024-09-19T09:17:58.968174+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:17:58.968174+0000","last_undegraded":"2024-09-19T09:17:58.968174+0000","last_fullsized":"2024-09-19T09:17:58.968174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:18.190201+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:18:18.190201+0000","last_peered":"2024-09-19T09:18:18.190201+0000","last_clean":"2024-09-19T09:18:18.190201+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:18:18.190201+0000","last_undegraded":"2024-09-19T09:18:18.190201+0000","last_fullsized":"2024-09-19T09:18:18.190201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980166+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:17:58.980166+0000","last_peered":"2024-09-19T09:17:58.980166+0000","last_clean":"2024-09-19T09:17:58.980166+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:17:58.980166+0000","last_undegraded":"2024-09-19T09:17:58.980166+0000","last_fullsized":"2024-09-19T09:17:58.980166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702339+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:17:30.702339+0000","last_peered":"2024-09-19T09:17:30.702339+0000","last_clean":"2024-09-19T09:17:30.702339+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:17:30.702339+0000","last_undegraded":"2024-09-19T09:17:30.702339+0000","last_fullsized":"2024-09-19T09:17:30.702339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.707109+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:17:30.707109+0000","last_peered":"2024-09-19T09:17:30.707109+0000","last_clean":"2024-09-19T09:17:30.707109+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:17:30.707109+0000","last_undegraded":"2024-09-19T09:17:30.707109+0000","last_fullsized":"2024-09-19T09:17:30.707109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977434+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:17:58.977434+0000","last_peered":"2024-09-19T09:17:58.977434+0000","last_clean":"2024-09-19T09:17:58.977434+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:17:58.977434+0000","last_undegraded":"2024-09-19T09:17:58.977434+0000","last_fullsized":"2024-09-19T09:17:58.977434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702100+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:17:30.702100+0000","last_peered":"2024-09-19T09:17:30.702100+0000","last_clean":"2024-09-19T09:17:30.702100+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:17:30.702100+0000","last_undegraded":"2024-09-19T09:17:30.702100+0000","last_fullsized":"2024-09-19T09:17:30.702100+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961956+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:17:58.961956+0000","last_peered":"2024-09-19T09:17:58.961956+0000","last_clean":"2024-09-19T09:17:58.961956+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.961956+0000","last_undegraded":"2024-09-19T09:17:58.961956+0000","last_fullsized":"2024-09-19T09:17:58.961956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":133,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:19.190880+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:18:19.190880+0000","last_peered":"2024-09-19T09:18:19.190880+0000","last_clean":"2024-09-19T09:18:19.190880+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:18:19.190880+0000","last_undegraded":"2024-09-19T09:18:19.190880+0000","last_fullsized":"2024-09-19T09:18:19.190880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963420+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:17:58.963420+0000","last_peered":"2024-09-19T09:17:58.963420+0000","last_clean":"2024-09-19T09:17:58.963420+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:17:58.963420+0000","last_undegraded":"2024-09-19T09:17:58.963420+0000","last_fullsized":"2024-09-19T09:17:58.963420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'8","reported_seq":139,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:19.191201+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:18:19.191201+0000","last_peered":"2024-09-19T09:18:19.191201+0000","last_clean":"2024-09-19T09:18:19.191201+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:18:19.191201+0000","last_undegraded":"2024-09-19T09:18:19.191201+0000","last_fullsized":"2024-09-19T09:18:19.191201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967435+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:17:58.967435+0000","last_peered":"2024-09-19T09:17:58.967435+0000","last_clean":"2024-09-19T09:17:58.967435+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:17:58.967435+0000","last_undegraded":"2024-09-19T09:17:58.967435+0000","last_fullsized":"2024-09-19T09:17:58.967435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.704404+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:17:30.704404+0000","last_peered":"2024-09-19T09:17:30.704404+0000","last_clean":"2024-09-19T09:17:30.704404+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:17:30.704404+0000","last_undegraded":"2024-09-19T09:17:30.704404+0000","last_fullsized":"2024-09-19T09:17:30.704404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970687+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:17:58.970687+0000","last_peered":"2024-09-19T09:17:58.970687+0000","last_clean":"2024-09-19T09:17:58.970687+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:17:58.970687+0000","last_undegraded":"2024-09-19T09:17:58.970687+0000","last_fullsized":"2024-09-19T09:17:58.970687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706919+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:17:30.706919+0000","last_peered":"2024-09-19T09:17:30.706919+0000","last_clean":"2024-09-19T09:17:30.706919+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:17:30.706919+0000","last_undegraded":"2024-09-19T09:17:30.706919+0000","last_fullsized":"2024-09-19T09:17:30.706919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.962302+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:17:58.962302+0000","last_peered":"2024-09-19T09:17:58.962302+0000","last_clean":"2024-09-19T09:17:58.962302+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:17:58.962302+0000","last_undegraded":"2024-09-19T09:17:58.962302+0000","last_fullsized":"2024-09-19T09:17:58.962302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:59.005140+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:17:59.005140+0000","last_peered":"2024-09-19T09:17:59.005140+0000","last_clean":"2024-09-19T09:17:59.005140+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:17:59.005140+0000","last_undegraded":"2024-09-19T09:17:59.005140+0000","last_fullsized":"2024-09-19T09:17:59.005140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970983+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:17:58.970983+0000","last_peered":"2024-09-19T09:17:58.970983+0000","last_clean":"2024-09-19T09:17:58.970983+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:17:58.970983+0000","last_undegraded":"2024-09-19T09:17:58.970983+0000","last_fullsized":"2024-09-19T09:17:58.970983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706710+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:17:30.706710+0000","last_peered":"2024-09-19T09:17:30.706710+0000","last_clean":"2024-09-19T09:17:30.706710+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:17:30.706710+0000","last_undegraded":"2024-09-19T09:17:30.706710+0000","last_fullsized":"2024-09-19T09:17:30.706710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979125+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:17:58.979125+0000","last_peered":"2024-09-19T09:17:58.979125+0000","last_clean":"2024-09-19T09:17:58.979125+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:17:58.979125+0000","last_undegraded":"2024-09-19T09:17:58.979125+0000","last_fullsized":"2024-09-19T09:17:58.979125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.700552+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:17:30.700552+0000","last_peered":"2024-09-19T09:17:30.700552+0000","last_clean":"2024-09-19T09:17:30.700552+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:17:30.700552+0000","last_undegraded":"2024-09-19T09:17:30.700552+0000","last_fullsized":"2024-09-19T09:17:30.700552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.933118+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:17:58.933118+0000","last_peered":"2024-09-19T09:17:58.933118+0000","last_clean":"2024-09-19T09:17:58.933118+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:17:58.933118+0000","last_undegraded":"2024-09-19T09:17:58.933118+0000","last_fullsized":"2024-09-19T09:17:58.933118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702269+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:17:30.702269+0000","last_peered":"2024-09-19T09:17:30.702269+0000","last_clean":"2024-09-19T09:17:30.702269+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:17:30.702269+0000","last_undegraded":"2024-09-19T09:17:30.702269+0000","last_fullsized":"2024-09-19T09:17:30.702269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975139+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:17:58.975139+0000","last_peered":"2024-09-19T09:17:58.975139+0000","last_clean":"2024-09-19T09:17:58.975139+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:17:58.975139+0000","last_undegraded":"2024-09-19T09:17:58.975139+0000","last_fullsized":"2024-09-19T09:17:58.975139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.722791+0000","last_change":"2024-09-19T09:17:30.722376+0000","last_active":"2024-09-19T09:17:30.722791+0000","last_peered":"2024-09-19T09:17:30.722791+0000","last_clean":"2024-09-19T09:17:30.722791+0000","last_became_active":"2024-09-19T09:17:30.709277+0000","last_became_peered":"2024-09-19T09:17:30.709277+0000","last_unstale":"2024-09-19T09:17:30.722791+0000","last_undegraded":"2024-09-19T09:17:30.722791+0000","last_fullsized":"2024-09-19T09:17:30.722791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.341264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980029+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:17:58.980029+0000","last_peered":"2024-09-19T09:17:58.980029+0000","last_clean":"2024-09-19T09:17:58.980029+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:17:58.980029+0000","last_undegraded":"2024-09-19T09:17:58.980029+0000","last_fullsized":"2024-09-19T09:17:58.980029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706536+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:17:30.706536+0000","last_peered":"2024-09-19T09:17:30.706536+0000","last_clean":"2024-09-19T09:17:30.706536+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:17:30.706536+0000","last_undegraded":"2024-09-19T09:17:30.706536+0000","last_fullsized":"2024-09-19T09:17:30.706536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979969+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:17:58.979969+0000","last_peered":"2024-09-19T09:17:58.979969+0000","last_clean":"2024-09-19T09:17:58.979969+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:17:58.979969+0000","last_undegraded":"2024-09-19T09:17:58.979969+0000","last_fullsized":"2024-09-19T09:17:58.979969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980085+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:17:58.980085+0000","last_peered":"2024-09-19T09:17:58.980085+0000","last_clean":"2024-09-19T09:17:58.980085+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:17:58.980085+0000","last_undegraded":"2024-09-19T09:17:58.980085+0000","last_fullsized":"2024-09-19T09:17:58.980085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706809+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:17:30.706809+0000","last_peered":"2024-09-19T09:17:30.706809+0000","last_clean":"2024-09-19T09:17:30.706809+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:17:30.706809+0000","last_undegraded":"2024-09-19T09:17:30.706809+0000","last_fullsized":"2024-09-19T09:17:30.706809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975767+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:17:58.975767+0000","last_peered":"2024-09-19T09:17:58.975767+0000","last_clean":"2024-09-19T09:17:58.975767+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:17:58.975767+0000","last_undegraded":"2024-09-19T09:17:58.975767+0000","last_fullsized":"2024-09-19T09:17:58.975767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'13","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706829+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:17:30.706829+0000","last_peered":"2024-09-19T09:17:30.706829+0000","last_clean":"2024-09-19T09:17:30.706829+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:17:30.706829+0000","last_undegraded":"2024-09-19T09:17:30.706829+0000","last_fullsized":"2024-09-19T09:17:30.706829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981137+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:17:58.981137+0000","last_peered":"2024-09-19T09:17:58.981137+0000","last_clean":"2024-09-19T09:17:58.981137+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:17:58.981137+0000","last_undegraded":"2024-09-19T09:17:58.981137+0000","last_fullsized":"2024-09-19T09:17:58.981137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702953+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:17:30.702953+0000","last_peered":"2024-09-19T09:17:30.702953+0000","last_clean":"2024-09-19T09:17:30.702953+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:17:30.702953+0000","last_undegraded":"2024-09-19T09:17:30.702953+0000","last_fullsized":"2024-09-19T09:17:30.702953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967339+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:17:58.967339+0000","last_peered":"2024-09-19T09:17:58.967339+0000","last_clean":"2024-09-19T09:17:58.967339+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:17:58.967339+0000","last_undegraded":"2024-09-19T09:17:58.967339+0000","last_fullsized":"2024-09-19T09:17:58.967339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":143,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:20.192226+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:18:20.192226+0000","last_peered":"2024-09-19T09:18:20.192226+0000","last_clean":"2024-09-19T09:18:20.192226+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:18:20.192226+0000","last_undegraded":"2024-09-19T09:18:20.192226+0000","last_fullsized":"2024-09-19T09:18:20.192226+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74375,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1110,"num_read_kb":635,"num_write":263,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":448245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1085440,"data_stored":1104761,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939696,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201333,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":447975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":1041500,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":448178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1040336,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":447197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":515580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":515134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:18:27.560 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:18:27.560 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:18:27.826 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:28.198 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:27 smithi046 ceph-mon[31203]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:28.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:27 smithi115 ceph-mon[35055]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:28.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:27 smithi099 ceph-mon[35256]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 -- 172.21.15.46:0/3005741579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 msgr2=0x7f9404107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 --2- 172.21.15.46:0/3005741579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404107ba0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009930 tx=0x7f93f402a420 comp rx=0 tx=0).stop 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 -- 172.21.15.46:0/3005741579 shutdown_connections 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 --2- 172.21.15.46:0/3005741579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404107ba0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 --2- 172.21.15.46:0/3005741579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94041082e0 0x7f940410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 --2- 172.21.15.46:0/3005741579 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9404102db0 0x7f9404103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 -- 172.21.15.46:0/3005741579 >> 172.21.15.46:0/3005741579 conn(0x7f94040fc7d0 msgr2=0x7f94040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 -- 172.21.15.46:0/3005741579 shutdown_connections 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.288+0000 7f940bae5640 1 -- 172.21.15.46:0/3005741579 wait complete. 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 Processor -- start 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 -- start start 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404102db0 0x7f9404100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94041082e0 0x7f9404101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9404112050 con 0x7f9404103760 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9404111ed0 con 0x7f9404102db0 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.289+0000 7f940bae5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f94041121d0 con 0x7f94041082e0 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34030/0 (socket says 172.21.15.46:34030) 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409881640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404102db0 0x7f9404100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 -- 172.21.15.46:0/4179144195 learned_addr learned my addr 172.21.15.46:0/4179144195 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f940a082640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94041082e0 0x7f9404101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 -- 172.21.15.46:0/4179144195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94041082e0 msgr2=0x7f9404101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94041082e0 0x7f9404101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 -- 172.21.15.46:0/4179144195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404102db0 msgr2=0x7f9404100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404102db0 0x7f9404100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 -- 172.21.15.46:0/4179144195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94041a6a70 con 0x7f9404103760 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409881640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404102db0 0x7f9404100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f9409080640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404100f50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005940 tx=0x7f93f4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.290+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f403f070 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.291+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94041a6d00 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.291+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93f4031c30 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.291+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4035030 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.291+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94041a71d0 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.292+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9404103190 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.294+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f93f4042070 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.295+0000 7f93faffd640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f93f00a3240 0x7f93f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.295+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f93f40f0540 con 0x7f9404103760 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.295+0000 7f9409881640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f93f00a3240 0x7f93f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.295+0000 7f9409881640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f93f00a3240 0x7f93f00a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9400009fc0 tx=0x7f9400005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.297+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93f4031de0 con 0x7f9404103760 2024-09-19T09:18:28.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.473+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 --> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9404062630 con 0x7f93f00a3240 2024-09-19T09:18:28.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.486+0000 7f93faffd640 1 -- 172.21.15.46:0/4179144195 <== mgr.14150 v2:172.21.15.46:6800/1744336406 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258984 (secure 0 0 0) 0x7f9404062630 con 0x7f93f00a3240 2024-09-19T09:18:28.489 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:28.490 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-19T09:18:28.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.490+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f93f00a3240 msgr2=0x7f93f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.490+0000 7f940bae5640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f93f00a3240 0x7f93f00a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9400009fc0 tx=0x7f9400005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:28.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.490+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 msgr2=0x7f9404100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.490+0000 7f940bae5640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404100f50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005940 tx=0x7f93f4003c10 comp rx=0 tx=0).stop 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.491+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 shutdown_connections 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.491+0000 7f940bae5640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f93f00a3240 0x7f93f00a5700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.491+0000 7f940bae5640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9404103760 0x7f9404100f50 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f93f4005940 tx=0x7f93f4003c10 comp rx=0 tx=0).stop 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.491+0000 7f940bae5640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94041082e0 0x7f9404101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.491+0000 7f940bae5640 1 --2- 172.21.15.46:0/4179144195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9404102db0 0x7f9404100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.491+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 >> 172.21.15.46:0/4179144195 conn(0x7f94040fc7d0 msgr2=0x7f9404105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.492+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 shutdown_connections 2024-09-19T09:18:28.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:28.492+0000 7f940bae5640 1 -- 172.21.15.46:0/4179144195 wait complete. 2024-09-19T09:18:29.143 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:28 smithi046 ceph-mon[31203]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:18:29.143 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:28 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:29.173 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T09:18:26.984284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666115,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1279,"num_read_kb":773,"num_write":447,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":348216,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":336557,"kb_avail":1124593608,"statfs":{"total":1151940427776,"available":1151583854592,"internally_reserved":0,"allocated":11722752,"data_stored":7356309,"data_compressed":108759,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19140,"internal_metadata":344634684},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6068,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":86,"num_write":9,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002565"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981549+0000","last_change":"2024-09-19T09:16:23.989187+0000","last_active":"2024-09-19T09:17:58.981549+0000","last_peered":"2024-09-19T09:17:58.981549+0000","last_clean":"2024-09-19T09:17:58.981549+0000","last_became_active":"2024-09-19T09:16:23.988878+0000","last_became_peered":"2024-09-19T09:16:23.988878+0000","last_unstale":"2024-09-19T09:17:58.981549+0000","last_undegraded":"2024-09-19T09:17:58.981549+0000","last_fullsized":"2024-09-19T09:17:58.981549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:53.393047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.978712+0000","last_change":"2024-09-19T09:16:23.984380+0000","last_active":"2024-09-19T09:17:58.978712+0000","last_peered":"2024-09-19T09:17:58.978712+0000","last_clean":"2024-09-19T09:17:58.978712+0000","last_became_active":"2024-09-19T09:16:23.984074+0000","last_became_peered":"2024-09-19T09:16:23.984074+0000","last_unstale":"2024-09-19T09:17:58.978712+0000","last_undegraded":"2024-09-19T09:17:58.978712+0000","last_fullsized":"2024-09-19T09:17:58.978712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:56.769877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980087+0000","last_change":"2024-09-19T09:16:23.991999+0000","last_active":"2024-09-19T09:17:58.980087+0000","last_peered":"2024-09-19T09:17:58.980087+0000","last_clean":"2024-09-19T09:17:58.980087+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.980087+0000","last_undegraded":"2024-09-19T09:17:58.980087+0000","last_fullsized":"2024-09-19T09:17:58.980087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:55.357707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963459+0000","last_change":"2024-09-19T09:16:23.991576+0000","last_active":"2024-09-19T09:17:58.963459+0000","last_peered":"2024-09-19T09:17:58.963459+0000","last_clean":"2024-09-19T09:17:58.963459+0000","last_became_active":"2024-09-19T09:16:23.991264+0000","last_became_peered":"2024-09-19T09:16:23.991264+0000","last_unstale":"2024-09-19T09:17:58.963459+0000","last_undegraded":"2024-09-19T09:17:58.963459+0000","last_fullsized":"2024-09-19T09:17:58.963459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:19.428812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956263+0000","last_change":"2024-09-19T09:16:23.987245+0000","last_active":"2024-09-19T09:17:58.956263+0000","last_peered":"2024-09-19T09:17:58.956263+0000","last_clean":"2024-09-19T09:17:58.956263+0000","last_became_active":"2024-09-19T09:16:23.986941+0000","last_became_peered":"2024-09-19T09:16:23.986941+0000","last_unstale":"2024-09-19T09:17:58.956263+0000","last_undegraded":"2024-09-19T09:17:58.956263+0000","last_fullsized":"2024-09-19T09:17:58.956263+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.934591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970384+0000","last_change":"2024-09-19T09:16:23.989226+0000","last_active":"2024-09-19T09:17:58.970384+0000","last_peered":"2024-09-19T09:17:58.970384+0000","last_clean":"2024-09-19T09:17:58.970384+0000","last_became_active":"2024-09-19T09:16:23.987933+0000","last_became_peered":"2024-09-19T09:16:23.987933+0000","last_unstale":"2024-09-19T09:17:58.970384+0000","last_undegraded":"2024-09-19T09:17:58.970384+0000","last_fullsized":"2024-09-19T09:17:58.970384+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:21.558792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968788+0000","last_change":"2024-09-19T09:16:23.989206+0000","last_active":"2024-09-19T09:17:58.968788+0000","last_peered":"2024-09-19T09:17:58.968788+0000","last_clean":"2024-09-19T09:17:58.968788+0000","last_became_active":"2024-09-19T09:16:23.988883+0000","last_became_peered":"2024-09-19T09:16:23.988883+0000","last_unstale":"2024-09-19T09:17:58.968788+0000","last_undegraded":"2024-09-19T09:17:58.968788+0000","last_fullsized":"2024-09-19T09:17:58.968788+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.748785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969443+0000","last_change":"2024-09-19T09:17:30.741930+0000","last_active":"2024-09-19T09:17:58.969443+0000","last_peered":"2024-09-19T09:17:58.969443+0000","last_clean":"2024-09-19T09:17:58.969443+0000","last_became_active":"2024-09-19T09:17:30.741704+0000","last_became_peered":"2024-09-19T09:17:30.741704+0000","last_unstale":"2024-09-19T09:17:58.969443+0000","last_undegraded":"2024-09-19T09:17:58.969443+0000","last_fullsized":"2024-09-19T09:17:58.969443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:05.913992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981366+0000","last_change":"2024-09-19T09:16:23.997227+0000","last_active":"2024-09-19T09:17:58.981366+0000","last_peered":"2024-09-19T09:17:58.981366+0000","last_clean":"2024-09-19T09:17:58.981366+0000","last_became_active":"2024-09-19T09:16:23.996890+0000","last_became_peered":"2024-09-19T09:16:23.996890+0000","last_unstale":"2024-09-19T09:17:58.981366+0000","last_undegraded":"2024-09-19T09:17:58.981366+0000","last_fullsized":"2024-09-19T09:17:58.981366+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:26.970143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968579+0000","last_change":"2024-09-19T09:16:23.992988+0000","last_active":"2024-09-19T09:17:58.968579+0000","last_peered":"2024-09-19T09:17:58.968579+0000","last_clean":"2024-09-19T09:17:58.968579+0000","last_became_active":"2024-09-19T09:16:23.992638+0000","last_became_peered":"2024-09-19T09:16:23.992638+0000","last_unstale":"2024-09-19T09:17:58.968579+0000","last_undegraded":"2024-09-19T09:17:58.968579+0000","last_fullsized":"2024-09-19T09:17:58.968579+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:09.244702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980413+0000","last_change":"2024-09-19T09:16:23.991459+0000","last_active":"2024-09-19T09:17:58.980413+0000","last_peered":"2024-09-19T09:17:58.980413+0000","last_clean":"2024-09-19T09:17:58.980413+0000","last_became_active":"2024-09-19T09:16:23.990569+0000","last_became_peered":"2024-09-19T09:16:23.990569+0000","last_unstale":"2024-09-19T09:17:58.980413+0000","last_undegraded":"2024-09-19T09:17:58.980413+0000","last_fullsized":"2024-09-19T09:17:58.980413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:29.389452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961145+0000","last_change":"2024-09-19T09:16:23.994028+0000","last_active":"2024-09-19T09:17:58.961145+0000","last_peered":"2024-09-19T09:17:58.961145+0000","last_clean":"2024-09-19T09:17:58.961145+0000","last_became_active":"2024-09-19T09:16:23.993617+0000","last_became_peered":"2024-09-19T09:16:23.993617+0000","last_unstale":"2024-09-19T09:17:58.961145+0000","last_undegraded":"2024-09-19T09:17:58.961145+0000","last_fullsized":"2024-09-19T09:17:58.961145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:19.174013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967545+0000","last_change":"2024-09-19T09:16:23.993431+0000","last_active":"2024-09-19T09:17:58.967545+0000","last_peered":"2024-09-19T09:17:58.967545+0000","last_clean":"2024-09-19T09:17:58.967545+0000","last_became_active":"2024-09-19T09:16:23.993139+0000","last_became_peered":"2024-09-19T09:16:23.993139+0000","last_unstale":"2024-09-19T09:17:58.967545+0000","last_undegraded":"2024-09-19T09:17:58.967545+0000","last_fullsized":"2024-09-19T09:17:58.967545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:16.895871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977708+0000","last_change":"2024-09-19T09:16:23.991430+0000","last_active":"2024-09-19T09:17:58.977708+0000","last_peered":"2024-09-19T09:17:58.977708+0000","last_clean":"2024-09-19T09:17:58.977708+0000","last_became_active":"2024-09-19T09:16:23.991050+0000","last_became_peered":"2024-09-19T09:16:23.991050+0000","last_unstale":"2024-09-19T09:17:58.977708+0000","last_undegraded":"2024-09-19T09:17:58.977708+0000","last_fullsized":"2024-09-19T09:17:58.977708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:17.071796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979172+0000","last_change":"2024-09-19T09:16:23.992279+0000","last_active":"2024-09-19T09:17:58.979172+0000","last_peered":"2024-09-19T09:17:58.979172+0000","last_clean":"2024-09-19T09:17:58.979172+0000","last_became_active":"2024-09-19T09:16:23.991907+0000","last_became_peered":"2024-09-19T09:16:23.991907+0000","last_unstale":"2024-09-19T09:17:58.979172+0000","last_undegraded":"2024-09-19T09:17:58.979172+0000","last_fullsized":"2024-09-19T09:17:58.979172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:23.606423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981760+0000","last_change":"2024-09-19T09:16:23.989946+0000","last_active":"2024-09-19T09:17:58.981760+0000","last_peered":"2024-09-19T09:17:58.981760+0000","last_clean":"2024-09-19T09:17:58.981760+0000","last_became_active":"2024-09-19T09:16:23.987263+0000","last_became_peered":"2024-09-19T09:16:23.987263+0000","last_unstale":"2024-09-19T09:17:58.981760+0000","last_undegraded":"2024-09-19T09:17:58.981760+0000","last_fullsized":"2024-09-19T09:17:58.981760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:57.479004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981803+0000","last_change":"2024-09-19T09:16:23.987172+0000","last_active":"2024-09-19T09:17:58.981803+0000","last_peered":"2024-09-19T09:17:58.981803+0000","last_clean":"2024-09-19T09:17:58.981803+0000","last_became_active":"2024-09-19T09:16:23.986754+0000","last_became_peered":"2024-09-19T09:16:23.986754+0000","last_unstale":"2024-09-19T09:17:58.981803+0000","last_undegraded":"2024-09-19T09:17:58.981803+0000","last_fullsized":"2024-09-19T09:17:58.981803+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:34.588603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967160+0000","last_change":"2024-09-19T09:16:23.987624+0000","last_active":"2024-09-19T09:17:58.967160+0000","last_peered":"2024-09-19T09:17:58.967160+0000","last_clean":"2024-09-19T09:17:58.967160+0000","last_became_active":"2024-09-19T09:16:23.987297+0000","last_became_peered":"2024-09-19T09:16:23.987297+0000","last_unstale":"2024-09-19T09:17:58.967160+0000","last_undegraded":"2024-09-19T09:17:58.967160+0000","last_fullsized":"2024-09-19T09:17:58.967160+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:36.569572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967152+0000","last_change":"2024-09-19T09:16:23.986043+0000","last_active":"2024-09-19T09:17:58.967152+0000","last_peered":"2024-09-19T09:17:58.967152+0000","last_clean":"2024-09-19T09:17:58.967152+0000","last_became_active":"2024-09-19T09:16:23.985697+0000","last_became_peered":"2024-09-19T09:16:23.985697+0000","last_unstale":"2024-09-19T09:17:58.967152+0000","last_undegraded":"2024-09-19T09:17:58.967152+0000","last_fullsized":"2024-09-19T09:17:58.967152+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:51.878194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970437+0000","last_change":"2024-09-19T09:16:23.988557+0000","last_active":"2024-09-19T09:17:58.970437+0000","last_peered":"2024-09-19T09:17:58.970437+0000","last_clean":"2024-09-19T09:17:58.970437+0000","last_became_active":"2024-09-19T09:16:23.988014+0000","last_became_peered":"2024-09-19T09:16:23.988014+0000","last_unstale":"2024-09-19T09:17:58.970437+0000","last_undegraded":"2024-09-19T09:17:58.970437+0000","last_fullsized":"2024-09-19T09:17:58.970437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:24.780800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980591+0000","last_change":"2024-09-19T09:16:23.983849+0000","last_active":"2024-09-19T09:17:58.980591+0000","last_peered":"2024-09-19T09:17:58.980591+0000","last_clean":"2024-09-19T09:17:58.980591+0000","last_became_active":"2024-09-19T09:16:23.983524+0000","last_became_peered":"2024-09-19T09:16:23.983524+0000","last_unstale":"2024-09-19T09:17:58.980591+0000","last_undegraded":"2024-09-19T09:17:58.980591+0000","last_fullsized":"2024-09-19T09:17:58.980591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:56.527050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981630+0000","last_change":"2024-09-19T09:16:23.989674+0000","last_active":"2024-09-19T09:17:58.981630+0000","last_peered":"2024-09-19T09:17:58.981630+0000","last_clean":"2024-09-19T09:17:58.981630+0000","last_became_active":"2024-09-19T09:16:23.987073+0000","last_became_peered":"2024-09-19T09:16:23.987073+0000","last_unstale":"2024-09-19T09:17:58.981630+0000","last_undegraded":"2024-09-19T09:17:58.981630+0000","last_fullsized":"2024-09-19T09:17:58.981630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:40.297244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968614+0000","last_change":"2024-09-19T09:16:23.990782+0000","last_active":"2024-09-19T09:17:58.968614+0000","last_peered":"2024-09-19T09:17:58.968614+0000","last_clean":"2024-09-19T09:17:58.968614+0000","last_became_active":"2024-09-19T09:16:23.990459+0000","last_became_peered":"2024-09-19T09:16:23.990459+0000","last_unstale":"2024-09-19T09:17:58.968614+0000","last_undegraded":"2024-09-19T09:17:58.968614+0000","last_fullsized":"2024-09-19T09:17:58.968614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:11.860067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961162+0000","last_change":"2024-09-19T09:16:23.992261+0000","last_active":"2024-09-19T09:17:58.961162+0000","last_peered":"2024-09-19T09:17:58.961162+0000","last_clean":"2024-09-19T09:17:58.961162+0000","last_became_active":"2024-09-19T09:16:23.990454+0000","last_became_peered":"2024-09-19T09:16:23.990454+0000","last_unstale":"2024-09-19T09:17:58.961162+0000","last_undegraded":"2024-09-19T09:17:58.961162+0000","last_fullsized":"2024-09-19T09:17:58.961162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:15.269878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968911+0000","last_change":"2024-09-19T09:16:23.992073+0000","last_active":"2024-09-19T09:17:58.968911+0000","last_peered":"2024-09-19T09:17:58.968911+0000","last_clean":"2024-09-19T09:17:58.968911+0000","last_became_active":"2024-09-19T09:16:23.991716+0000","last_became_peered":"2024-09-19T09:16:23.991716+0000","last_unstale":"2024-09-19T09:17:58.968911+0000","last_undegraded":"2024-09-19T09:17:58.968911+0000","last_fullsized":"2024-09-19T09:17:58.968911+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:45.013336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981030+0000","last_change":"2024-09-19T09:16:23.987856+0000","last_active":"2024-09-19T09:17:58.981030+0000","last_peered":"2024-09-19T09:17:58.981030+0000","last_clean":"2024-09-19T09:17:58.981030+0000","last_became_active":"2024-09-19T09:16:23.987474+0000","last_became_peered":"2024-09-19T09:16:23.987474+0000","last_unstale":"2024-09-19T09:17:58.981030+0000","last_undegraded":"2024-09-19T09:17:58.981030+0000","last_fullsized":"2024-09-19T09:17:58.981030+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:35.433823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969254+0000","last_change":"2024-09-19T09:16:23.988567+0000","last_active":"2024-09-19T09:17:58.969254+0000","last_peered":"2024-09-19T09:17:58.969254+0000","last_clean":"2024-09-19T09:17:58.969254+0000","last_became_active":"2024-09-19T09:16:23.988096+0000","last_became_peered":"2024-09-19T09:16:23.988096+0000","last_unstale":"2024-09-19T09:17:58.969254+0000","last_undegraded":"2024-09-19T09:17:58.969254+0000","last_fullsized":"2024-09-19T09:17:58.969254+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:47.975927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979843+0000","last_change":"2024-09-19T09:16:23.985822+0000","last_active":"2024-09-19T09:17:58.979843+0000","last_peered":"2024-09-19T09:17:58.979843+0000","last_clean":"2024-09-19T09:17:58.979843+0000","last_became_active":"2024-09-19T09:16:23.985449+0000","last_became_peered":"2024-09-19T09:16:23.985449+0000","last_unstale":"2024-09-19T09:17:58.979843+0000","last_undegraded":"2024-09-19T09:17:58.979843+0000","last_fullsized":"2024-09-19T09:17:58.979843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:07.327988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977631+0000","last_change":"2024-09-19T09:16:23.987472+0000","last_active":"2024-09-19T09:17:58.977631+0000","last_peered":"2024-09-19T09:17:58.977631+0000","last_clean":"2024-09-19T09:17:58.977631+0000","last_became_active":"2024-09-19T09:16:23.987092+0000","last_became_peered":"2024-09-19T09:16:23.987092+0000","last_unstale":"2024-09-19T09:17:58.977631+0000","last_undegraded":"2024-09-19T09:17:58.977631+0000","last_fullsized":"2024-09-19T09:17:58.977631+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:53:05.605146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980454+0000","last_change":"2024-09-19T09:16:23.989400+0000","last_active":"2024-09-19T09:17:58.980454+0000","last_peered":"2024-09-19T09:17:58.980454+0000","last_clean":"2024-09-19T09:17:58.980454+0000","last_became_active":"2024-09-19T09:16:23.989045+0000","last_became_peered":"2024-09-19T09:16:23.989045+0000","last_unstale":"2024-09-19T09:17:58.980454+0000","last_undegraded":"2024-09-19T09:17:58.980454+0000","last_fullsized":"2024-09-19T09:17:58.980454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:42.440898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.966717+0000","last_change":"2024-09-19T09:16:23.986634+0000","last_active":"2024-09-19T09:17:58.966717+0000","last_peered":"2024-09-19T09:17:58.966717+0000","last_clean":"2024-09-19T09:17:58.966717+0000","last_became_active":"2024-09-19T09:16:23.986227+0000","last_became_peered":"2024-09-19T09:16:23.986227+0000","last_unstale":"2024-09-19T09:17:58.966717+0000","last_undegraded":"2024-09-19T09:17:58.966717+0000","last_fullsized":"2024-09-19T09:17:58.966717+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:11.543247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970020+0000","last_change":"2024-09-19T09:16:23.991464+0000","last_active":"2024-09-19T09:17:58.970020+0000","last_peered":"2024-09-19T09:17:58.970020+0000","last_clean":"2024-09-19T09:17:58.970020+0000","last_became_active":"2024-09-19T09:16:23.991122+0000","last_became_peered":"2024-09-19T09:16:23.991122+0000","last_unstale":"2024-09-19T09:17:58.970020+0000","last_undegraded":"2024-09-19T09:17:58.970020+0000","last_fullsized":"2024-09-19T09:17:58.970020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:57.301363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.957135+0000","last_change":"2024-09-19T09:16:23.994887+0000","last_active":"2024-09-19T09:17:58.957135+0000","last_peered":"2024-09-19T09:17:58.957135+0000","last_clean":"2024-09-19T09:17:58.957135+0000","last_became_active":"2024-09-19T09:16:23.994252+0000","last_became_peered":"2024-09-19T09:16:23.994252+0000","last_unstale":"2024-09-19T09:17:58.957135+0000","last_undegraded":"2024-09-19T09:17:58.957135+0000","last_fullsized":"2024-09-19T09:17:58.957135+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.860212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'7","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:23.197107+0000","last_change":"2024-09-19T09:16:21.962160+0000","last_active":"2024-09-19T09:18:23.197107+0000","last_peered":"2024-09-19T09:18:23.197107+0000","last_clean":"2024-09-19T09:18:23.197107+0000","last_became_active":"2024-09-19T09:16:21.961797+0000","last_became_peered":"2024-09-19T09:16:21.961797+0000","last_unstale":"2024-09-19T09:18:23.197107+0000","last_undegraded":"2024-09-19T09:18:23.197107+0000","last_fullsized":"2024-09-19T09:18:23.197107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:12:24.927651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.965388+0000","last_change":"2024-09-19T09:16:23.992055+0000","last_active":"2024-09-19T09:17:58.965388+0000","last_peered":"2024-09-19T09:17:58.965388+0000","last_clean":"2024-09-19T09:17:58.965388+0000","last_became_active":"2024-09-19T09:16:23.991753+0000","last_became_peered":"2024-09-19T09:16:23.991753+0000","last_unstale":"2024-09-19T09:17:58.965388+0000","last_undegraded":"2024-09-19T09:17:58.965388+0000","last_fullsized":"2024-09-19T09:17:58.965388+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:23.810061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.740826+0000","last_change":"2024-09-19T09:16:21.959147+0000","last_active":"2024-09-19T09:17:30.740826+0000","last_peered":"2024-09-19T09:17:30.740826+0000","last_clean":"2024-09-19T09:17:30.740826+0000","last_became_active":"2024-09-19T09:16:21.958771+0000","last_became_peered":"2024-09-19T09:16:21.958771+0000","last_unstale":"2024-09-19T09:17:30.740826+0000","last_undegraded":"2024-09-19T09:17:30.740826+0000","last_fullsized":"2024-09-19T09:17:30.740826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:18.326843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.699545+0000","last_change":"2024-09-19T09:16:21.959625+0000","last_active":"2024-09-19T09:17:30.699545+0000","last_peered":"2024-09-19T09:17:30.699545+0000","last_clean":"2024-09-19T09:17:30.699545+0000","last_became_active":"2024-09-19T09:16:21.959286+0000","last_became_peered":"2024-09-19T09:16:21.959286+0000","last_unstale":"2024-09-19T09:17:30.699545+0000","last_undegraded":"2024-09-19T09:17:30.699545+0000","last_fullsized":"2024-09-19T09:17:30.699545+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:41.646369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970622+0000","last_change":"2024-09-19T09:16:23.980970+0000","last_active":"2024-09-19T09:17:58.970622+0000","last_peered":"2024-09-19T09:17:58.970622+0000","last_clean":"2024-09-19T09:17:58.970622+0000","last_became_active":"2024-09-19T09:16:23.980626+0000","last_became_peered":"2024-09-19T09:16:23.980626+0000","last_unstale":"2024-09-19T09:17:58.970622+0000","last_undegraded":"2024-09-19T09:17:58.970622+0000","last_fullsized":"2024-09-19T09:17:58.970622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701519+0000","last_change":"2024-09-19T09:16:21.963034+0000","last_active":"2024-09-19T09:17:30.701519+0000","last_peered":"2024-09-19T09:17:30.701519+0000","last_clean":"2024-09-19T09:17:30.701519+0000","last_became_active":"2024-09-19T09:16:21.962645+0000","last_became_peered":"2024-09-19T09:16:21.962645+0000","last_unstale":"2024-09-19T09:17:30.701519+0000","last_undegraded":"2024-09-19T09:17:30.701519+0000","last_fullsized":"2024-09-19T09:17:30.701519+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:31.149150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970260+0000","last_change":"2024-09-19T09:16:23.983853+0000","last_active":"2024-09-19T09:17:58.970260+0000","last_peered":"2024-09-19T09:17:58.970260+0000","last_clean":"2024-09-19T09:17:58.970260+0000","last_became_active":"2024-09-19T09:16:23.983541+0000","last_became_peered":"2024-09-19T09:16:23.983541+0000","last_unstale":"2024-09-19T09:17:58.970260+0000","last_undegraded":"2024-09-19T09:17:58.970260+0000","last_fullsized":"2024-09-19T09:17:58.970260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:33.832107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'6","reported_seq":250,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:26.200356+0000","last_change":"2024-09-19T09:16:21.961922+0000","last_active":"2024-09-19T09:18:26.200356+0000","last_peered":"2024-09-19T09:18:26.200356+0000","last_clean":"2024-09-19T09:18:26.200356+0000","last_became_active":"2024-09-19T09:16:21.961552+0000","last_became_peered":"2024-09-19T09:16:21.961552+0000","last_unstale":"2024-09-19T09:18:26.200356+0000","last_undegraded":"2024-09-19T09:18:26.200356+0000","last_fullsized":"2024-09-19T09:18:26.200356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:37.544736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.976566+0000","last_change":"2024-09-19T09:16:23.990449+0000","last_active":"2024-09-19T09:17:58.976566+0000","last_peered":"2024-09-19T09:17:58.976566+0000","last_clean":"2024-09-19T09:17:58.976566+0000","last_became_active":"2024-09-19T09:16:23.990141+0000","last_became_peered":"2024-09-19T09:16:23.990141+0000","last_unstale":"2024-09-19T09:17:58.976566+0000","last_undegraded":"2024-09-19T09:17:58.976566+0000","last_fullsized":"2024-09-19T09:17:58.976566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:49.134027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701780+0000","last_change":"2024-09-19T09:16:21.963218+0000","last_active":"2024-09-19T09:17:30.701780+0000","last_peered":"2024-09-19T09:17:30.701780+0000","last_clean":"2024-09-19T09:17:30.701780+0000","last_became_active":"2024-09-19T09:16:21.962841+0000","last_became_peered":"2024-09-19T09:16:21.962841+0000","last_unstale":"2024-09-19T09:17:30.701780+0000","last_undegraded":"2024-09-19T09:17:30.701780+0000","last_fullsized":"2024-09-19T09:17:30.701780+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.385111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979267+0000","last_change":"2024-09-19T09:17:30.711986+0000","last_active":"2024-09-19T09:17:58.979267+0000","last_peered":"2024-09-19T09:17:58.979267+0000","last_clean":"2024-09-19T09:17:58.979267+0000","last_became_active":"2024-09-19T09:17:30.711751+0000","last_became_peered":"2024-09-19T09:17:30.711751+0000","last_unstale":"2024-09-19T09:17:58.979267+0000","last_undegraded":"2024-09-19T09:17:58.979267+0000","last_fullsized":"2024-09-19T09:17:58.979267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:18.081567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701396+0000","last_change":"2024-09-19T09:16:22.072403+0000","last_active":"2024-09-19T09:17:30.701396+0000","last_peered":"2024-09-19T09:17:30.701396+0000","last_clean":"2024-09-19T09:17:30.701396+0000","last_became_active":"2024-09-19T09:16:22.072072+0000","last_became_peered":"2024-09-19T09:16:22.072072+0000","last_unstale":"2024-09-19T09:17:30.701396+0000","last_undegraded":"2024-09-19T09:17:30.701396+0000","last_fullsized":"2024-09-19T09:17:30.701396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:47.342653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979992+0000","last_change":"2024-09-19T09:16:23.998848+0000","last_active":"2024-09-19T09:17:58.979992+0000","last_peered":"2024-09-19T09:17:58.979992+0000","last_clean":"2024-09-19T09:17:58.979992+0000","last_became_active":"2024-09-19T09:16:23.998362+0000","last_became_peered":"2024-09-19T09:16:23.998362+0000","last_unstale":"2024-09-19T09:17:58.979992+0000","last_undegraded":"2024-09-19T09:17:58.979992+0000","last_fullsized":"2024-09-19T09:17:58.979992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:12.278556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'38","reported_seq":296,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:26.200548+0000","last_change":"2024-09-19T09:16:21.963465+0000","last_active":"2024-09-19T09:18:26.200548+0000","last_peered":"2024-09-19T09:18:26.200548+0000","last_clean":"2024-09-19T09:18:26.200548+0000","last_became_active":"2024-09-19T09:16:21.963128+0000","last_became_peered":"2024-09-19T09:16:21.963128+0000","last_unstale":"2024-09-19T09:18:26.200548+0000","last_undegraded":"2024-09-19T09:18:26.200548+0000","last_fullsized":"2024-09-19T09:18:26.200548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:42.774428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67181,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":236,"num_read_kb":184,"num_write":40,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967581+0000","last_change":"2024-09-19T09:16:23.985046+0000","last_active":"2024-09-19T09:17:58.967581+0000","last_peered":"2024-09-19T09:17:58.967581+0000","last_clean":"2024-09-19T09:17:58.967581+0000","last_became_active":"2024-09-19T09:16:23.984691+0000","last_became_peered":"2024-09-19T09:16:23.984691+0000","last_unstale":"2024-09-19T09:17:58.967581+0000","last_undegraded":"2024-09-19T09:17:58.967581+0000","last_fullsized":"2024-09-19T09:17:58.967581+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:16.894067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701982+0000","last_change":"2024-09-19T09:16:21.965532+0000","last_active":"2024-09-19T09:17:30.701982+0000","last_peered":"2024-09-19T09:17:30.701982+0000","last_clean":"2024-09-19T09:17:30.701982+0000","last_became_active":"2024-09-19T09:16:21.965136+0000","last_became_peered":"2024-09-19T09:16:21.965136+0000","last_unstale":"2024-09-19T09:17:30.701982+0000","last_undegraded":"2024-09-19T09:17:30.701982+0000","last_fullsized":"2024-09-19T09:17:30.701982+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:36.153948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.956062+0000","last_change":"2024-09-19T09:16:23.982724+0000","last_active":"2024-09-19T09:17:58.956062+0000","last_peered":"2024-09-19T09:17:58.956062+0000","last_clean":"2024-09-19T09:17:58.956062+0000","last_became_active":"2024-09-19T09:16:23.982383+0000","last_became_peered":"2024-09-19T09:16:23.982383+0000","last_unstale":"2024-09-19T09:17:58.956062+0000","last_undegraded":"2024-09-19T09:17:58.956062+0000","last_fullsized":"2024-09-19T09:17:58.956062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:03.420390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701288+0000","last_change":"2024-09-19T09:16:21.961438+0000","last_active":"2024-09-19T09:17:30.701288+0000","last_peered":"2024-09-19T09:17:30.701288+0000","last_clean":"2024-09-19T09:17:30.701288+0000","last_became_active":"2024-09-19T09:16:21.960984+0000","last_became_peered":"2024-09-19T09:16:21.960984+0000","last_unstale":"2024-09-19T09:17:30.701288+0000","last_undegraded":"2024-09-19T09:17:30.701288+0000","last_fullsized":"2024-09-19T09:17:30.701288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:42.792446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.971893+0000","last_change":"2024-09-19T09:17:30.706308+0000","last_active":"2024-09-19T09:17:58.971893+0000","last_peered":"2024-09-19T09:17:58.971893+0000","last_clean":"2024-09-19T09:17:58.971893+0000","last_became_active":"2024-09-19T09:17:30.705841+0000","last_became_peered":"2024-09-19T09:17:30.705841+0000","last_unstale":"2024-09-19T09:17:58.971893+0000","last_undegraded":"2024-09-19T09:17:58.971893+0000","last_fullsized":"2024-09-19T09:17:58.971893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:53.567272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:23.196866+0000","last_change":"2024-09-19T09:16:21.960361+0000","last_active":"2024-09-19T09:18:23.196866+0000","last_peered":"2024-09-19T09:18:23.196866+0000","last_clean":"2024-09-19T09:18:23.196866+0000","last_became_active":"2024-09-19T09:16:21.960002+0000","last_became_peered":"2024-09-19T09:16:21.960002+0000","last_unstale":"2024-09-19T09:18:23.196866+0000","last_undegraded":"2024-09-19T09:18:23.196866+0000","last_fullsized":"2024-09-19T09:18:23.196866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:54.842683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969899+0000","last_change":"2024-09-19T09:17:30.742259+0000","last_active":"2024-09-19T09:17:58.969899+0000","last_peered":"2024-09-19T09:17:58.969899+0000","last_clean":"2024-09-19T09:17:58.969899+0000","last_became_active":"2024-09-19T09:17:30.741880+0000","last_became_peered":"2024-09-19T09:17:30.741880+0000","last_unstale":"2024-09-19T09:17:58.969899+0000","last_undegraded":"2024-09-19T09:17:58.969899+0000","last_fullsized":"2024-09-19T09:17:58.969899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:33.736292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706370+0000","last_change":"2024-09-19T09:16:22.074154+0000","last_active":"2024-09-19T09:17:30.706370+0000","last_peered":"2024-09-19T09:17:30.706370+0000","last_clean":"2024-09-19T09:17:30.706370+0000","last_became_active":"2024-09-19T09:16:22.073740+0000","last_became_peered":"2024-09-19T09:16:22.073740+0000","last_unstale":"2024-09-19T09:17:30.706370+0000","last_undegraded":"2024-09-19T09:17:30.706370+0000","last_fullsized":"2024-09-19T09:17:30.706370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:37.594658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.974073+0000","last_change":"2024-09-19T09:16:23.996041+0000","last_active":"2024-09-19T09:17:58.974073+0000","last_peered":"2024-09-19T09:17:58.974073+0000","last_clean":"2024-09-19T09:17:58.974073+0000","last_became_active":"2024-09-19T09:16:23.995677+0000","last_became_peered":"2024-09-19T09:16:23.995677+0000","last_unstale":"2024-09-19T09:17:58.974073+0000","last_undegraded":"2024-09-19T09:17:58.974073+0000","last_fullsized":"2024-09-19T09:17:58.974073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:51.694520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.716217+0000","last_change":"2024-09-19T09:17:30.715839+0000","last_active":"2024-09-19T09:17:30.716217+0000","last_peered":"2024-09-19T09:17:30.716217+0000","last_clean":"2024-09-19T09:17:30.716217+0000","last_became_active":"2024-09-19T09:17:30.707470+0000","last_became_peered":"2024-09-19T09:17:30.707470+0000","last_unstale":"2024-09-19T09:17:30.716217+0000","last_undegraded":"2024-09-19T09:17:30.716217+0000","last_fullsized":"2024-09-19T09:17:30.716217+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.090063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.969162+0000","last_change":"2024-09-19T09:16:23.987788+0000","last_active":"2024-09-19T09:17:58.969162+0000","last_peered":"2024-09-19T09:17:58.969162+0000","last_clean":"2024-09-19T09:17:58.969162+0000","last_became_active":"2024-09-19T09:16:23.987420+0000","last_became_peered":"2024-09-19T09:16:23.987420+0000","last_unstale":"2024-09-19T09:17:58.969162+0000","last_undegraded":"2024-09-19T09:17:58.969162+0000","last_fullsized":"2024-09-19T09:17:58.969162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:39.286442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.719006+0000","last_change":"2024-09-19T09:17:30.719006+0000","last_active":"2024-09-19T09:17:30.719006+0000","last_peered":"2024-09-19T09:17:30.719006+0000","last_clean":"2024-09-19T09:17:30.719006+0000","last_became_active":"2024-09-19T09:17:30.709645+0000","last_became_peered":"2024-09-19T09:17:30.709645+0000","last_unstale":"2024-09-19T09:17:30.719006+0000","last_undegraded":"2024-09-19T09:17:30.719006+0000","last_fullsized":"2024-09-19T09:17:30.719006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:41.476145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977582+0000","last_change":"2024-09-19T09:16:23.985476+0000","last_active":"2024-09-19T09:17:58.977582+0000","last_peered":"2024-09-19T09:17:58.977582+0000","last_clean":"2024-09-19T09:17:58.977582+0000","last_became_active":"2024-09-19T09:16:23.985150+0000","last_became_peered":"2024-09-19T09:16:23.985150+0000","last_unstale":"2024-09-19T09:17:58.977582+0000","last_undegraded":"2024-09-19T09:17:58.977582+0000","last_fullsized":"2024-09-19T09:17:58.977582+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:32.154564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.701511+0000","last_change":"2024-09-19T09:16:21.963781+0000","last_active":"2024-09-19T09:17:30.701511+0000","last_peered":"2024-09-19T09:17:30.701511+0000","last_clean":"2024-09-19T09:17:30.701511+0000","last_became_active":"2024-09-19T09:16:21.963253+0000","last_became_peered":"2024-09-19T09:16:21.963253+0000","last_unstale":"2024-09-19T09:17:30.701511+0000","last_undegraded":"2024-09-19T09:17:30.701511+0000","last_fullsized":"2024-09-19T09:17:30.701511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:39.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.968174+0000","last_change":"2024-09-19T09:16:23.988356+0000","last_active":"2024-09-19T09:17:58.968174+0000","last_peered":"2024-09-19T09:17:58.968174+0000","last_clean":"2024-09-19T09:17:58.968174+0000","last_became_active":"2024-09-19T09:16:23.987996+0000","last_became_peered":"2024-09-19T09:16:23.987996+0000","last_unstale":"2024-09-19T09:17:58.968174+0000","last_undegraded":"2024-09-19T09:17:58.968174+0000","last_fullsized":"2024-09-19T09:17:58.968174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:55.903378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'7","reported_seq":142,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:23.196872+0000","last_change":"2024-09-19T09:16:22.073870+0000","last_active":"2024-09-19T09:18:23.196872+0000","last_peered":"2024-09-19T09:18:23.196872+0000","last_clean":"2024-09-19T09:18:23.196872+0000","last_became_active":"2024-09-19T09:16:22.073309+0000","last_became_peered":"2024-09-19T09:16:22.073309+0000","last_unstale":"2024-09-19T09:18:23.196872+0000","last_undegraded":"2024-09-19T09:18:23.196872+0000","last_fullsized":"2024-09-19T09:18:23.196872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:56.722311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980166+0000","last_change":"2024-09-19T09:16:23.988258+0000","last_active":"2024-09-19T09:17:58.980166+0000","last_peered":"2024-09-19T09:17:58.980166+0000","last_clean":"2024-09-19T09:17:58.980166+0000","last_became_active":"2024-09-19T09:16:23.987925+0000","last_became_peered":"2024-09-19T09:16:23.987925+0000","last_unstale":"2024-09-19T09:17:58.980166+0000","last_undegraded":"2024-09-19T09:17:58.980166+0000","last_fullsized":"2024-09-19T09:17:58.980166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:50.520271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":338,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702339+0000","last_change":"2024-09-19T09:15:09.911097+0000","last_active":"2024-09-19T09:17:30.702339+0000","last_peered":"2024-09-19T09:17:30.702339+0000","last_clean":"2024-09-19T09:17:30.702339+0000","last_became_active":"2024-09-19T09:15:09.910692+0000","last_became_peered":"2024-09-19T09:15:09.910692+0000","last_unstale":"2024-09-19T09:17:30.702339+0000","last_undegraded":"2024-09-19T09:17:30.702339+0000","last_fullsized":"2024-09-19T09:17:30.702339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:11:45.380589+0000","last_clean_scrub_stamp":"2024-09-19T09:11:45.380589+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.589461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.707109+0000","last_change":"2024-09-19T09:16:21.958763+0000","last_active":"2024-09-19T09:17:30.707109+0000","last_peered":"2024-09-19T09:17:30.707109+0000","last_clean":"2024-09-19T09:17:30.707109+0000","last_became_active":"2024-09-19T09:16:21.958430+0000","last_became_peered":"2024-09-19T09:16:21.958430+0000","last_unstale":"2024-09-19T09:17:30.707109+0000","last_undegraded":"2024-09-19T09:17:30.707109+0000","last_fullsized":"2024-09-19T09:17:30.707109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:58.389707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.977434+0000","last_change":"2024-09-19T09:16:23.994293+0000","last_active":"2024-09-19T09:17:58.977434+0000","last_peered":"2024-09-19T09:17:58.977434+0000","last_clean":"2024-09-19T09:17:58.977434+0000","last_became_active":"2024-09-19T09:16:23.993979+0000","last_became_peered":"2024-09-19T09:16:23.993979+0000","last_unstale":"2024-09-19T09:17:58.977434+0000","last_undegraded":"2024-09-19T09:17:58.977434+0000","last_fullsized":"2024-09-19T09:17:58.977434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:52.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702158+0000","last_change":"2024-09-19T09:16:21.962086+0000","last_active":"2024-09-19T09:17:30.702158+0000","last_peered":"2024-09-19T09:17:30.702158+0000","last_clean":"2024-09-19T09:17:30.702158+0000","last_became_active":"2024-09-19T09:16:21.961721+0000","last_became_peered":"2024-09-19T09:16:21.961721+0000","last_unstale":"2024-09-19T09:17:30.702158+0000","last_undegraded":"2024-09-19T09:17:30.702158+0000","last_fullsized":"2024-09-19T09:17:30.702158+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:13.125558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.961956+0000","last_change":"2024-09-19T09:16:23.992007+0000","last_active":"2024-09-19T09:17:58.961956+0000","last_peered":"2024-09-19T09:17:58.961956+0000","last_clean":"2024-09-19T09:17:58.961956+0000","last_became_active":"2024-09-19T09:16:23.991688+0000","last_became_peered":"2024-09-19T09:16:23.991688+0000","last_unstale":"2024-09-19T09:17:58.961956+0000","last_undegraded":"2024-09-19T09:17:58.961956+0000","last_fullsized":"2024-09-19T09:17:58.961956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:38.012275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:24.197490+0000","last_change":"2024-09-19T09:16:22.071588+0000","last_active":"2024-09-19T09:18:24.197490+0000","last_peered":"2024-09-19T09:18:24.197490+0000","last_clean":"2024-09-19T09:18:24.197490+0000","last_became_active":"2024-09-19T09:16:22.071271+0000","last_became_peered":"2024-09-19T09:16:22.071271+0000","last_unstale":"2024-09-19T09:18:24.197490+0000","last_undegraded":"2024-09-19T09:18:24.197490+0000","last_fullsized":"2024-09-19T09:18:24.197490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:13.655461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.963420+0000","last_change":"2024-09-19T09:16:23.993133+0000","last_active":"2024-09-19T09:17:58.963420+0000","last_peered":"2024-09-19T09:17:58.963420+0000","last_clean":"2024-09-19T09:17:58.963420+0000","last_became_active":"2024-09-19T09:16:23.992831+0000","last_became_peered":"2024-09-19T09:16:23.992831+0000","last_unstale":"2024-09-19T09:17:58.963420+0000","last_undegraded":"2024-09-19T09:17:58.963420+0000","last_fullsized":"2024-09-19T09:17:58.963420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:55.351779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"84'8","reported_seq":144,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:24.197882+0000","last_change":"2024-09-19T09:16:21.961597+0000","last_active":"2024-09-19T09:18:24.197882+0000","last_peered":"2024-09-19T09:18:24.197882+0000","last_clean":"2024-09-19T09:18:24.197882+0000","last_became_active":"2024-09-19T09:16:21.960930+0000","last_became_peered":"2024-09-19T09:16:21.960930+0000","last_unstale":"2024-09-19T09:18:24.197882+0000","last_undegraded":"2024-09-19T09:18:24.197882+0000","last_fullsized":"2024-09-19T09:18:24.197882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:03.581899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1430,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967435+0000","last_change":"2024-09-19T09:16:23.987743+0000","last_active":"2024-09-19T09:17:58.967435+0000","last_peered":"2024-09-19T09:17:58.967435+0000","last_clean":"2024-09-19T09:17:58.967435+0000","last_became_active":"2024-09-19T09:16:23.987436+0000","last_became_peered":"2024-09-19T09:16:23.987436+0000","last_unstale":"2024-09-19T09:17:58.967435+0000","last_undegraded":"2024-09-19T09:17:58.967435+0000","last_fullsized":"2024-09-19T09:17:58.967435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:41.411220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.704454+0000","last_change":"2024-09-19T09:16:22.072069+0000","last_active":"2024-09-19T09:17:30.704454+0000","last_peered":"2024-09-19T09:17:30.704454+0000","last_clean":"2024-09-19T09:17:30.704454+0000","last_became_active":"2024-09-19T09:16:22.071682+0000","last_became_peered":"2024-09-19T09:16:22.071682+0000","last_unstale":"2024-09-19T09:17:30.704454+0000","last_undegraded":"2024-09-19T09:17:30.704454+0000","last_fullsized":"2024-09-19T09:17:30.704454+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:34.321410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970687+0000","last_change":"2024-09-19T09:16:23.984188+0000","last_active":"2024-09-19T09:17:58.970687+0000","last_peered":"2024-09-19T09:17:58.970687+0000","last_clean":"2024-09-19T09:17:58.970687+0000","last_became_active":"2024-09-19T09:16:23.983525+0000","last_became_peered":"2024-09-19T09:16:23.983525+0000","last_unstale":"2024-09-19T09:17:58.970687+0000","last_undegraded":"2024-09-19T09:17:58.970687+0000","last_fullsized":"2024-09-19T09:17:58.970687+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:09.220640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706973+0000","last_change":"2024-09-19T09:16:22.072371+0000","last_active":"2024-09-19T09:17:30.706973+0000","last_peered":"2024-09-19T09:17:30.706973+0000","last_clean":"2024-09-19T09:17:30.706973+0000","last_became_active":"2024-09-19T09:16:22.072020+0000","last_became_peered":"2024-09-19T09:16:22.072020+0000","last_unstale":"2024-09-19T09:17:30.706973+0000","last_undegraded":"2024-09-19T09:17:30.706973+0000","last_fullsized":"2024-09-19T09:17:30.706973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:23.286016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.962302+0000","last_change":"2024-09-19T09:16:23.986980+0000","last_active":"2024-09-19T09:17:58.962302+0000","last_peered":"2024-09-19T09:17:58.962302+0000","last_clean":"2024-09-19T09:17:58.962302+0000","last_became_active":"2024-09-19T09:16:23.986643+0000","last_became_peered":"2024-09-19T09:16:23.986643+0000","last_unstale":"2024-09-19T09:17:58.962302+0000","last_undegraded":"2024-09-19T09:17:58.962302+0000","last_fullsized":"2024-09-19T09:17:58.962302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:17.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'16","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:59.005140+0000","last_change":"2024-09-19T09:16:21.954505+0000","last_active":"2024-09-19T09:17:59.005140+0000","last_peered":"2024-09-19T09:17:59.005140+0000","last_clean":"2024-09-19T09:17:59.005140+0000","last_became_active":"2024-09-19T09:16:21.954142+0000","last_became_peered":"2024-09-19T09:16:21.954142+0000","last_unstale":"2024-09-19T09:17:59.005140+0000","last_undegraded":"2024-09-19T09:17:59.005140+0000","last_fullsized":"2024-09-19T09:17:59.005140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:45.935256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.970983+0000","last_change":"2024-09-19T09:16:23.983685+0000","last_active":"2024-09-19T09:17:58.970983+0000","last_peered":"2024-09-19T09:17:58.970983+0000","last_clean":"2024-09-19T09:17:58.970983+0000","last_became_active":"2024-09-19T09:16:23.983308+0000","last_became_peered":"2024-09-19T09:16:23.983308+0000","last_unstale":"2024-09-19T09:17:58.970983+0000","last_undegraded":"2024-09-19T09:17:58.970983+0000","last_fullsized":"2024-09-19T09:17:58.970983+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:21.055227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706710+0000","last_change":"2024-09-19T09:16:22.032189+0000","last_active":"2024-09-19T09:17:30.706710+0000","last_peered":"2024-09-19T09:17:30.706710+0000","last_clean":"2024-09-19T09:17:30.706710+0000","last_became_active":"2024-09-19T09:16:22.031745+0000","last_became_peered":"2024-09-19T09:16:22.031745+0000","last_unstale":"2024-09-19T09:17:30.706710+0000","last_undegraded":"2024-09-19T09:17:30.706710+0000","last_fullsized":"2024-09-19T09:17:30.706710+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:15.741720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979125+0000","last_change":"2024-09-19T09:16:23.988738+0000","last_active":"2024-09-19T09:17:58.979125+0000","last_peered":"2024-09-19T09:17:58.979125+0000","last_clean":"2024-09-19T09:17:58.979125+0000","last_became_active":"2024-09-19T09:16:23.988456+0000","last_became_peered":"2024-09-19T09:16:23.988456+0000","last_unstale":"2024-09-19T09:17:58.979125+0000","last_undegraded":"2024-09-19T09:17:58.979125+0000","last_fullsized":"2024-09-19T09:17:58.979125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:27.391881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.700552+0000","last_change":"2024-09-19T09:16:22.074094+0000","last_active":"2024-09-19T09:17:30.700552+0000","last_peered":"2024-09-19T09:17:30.700552+0000","last_clean":"2024-09-19T09:17:30.700552+0000","last_became_active":"2024-09-19T09:16:22.073680+0000","last_became_peered":"2024-09-19T09:16:22.073680+0000","last_unstale":"2024-09-19T09:17:30.700552+0000","last_undegraded":"2024-09-19T09:17:30.700552+0000","last_fullsized":"2024-09-19T09:17:30.700552+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:07.030725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.933118+0000","last_change":"2024-09-19T09:16:23.985339+0000","last_active":"2024-09-19T09:17:58.933118+0000","last_peered":"2024-09-19T09:17:58.933118+0000","last_clean":"2024-09-19T09:17:58.933118+0000","last_became_active":"2024-09-19T09:16:23.984980+0000","last_became_peered":"2024-09-19T09:16:23.984980+0000","last_unstale":"2024-09-19T09:17:58.933118+0000","last_undegraded":"2024-09-19T09:17:58.933118+0000","last_fullsized":"2024-09-19T09:17:58.933118+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:18.708166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702269+0000","last_change":"2024-09-19T09:16:21.960521+0000","last_active":"2024-09-19T09:17:30.702269+0000","last_peered":"2024-09-19T09:17:30.702269+0000","last_clean":"2024-09-19T09:17:30.702269+0000","last_became_active":"2024-09-19T09:16:21.960083+0000","last_became_peered":"2024-09-19T09:16:21.960083+0000","last_unstale":"2024-09-19T09:17:30.702269+0000","last_undegraded":"2024-09-19T09:17:30.702269+0000","last_fullsized":"2024-09-19T09:17:30.702269+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:57.856523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975139+0000","last_change":"2024-09-19T09:16:23.992344+0000","last_active":"2024-09-19T09:17:58.975139+0000","last_peered":"2024-09-19T09:17:58.975139+0000","last_clean":"2024-09-19T09:17:58.975139+0000","last_became_active":"2024-09-19T09:16:23.992031+0000","last_became_peered":"2024-09-19T09:16:23.992031+0000","last_unstale":"2024-09-19T09:17:58.975139+0000","last_undegraded":"2024-09-19T09:17:58.975139+0000","last_fullsized":"2024-09-19T09:17:58.975139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:11.822063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.722791+0000","last_change":"2024-09-19T09:17:30.722376+0000","last_active":"2024-09-19T09:17:30.722791+0000","last_peered":"2024-09-19T09:17:30.722791+0000","last_clean":"2024-09-19T09:17:30.722791+0000","last_became_active":"2024-09-19T09:17:30.709277+0000","last_became_peered":"2024-09-19T09:17:30.709277+0000","last_unstale":"2024-09-19T09:17:30.722791+0000","last_undegraded":"2024-09-19T09:17:30.722791+0000","last_fullsized":"2024-09-19T09:17:30.722791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:59.341264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980029+0000","last_change":"2024-09-19T09:16:23.985947+0000","last_active":"2024-09-19T09:17:58.980029+0000","last_peered":"2024-09-19T09:17:58.980029+0000","last_clean":"2024-09-19T09:17:58.980029+0000","last_became_active":"2024-09-19T09:16:23.985594+0000","last_became_peered":"2024-09-19T09:16:23.985594+0000","last_unstale":"2024-09-19T09:17:58.980029+0000","last_undegraded":"2024-09-19T09:17:58.980029+0000","last_fullsized":"2024-09-19T09:17:58.980029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:22.447984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706536+0000","last_change":"2024-09-19T09:16:21.961828+0000","last_active":"2024-09-19T09:17:30.706536+0000","last_peered":"2024-09-19T09:17:30.706536+0000","last_clean":"2024-09-19T09:17:30.706536+0000","last_became_active":"2024-09-19T09:16:21.961430+0000","last_became_peered":"2024-09-19T09:16:21.961430+0000","last_unstale":"2024-09-19T09:17:30.706536+0000","last_undegraded":"2024-09-19T09:17:30.706536+0000","last_fullsized":"2024-09-19T09:17:30.706536+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.013963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.979969+0000","last_change":"2024-09-19T09:16:23.990096+0000","last_active":"2024-09-19T09:17:58.979969+0000","last_peered":"2024-09-19T09:17:58.979969+0000","last_clean":"2024-09-19T09:17:58.979969+0000","last_became_active":"2024-09-19T09:16:23.989778+0000","last_became_peered":"2024-09-19T09:16:23.989778+0000","last_unstale":"2024-09-19T09:17:58.979969+0000","last_undegraded":"2024-09-19T09:17:58.979969+0000","last_fullsized":"2024-09-19T09:17:58.979969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:59.164456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.980085+0000","last_change":"2024-09-19T09:16:23.996074+0000","last_active":"2024-09-19T09:17:58.980085+0000","last_peered":"2024-09-19T09:17:58.980085+0000","last_clean":"2024-09-19T09:17:58.980085+0000","last_became_active":"2024-09-19T09:16:23.995729+0000","last_became_peered":"2024-09-19T09:16:23.995729+0000","last_unstale":"2024-09-19T09:17:58.980085+0000","last_undegraded":"2024-09-19T09:17:58.980085+0000","last_fullsized":"2024-09-19T09:17:58.980085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:44.310246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706809+0000","last_change":"2024-09-19T09:16:21.957803+0000","last_active":"2024-09-19T09:17:30.706809+0000","last_peered":"2024-09-19T09:17:30.706809+0000","last_clean":"2024-09-19T09:17:30.706809+0000","last_became_active":"2024-09-19T09:16:21.957405+0000","last_became_peered":"2024-09-19T09:16:21.957405+0000","last_unstale":"2024-09-19T09:17:30.706809+0000","last_undegraded":"2024-09-19T09:17:30.706809+0000","last_fullsized":"2024-09-19T09:17:30.706809+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:45.479009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.975767+0000","last_change":"2024-09-19T09:16:23.986954+0000","last_active":"2024-09-19T09:17:58.975767+0000","last_peered":"2024-09-19T09:17:58.975767+0000","last_clean":"2024-09-19T09:17:58.975767+0000","last_became_active":"2024-09-19T09:16:23.986380+0000","last_became_peered":"2024-09-19T09:16:23.986380+0000","last_unstale":"2024-09-19T09:17:58.975767+0000","last_undegraded":"2024-09-19T09:17:58.975767+0000","last_fullsized":"2024-09-19T09:17:58.975767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:37.454098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"84'13","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.706829+0000","last_change":"2024-09-19T09:16:21.960645+0000","last_active":"2024-09-19T09:17:30.706829+0000","last_peered":"2024-09-19T09:17:30.706829+0000","last_clean":"2024-09-19T09:17:30.706829+0000","last_became_active":"2024-09-19T09:16:21.960280+0000","last_became_peered":"2024-09-19T09:16:21.960280+0000","last_unstale":"2024-09-19T09:17:30.706829+0000","last_undegraded":"2024-09-19T09:17:30.706829+0000","last_fullsized":"2024-09-19T09:17:30.706829+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:37.543908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.981137+0000","last_change":"2024-09-19T09:16:23.986815+0000","last_active":"2024-09-19T09:17:58.981137+0000","last_peered":"2024-09-19T09:17:58.981137+0000","last_clean":"2024-09-19T09:17:58.981137+0000","last_became_active":"2024-09-19T09:16:23.986467+0000","last_became_peered":"2024-09-19T09:16:23.986467+0000","last_unstale":"2024-09-19T09:17:58.981137+0000","last_undegraded":"2024-09-19T09:17:58.981137+0000","last_fullsized":"2024-09-19T09:17:58.981137+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.129289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:30.702953+0000","last_change":"2024-09-19T09:16:22.071650+0000","last_active":"2024-09-19T09:17:30.702953+0000","last_peered":"2024-09-19T09:17:30.702953+0000","last_clean":"2024-09-19T09:17:30.702953+0000","last_became_active":"2024-09-19T09:16:22.071309+0000","last_became_peered":"2024-09-19T09:16:22.071309+0000","last_unstale":"2024-09-19T09:17:30.702953+0000","last_undegraded":"2024-09-19T09:17:30.702953+0000","last_fullsized":"2024-09-19T09:17:30.702953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:25.985855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:17:58.967339+0000","last_change":"2024-09-19T09:16:23.990539+0000","last_active":"2024-09-19T09:17:58.967339+0000","last_peered":"2024-09-19T09:17:58.967339+0000","last_clean":"2024-09-19T09:17:58.967339+0000","last_became_active":"2024-09-19T09:16:23.990174+0000","last_became_peered":"2024-09-19T09:16:23.990174+0000","last_unstale":"2024-09-19T09:17:58.967339+0000","last_undegraded":"2024-09-19T09:17:58.967339+0000","last_fullsized":"2024-09-19T09:17:58.967339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:22.965285+0000","last_clean_scrub_stamp":"2024-09-19T09:16:22.965285+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:30.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"84'14","reported_seq":150,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T09:18:26.199897+0000","last_change":"2024-09-19T09:16:21.957845+0000","last_active":"2024-09-19T09:18:26.199897+0000","last_peered":"2024-09-19T09:18:26.199897+0000","last_clean":"2024-09-19T09:18:26.199897+0000","last_became_active":"2024-09-19T09:16:21.957549+0000","last_became_peered":"2024-09-19T09:16:21.957549+0000","last_unstale":"2024-09-19T09:18:26.199897+0000","last_undegraded":"2024-09-19T09:18:26.199897+0000","last_fullsized":"2024-09-19T09:18:26.199897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:16:20.943950+0000","last_clean_scrub_stamp":"2024-09-19T09:16:20.943950+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:18.789240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75513,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1153,"num_read_kb":664,"num_write":264,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":2951840,"data_compressed":179629,"data_compressed_allocated":225280,"data_compressed_original":2932736,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514534,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":448245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":1105899,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":447975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":1041500,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":448178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":1040336,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":447197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":447161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":516718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":516272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34617,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36253,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:18:29.177 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:29.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:28 smithi115 ceph-mon[35055]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:18:29.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:28 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:29.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:28 smithi099 ceph-mon[35256]: pgmap v343: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T09:18:29.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:28 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:18:29.956 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:30.207 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:29 smithi046 ceph-mon[31203]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:30.208 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.208 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.208 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.208 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:29 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:29 smithi115 ceph-mon[35055]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:29 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:29 smithi099 ceph-mon[35256]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:18:30.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:29 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 -- 172.21.15.46:0/3358064573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8102dd0 msgr2=0x7f7ab81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/3358064573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8102dd0 0x7f7ab81031b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009cd0 tx=0x7f7aa802a8d0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 -- 172.21.15.46:0/3358064573 shutdown_connections 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/3358064573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab8108300 0x7f7ab810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/3358064573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ab8103780 0x7f7ab8107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/3358064573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8102dd0 0x7f7ab81031b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 -- 172.21.15.46:0/3358064573 >> 172.21.15.46:0/3358064573 conn(0x7f7ab80fc7d0 msgr2=0x7f7ab80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 -- 172.21.15.46:0/3358064573 shutdown_connections 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.469+0000 7f7abdcb6640 1 -- 172.21.15.46:0/3358064573 wait complete. 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 Processor -- start 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 -- start start 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ab8102dd0 0x7f7ab8198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 0x7f7ab8198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab8108300 0x7f7ab819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8112090 con 0x7f7ab8103780 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8111f10 con 0x7f7ab8108300 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7abdcb6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab8112210 con 0x7f7ab8102dd0 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7ab6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 0x7f7ab8198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7ab6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 0x7f7ab8198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58378/0 (socket says 172.21.15.46:58378) 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7ab6ffd640 1 -- 172.21.15.46:0/2409865430 learned_addr learned my addr 172.21.15.46:0/2409865430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7ab7fff640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab8108300 0x7f7ab819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.470+0000 7f7ab77fe640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ab8102dd0 0x7f7ab8198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab6ffd640 1 -- 172.21.15.46:0/2409865430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ab8102dd0 msgr2=0x7f7ab8198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab6ffd640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ab8102dd0 0x7f7ab8198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab6ffd640 1 -- 172.21.15.46:0/2409865430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab8108300 msgr2=0x7f7ab819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab6ffd640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab8108300 0x7f7ab819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab6ffd640 1 -- 172.21.15.46:0/2409865430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab819d600 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab6ffd640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 0x7f7ab8198b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c970 tx=0x7f7aac00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac007bb0 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab819d8f0 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aac007d50 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00f450 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.471+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab81a51d0 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.472+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab806a7b0 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.473+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7aac004eb0 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.474+0000 7f7ab4ff9640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7aa00a3240 0x7f7aa00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.474+0000 7f7ab77fe640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7aa00a3240 0x7f7aa00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.474+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7aac0cf580 con 0x7f7ab8103780 2024-09-19T09:18:30.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.475+0000 7f7ab77fe640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7aa00a3240 0x7f7aa00a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8000f80 tx=0x7f7aa8005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.478+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7aac014030 con 0x7f7ab8103780 2024-09-19T09:18:30.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.737+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ab810a290 con 0x7f7ab8103780 2024-09-19T09:18:30.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.738+0000 7f7ab4ff9640 1 -- 172.21.15.46:0/2409865430 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f7aac09c2d0 con 0x7f7ab8103780 2024-09-19T09:18:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:30.739 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:18:30.739 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7aa00a3240 msgr2=0x7f7aa00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7aa00a3240 0x7f7aa00a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8000f80 tx=0x7f7aa8005ef0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 msgr2=0x7f7ab8198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 0x7f7ab8198b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c970 tx=0x7f7aac00cd70 comp rx=0 tx=0).stop 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 shutdown_connections 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7aa00a3240 0x7f7aa00a5700 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8000f80 tx=0x7f7aa8005ef0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ab8103780 0x7f7ab8198b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ab8108300 0x7f7ab819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 --2- 172.21.15.46:0/2409865430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ab8102dd0 0x7f7ab8198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.741+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 >> 172.21.15.46:0/2409865430 conn(0x7f7ab80fc7d0 msgr2=0x7f7ab8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.742+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 shutdown_connections 2024-09-19T09:18:30.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:30.742+0000 7f7abdcb6640 1 -- 172.21.15.46:0/2409865430 wait complete. 2024-09-19T09:18:31.108 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:30 smithi046 ceph-mon[31203]: pgmap v344: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:18:31.109 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:30 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2409865430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:31.109 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:31.109 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:31.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:30 smithi115 ceph-mon[35055]: pgmap v344: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:18:31.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:30 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2409865430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:31.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:31.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:31.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:30 smithi099 ceph-mon[35256]: pgmap v344: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:18:31.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:30 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2409865430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:31.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:31.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:31.448 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:31.728 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:32.113 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:32.113 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:32.113 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:31 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:32.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:32.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:32.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:31 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 -- 172.21.15.46:0/1641133506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f810c170 msgr2=0x7f52f810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 --2- 172.21.15.46:0/1641133506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f810c170 0x7f52f810e610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009ca0 tx=0x7f52f002a950 comp rx=0 tx=0).stop 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 -- 172.21.15.46:0/1641133506 shutdown_connections 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 --2- 172.21.15.46:0/1641133506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f810c170 0x7f52f810e610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 --2- 172.21.15.46:0/1641133506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f8103660 0x7f52f810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 --2- 172.21.15.46:0/1641133506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f8102d40 0x7f52f8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 -- 172.21.15.46:0/1641133506 >> 172.21.15.46:0/1641133506 conn(0x7f52f80fc7a0 msgr2=0x7f52f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:32.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 -- 172.21.15.46:0/1641133506 shutdown_connections 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 -- 172.21.15.46:0/1641133506 wait complete. 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.197+0000 7f52fcc88640 1 Processor -- start 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 -- start start 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f8102d40 0x7f52f81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 0x7f52f8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f810c170 0x7f52f819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8111f70 con 0x7f52f8103660 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f52f8111df0 con 0x7f52f8102d40 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52fcc88640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f52f81120f0 con 0x7f52f810c170 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 0x7f52f8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 0x7f52f8198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58386/0 (socket says 172.21.15.46:58386) 2024-09-19T09:18:32.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 -- 172.21.15.46:0/2694095448 learned_addr learned my addr 172.21.15.46:0/2694095448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f6d9d640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f810c170 0x7f52f819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f659c640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f8102d40 0x7f52f81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 -- 172.21.15.46:0/2694095448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f810c170 msgr2=0x7f52f819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f810c170 0x7f52f819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 -- 172.21.15.46:0/2694095448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f8102d40 msgr2=0x7f52f81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f8102d40 0x7f52f81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 -- 172.21.15.46:0/2694095448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f819d3a0 con 0x7f52f8103660 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.198+0000 7f52f5d9b640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 0x7f52f8198930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00d750 tx=0x7f52ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.199+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec017070 con 0x7f52f8103660 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.199+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f819d690 con 0x7f52f8103660 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.199+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52ec005020 con 0x7f52f8103660 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.199+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec004d00 con 0x7f52f8103660 2024-09-19T09:18:32.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.199+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f81a4f70 con 0x7f52f8103660 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.200+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f8103120 con 0x7f52f8103660 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.201+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f52ec009a30 con 0x7f52f8103660 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.201+0000 7f52e77fe640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52e00a3240 0x7f52e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.202+0000 7f52f659c640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52e00a3240 0x7f52e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.202+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f52ec0cf6e0 con 0x7f52f8103660 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.202+0000 7f52f659c640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52e00a3240 0x7f52e00a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f52e8005fd0 tx=0x7f52e8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:32.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.205+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52ec09c430 con 0x7f52f8103660 2024-09-19T09:18:32.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:18:32.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:18:32.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:31 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:18:32.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.419+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52f8107210 con 0x7f52f8103660 2024-09-19T09:18:32.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.419+0000 7f52e77fe640 1 -- 172.21.15.46:0/2694095448 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f52ec09bd30 con 0x7f52f8103660 2024-09-19T09:18:32.420 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:32.420 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:18:32.421 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52e00a3240 msgr2=0x7f52e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52e00a3240 0x7f52e00a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f52e8005fd0 tx=0x7f52e8005850 comp rx=0 tx=0).stop 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 msgr2=0x7f52f8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 0x7f52f8198930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00d750 tx=0x7f52ec00dc10 comp rx=0 tx=0).stop 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 shutdown_connections 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52e00a3240 0x7f52e00a5700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52f8103660 0x7f52f8198930 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f52f810c170 0x7f52f819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 --2- 172.21.15.46:0/2694095448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52f8102d40 0x7f52f81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 >> 172.21.15.46:0/2694095448 conn(0x7f52f80fc7a0 msgr2=0x7f52f80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 shutdown_connections 2024-09-19T09:18:32.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:32.422+0000 7f52fcc88640 1 -- 172.21.15.46:0/2694095448 wait complete. 2024-09-19T09:18:33.051 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:32 smithi046 ceph-mon[31203]: pgmap v345: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:18:33.051 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:32 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2694095448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:33.085 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:18:33.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:32 smithi115 ceph-mon[35055]: pgmap v345: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:18:33.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:32 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2694095448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:33.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:32 smithi099 ceph-mon[35256]: pgmap v345: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:18:33.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:32 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2694095448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:33.348 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:33.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 -- 172.21.15.46:0/4109190822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91901036e0 msgr2=0x7f9190107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 --2- 172.21.15.46:0/4109190822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91901036e0 0x7f9190107b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9184009930 tx=0x7f918402a420 comp rx=0 tx=0).stop 2024-09-19T09:18:33.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 -- 172.21.15.46:0/4109190822 shutdown_connections 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 --2- 172.21.15.46:0/4109190822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91901036e0 0x7f9190107b90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 --2- 172.21.15.46:0/4109190822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91901082a0 0x7f919010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 --2- 172.21.15.46:0/4109190822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9190102d30 0x7f9190103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 -- 172.21.15.46:0/4109190822 >> 172.21.15.46:0/4109190822 conn(0x7f91900fc7d0 msgr2=0x7f91900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 -- 172.21.15.46:0/4109190822 shutdown_connections 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 -- 172.21.15.46:0/4109190822 wait complete. 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 Processor -- start 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.786+0000 7f91979fc640 1 -- start start 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 0x7f9190198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91901036e0 0x7f9190198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91901082a0 0x7f919019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f91901120a0 con 0x7f9190102d30 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9190111f20 con 0x7f91901036e0 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9190112220 con 0x7f91901082a0 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 0x7f9190198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 0x7f9190198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58416/0 (socket says 172.21.15.46:58416) 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 -- 172.21.15.46:0/2090233577 learned_addr learned my addr 172.21.15.46:0/2090233577 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9194f97640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91901036e0 0x7f9190198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195f99640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91901082a0 0x7f919019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 -- 172.21.15.46:0/2090233577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91901082a0 msgr2=0x7f919019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91901082a0 0x7f919019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 -- 172.21.15.46:0/2090233577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91901036e0 msgr2=0x7f9190198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91901036e0 0x7f9190198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 -- 172.21.15.46:0/2090233577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919019d500 con 0x7f9190102d30 2024-09-19T09:18:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195f99640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91901082a0 0x7f919019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f9195798640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 0x7f9190198550 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f918000c920 tx=0x7f918000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180007c70 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919019d7f0 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.787+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9180007e10 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.788+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180018890 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.788+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91901a50d0 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.788+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9190103110 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.790+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9180018a50 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.790+0000 7f918e7fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91780a3240 0x7f91780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.791+0000 7f9194f97640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91780a3240 0x7f91780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.791+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f91800cfd20 con 0x7f9190102d30 2024-09-19T09:18:33.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.791+0000 7f9194f97640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91780a3240 0x7f91780a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9184005940 tx=0x7f91840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:33.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.794+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9180014030 con 0x7f9190102d30 2024-09-19T09:18:33.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.971+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91901998b0 con 0x7f9190102d30 2024-09-19T09:18:33.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.973+0000 7f918e7fc640 1 -- 172.21.15.46:0/2090233577 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22631 (secure 0 0 0) 0x7f91901998b0 con 0x7f9190102d30 2024-09-19T09:18:33.974 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:33.974 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":84,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:17:30.696589+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91780a3240 msgr2=0x7f91780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91780a3240 0x7f91780a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9184005940 tx=0x7f91840058d0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 msgr2=0x7f9190198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 0x7f9190198550 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f918000c920 tx=0x7f918000cde0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 shutdown_connections 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f91780a3240 0x7f91780a5700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f91901082a0 0x7f919019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91901036e0 0x7f9190198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 --2- 172.21.15.46:0/2090233577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9190102d30 0x7f9190198550 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 >> 172.21.15.46:0/2090233577 conn(0x7f91900fc7d0 msgr2=0x7f9190105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 shutdown_connections 2024-09-19T09:18:33.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:33.975+0000 7f91979fc640 1 -- 172.21.15.46:0/2090233577 wait complete. 2024-09-19T09:18:34.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T09:18:34.906 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:35.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:34 smithi046 ceph-mon[31203]: pgmap v346: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:18:35.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:34 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2090233577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:35.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:34 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:18:35.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:34 smithi115 ceph-mon[35055]: pgmap v346: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:18:35.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:34 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2090233577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:35.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:34 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:18:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:34 smithi099 ceph-mon[35256]: pgmap v346: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:18:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:34 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2090233577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:18:35.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:34 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 -- 172.21.15.46:0/1577847131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c104f10 msgr2=0x7f568c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 --2- 172.21.15.46:0/1577847131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c104f10 0x7f568c107300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c02a410 comp rx=0 tx=0).stop 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 -- 172.21.15.46:0/1577847131 shutdown_connections 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 --2- 172.21.15.46:0/1577847131 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c104f10 0x7f568c107300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 --2- 172.21.15.46:0/1577847131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f568c107840 0x7f568c109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 --2- 172.21.15.46:0/1577847131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 0x7f568c1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.498+0000 7f56944e4640 1 -- 172.21.15.46:0/1577847131 >> 172.21.15.46:0/1577847131 conn(0x7f568c0fc1e0 msgr2=0x7f568c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 -- 172.21.15.46:0/1577847131 shutdown_connections 2024-09-19T09:18:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 -- 172.21.15.46:0/1577847131 wait complete. 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 Processor -- start 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 -- start start 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 0x7f568c101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f568c104f10 0x7f568c100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 0x7f568c100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10d810 con 0x7f568c107840 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10d690 con 0x7f568c104f10 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f56944e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10d990 con 0x7f568c1025e0 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.499+0000 7f5692a81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 0x7f568c100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 0x7f568c100ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58444/0 (socket says 172.21.15.46:58444) 2024-09-19T09:18:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 -- 172.21.15.46:0/987163805 learned_addr learned my addr 172.21.15.46:0/987163805 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5691a7f640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f568c104f10 0x7f568c100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692280640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 0x7f568c101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 -- 172.21.15.46:0/987163805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 msgr2=0x7f568c101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 0x7f568c101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 -- 172.21.15.46:0/987163805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f568c104f10 msgr2=0x7f568c100590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f568c104f10 0x7f568c100590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 -- 172.21.15.46:0/987163805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c101360 con 0x7f568c107840 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692280640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 0x7f568c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f5692a81640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 0x7f568c100ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f568400eb40 tx=0x7f568400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f56837fe640 1 -- 172.21.15.46:0/987163805 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684004b20 con 0x7f568c107840 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f56837fe640 1 -- 172.21.15.46:0/987163805 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5684004cc0 con 0x7f568c107840 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c1a1fb0 con 0x7f568c107840 2024-09-19T09:18:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f56837fe640 1 -- 172.21.15.46:0/987163805 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684010850 con 0x7f568c107840 2024-09-19T09:18:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.500+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c1a2410 con 0x7f568c107840 2024-09-19T09:18:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f56837fe640 1 -- 172.21.15.46:0/987163805 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5684005020 con 0x7f568c107840 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 Processor -- start 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 -- start start 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285bb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f9285172f0 con 0x55f9285b9370 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f9284bf270 con 0x55f9285b42e0 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.503+0000 7f5697279740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f9285132b0 con 0x55f9285b39a0 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f56837fe640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56780a3370 0x7f56780a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285bb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285bb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58448/0 (socket says 172.21.15.46:58448) 2024-09-19T09:18:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 -- 172.21.15.46:0/3400099260 learned_addr learned my addr 172.21.15.46:0/3400099260 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5692a81640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56780a3370 0x7f56780a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5692280640 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f56837fe640 1 -- 172.21.15.46:0/987163805 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f56840d00e0 con 0x7f568c107840 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 -- 172.21.15.46:0/3400099260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 msgr2=0x55f9285b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 -- 172.21.15.46:0/3400099260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 msgr2=0x55f9285b8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285b8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 -- 172.21.15.46:0/3400099260 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9284be340 con 0x55f9285b9370 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5691a7f640 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285bb830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f567c005ec0 tx=0x7f567c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46c4c54125fd28a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5692a81640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56780a3370 0x7f56780a5830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f568409c6c0 tx=0x7f5684089040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5680bfe640 1 -- 172.21.15.46:0/3400099260 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035070 con 0x55f9285b9370 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.504+0000 7f5680bfe640 1 -- 172.21.15.46:0/3400099260 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c005510 con 0x55f9285b9370 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5680bfe640 1 -- 172.21.15.46:0/3400099260 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c004c80 con 0x55f9285b9370 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 -- 172.21.15.46:0/3400099260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 msgr2=0x55f9285bb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285bb830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f567c005ec0 tx=0x7f567c005fd0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 -- 172.21.15.46:0/3400099260 shutdown_connections 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285bb830 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285b8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 --2- 172.21.15.46:0/3400099260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 -- 172.21.15.46:0/3400099260 >> 172.21.15.46:0/3400099260 conn(0x55f9285af010 msgr2=0x55f9285af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 -- 172.21.15.46:0/3400099260 shutdown_connections 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.505+0000 7f5697279740 1 -- 172.21.15.46:0/3400099260 wait complete. 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 -- start start 2024-09-19T09:18:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 Processor -- start 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285bdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285be130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285c5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f9285bc2e0 con 0x55f9285b9370 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f9284a0290 con 0x55f9285b42e0 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f9285bc460 con 0x55f9285b39a0 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5697279740 10 client.0 _ll_register_callbacks cb 0x55f9284d1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58452/0 (socket says 172.21.15.46:58452) 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5691a7f640 1 -- 172.21.15.46:0/1723466180 learned_addr learned my addr 172.21.15.46:0/1723466180 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5692280640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.506+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285bdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5691a7f640 1 -- 172.21.15.46:0/1723466180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 msgr2=0x55f9285bdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285bdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5691a7f640 1 -- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 msgr2=0x55f9285be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285be130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5691a7f640 1 -- 172.21.15.46:0/1723466180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f92822a210 con 0x55f9285b9370 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5692280640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285c5170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55f9285bd120 tx=0x7f567c041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2feee1cb1c8b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5675ffb640 1 -- 172.21.15.46:0/1723466180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035070 con 0x55f9285b9370 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f567c005510 con 0x55f9285b9370 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5675ffb640 1 -- 172.21.15.46:0/1723466180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f567c0035f0 con 0x55f9285b9370 2024-09-19T09:18:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5675ffb640 1 -- 172.21.15.46:0/1723466180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f567c0037f0 con 0x55f9285b9370 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5697279740 10 client.15342 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9282f6620 con 0x55f9285b9370 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5675ffb640 1 -- 172.21.15.46:0/1723466180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c005510 con 0x55f9285b9370 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.507+0000 7f5675ffb640 1 -- 172.21.15.46:0/1723466180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f567c004f50 con 0x55f9285b9370 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5697279740 10 client.15342 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5697279740 10 client.15342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5697279740 20 client.15342 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5697279740 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f9285c9470 0x55f9285cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5697279740 4 client.15342 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f928524a20 con 0x55f9285c9470 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5692280640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f9285c9470 0x55f9285cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5692280640 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f9285c9470 0x55f9285cb860 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c9d319335d7a49 server_cookie=bf0d7bc0203c184f in_seq=0 out_seq=0 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.508+0000 7f5675ffb640 10 client.15342 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5675ffb640 1 -- 172.21.15.46:0/1723466180 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f928524a20 con 0x55f9285c9470 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5675ffb640 10 client.15342 handle_command_reply: tid=0 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 client.15342 shutdown 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 msgr2=0x55f9285c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285c5170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x55f9285bd120 tx=0x7f567c041040 comp rx=0 tx=0).stop 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 shutdown_connections 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f9285c9470 0x55f9285cb860 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285c5170 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b42e0 0x55f9285be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5675ffb640 0 client.15342 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 --2- 172.21.15.46:0/1723466180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b39a0 0x55f9285bdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.509+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 >> 172.21.15.46:0/1723466180 conn(0x55f9285af010 msgr2=0x55f9285b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.510+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 shutdown_connections 2024-09-19T09:18:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.510+0000 7f5697279740 1 -- 172.21.15.46:0/1723466180 wait complete. 2024-09-19T09:18:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.510+0000 7f5697279740 20 client.15342 trim_cache size 0 max 16384 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 Processor -- start 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 -- start start 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b39a0 0x55f9285afec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1ab140 con 0x55f9285b9370 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1acc80 con 0x55f9285b39a0 2024-09-19T09:18:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5697279740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1ab810 con 0x55f9285b42e0 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58454/0 (socket says 172.21.15.46:58454) 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5691a7f640 1 -- 172.21.15.46:0/1401595196 learned_addr learned my addr 172.21.15.46:0/1401595196 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b39a0 0x55f9285afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.524+0000 7f5692280640 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5691a7f640 1 -- 172.21.15.46:0/1401595196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 msgr2=0x55f9285c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5691a7f640 1 -- 172.21.15.46:0/1401595196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b39a0 msgr2=0x55f9285afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b39a0 0x55f9285afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5691a7f640 1 -- 172.21.15.46:0/1401595196 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9285b8800 con 0x55f9285b9370 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5691a7f640 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285b0400 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f567c033000 tx=0x7f567c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9230ee85cc35e63c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5677fff640 1 -- 172.21.15.46:0/1401595196 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035040 con 0x55f9285b9370 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5677fff640 1 -- 172.21.15.46:0/1401595196 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c052070 con 0x55f9285b9370 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5677fff640 1 -- 172.21.15.46:0/1401595196 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c04d7d0 con 0x55f9285b9370 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5697279740 1 -- 172.21.15.46:0/1401595196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 msgr2=0x55f9285b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5697279740 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285b0400 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f567c033000 tx=0x7f567c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5697279740 1 -- 172.21.15.46:0/1401595196 shutdown_connections 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.525+0000 7f5697279740 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b9370 0x55f9285b0400 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 --2- 172.21.15.46:0/1401595196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b39a0 0x55f9285afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- 172.21.15.46:0/1401595196 >> 172.21.15.46:0/1401595196 conn(0x55f9285af010 msgr2=0x55f9285bdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- 172.21.15.46:0/1401595196 shutdown_connections 2024-09-19T09:18:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- 172.21.15.46:0/1401595196 wait complete. 2024-09-19T09:18:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- start start 2024-09-19T09:18:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 Processor -- start 2024-09-19T09:18:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 0x55f9285c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b9370 0x55f9285c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1ac5b0 con 0x55f9285b39a0 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1abee0 con 0x55f9285b9370 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a9120 con 0x55f9285b42e0 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5697279740 10 client.0 _ll_register_callbacks cb 0x7f568800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 0x55f9285c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5691a7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 0x55f9285c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58456/0 (socket says 172.21.15.46:58456) 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5691a7f640 1 -- 172.21.15.46:0/2944959208 learned_addr learned my addr 172.21.15.46:0/2944959208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.526+0000 7f5692280640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5691a7f640 1 -- 172.21.15.46:0/2944959208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 msgr2=0x55f9285c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5691a7f640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5691a7f640 1 -- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b9370 msgr2=0x55f9285c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5691a7f640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b9370 0x55f9285c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5691a7f640 1 -- 172.21.15.46:0/2944959208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9285c4390 con 0x55f9285b39a0 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5692280640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5691a7f640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 0x55f9285c2880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f567c0314e0 tx=0x7f567c04d590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2d79211623b2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5675ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5675ffb640 1 -- 172.21.15.46:0/2944959208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035070 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5675ffb640 1 -- 172.21.15.46:0/2944959208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f567c003b90 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f567c052070 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5675ffb640 1 -- 172.21.15.46:0/2944959208 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f567c003d90 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 10 client.15348 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f928634060 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5675ffb640 1 -- 172.21.15.46:0/2944959208 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c052070 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5675ffb640 1 -- 172.21.15.46:0/2944959208 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f567c071710 con 0x55f9285b39a0 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 10 client.15348 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 10 client.15348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 20 client.15348 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f928634760 0x55f928636b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 4 client.15348 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.527+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f92851ed70 con 0x55f928634760 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.528+0000 7f5692280640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f928634760 0x55f928636b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.528+0000 7f5692280640 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f928634760 0x55f928636b50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60d00e9a73d7e1b server_cookie=3b69b3a8437de873 in_seq=0 out_seq=0 2024-09-19T09:18:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.528+0000 7f5675ffb640 10 client.15348 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5675ffb640 1 -- 172.21.15.46:0/2944959208 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f92851ed70 con 0x55f928634760 2024-09-19T09:18:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5675ffb640 10 client.15348 handle_command_reply: tid=0 2024-09-19T09:18:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 client.15348 shutdown 2024-09-19T09:18:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 msgr2=0x55f9285c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 0x55f9285c2880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f567c0314e0 tx=0x7f567c04d590 comp rx=0 tx=0).stop 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 shutdown_connections 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f928634760 0x55f928636b50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f9285b9370 0x55f9285c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f9285b42e0 0x55f9285c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5675ffb640 0 client.15348 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 --2- 172.21.15.46:0/2944959208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f9285b39a0 0x55f9285c2880 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 >> 172.21.15.46:0/2944959208 conn(0x55f9285af010 msgr2=0x55f9285ad9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 shutdown_connections 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 1 -- 172.21.15.46:0/2944959208 wait complete. 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.538+0000 7f5697279740 20 client.15348 trim_cache size 0 max 16384 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:18:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56780a3370 msgr2=0x7f56780a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56780a3370 0x7f56780a5830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f568409c6c0 tx=0x7f5684089040 comp rx=0 tx=0).stop 2024-09-19T09:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 msgr2=0x7f568c100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 0x7f568c100ad0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f568400eb40 tx=0x7f568400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 shutdown_connections 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f56780a3370 0x7f56780a5830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f568c107840 0x7f568c100ad0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f568c104f10 0x7f568c100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 --2- 172.21.15.46:0/987163805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f568c1025e0 0x7f568c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 >> 172.21.15.46:0/987163805 conn(0x7f568c0fc1e0 msgr2=0x7f568c103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 shutdown_connections 2024-09-19T09:18:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:35.539+0000 7f56944e4640 1 -- 172.21.15.46:0/987163805 wait complete. 2024-09-19T09:18:36.041 INFO:teuthology.orchestra.run.smithi046.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T09:18:36.041 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T09:18:36.042 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T09:18:36.042 DEBUG:tasks.quiescer:Yielding 2024-09-19T09:18:36.042 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:18:36.059 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:18:36.060 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:18:36.060 INFO:tasks.workunit:timeout=3h 2024-09-19T09:18:36.060 INFO:tasks.workunit:cleanup=True 2024-09-19T09:18:36.060 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:36.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-19 09:16:42.657217652 +0000 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-19 09:16:42.657217652 +0000 2024-09-19T09:18:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-19 09:18:13.779450659 +0000 2024-09-19T09:18:36.079 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-19 09:16:42.657217652 +0000 2024-09-19T09:18:36.079 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:36.079 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:18:36.154 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:18:36.210 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:18:36.325 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.816+0000 7fd5c10a1640 1 -- 172.21.15.46:0/499914966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc101de0 msgr2=0x7fd5bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.816+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/499914966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc101de0 0x7fd5bc1021c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009900 tx=0x7fd5ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 -- 172.21.15.46:0/499914966 shutdown_connections 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/499914966 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5bc106f10 0x7fd5bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/499914966 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc102790 0x7fd5bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/499914966 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc101de0 0x7fd5bc1021c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 -- 172.21.15.46:0/499914966 >> 172.21.15.46:0/499914966 conn(0x7fd5bc0fd8c0 msgr2=0x7fd5bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 -- 172.21.15.46:0/499914966 shutdown_connections 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.817+0000 7fd5c10a1640 1 -- 172.21.15.46:0/499914966 wait complete. 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 Processor -- start 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 -- start start 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5bc101de0 0x7fd5bc19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc102790 0x7fd5bc19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:36.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 0x7fd5bc19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc111f80 con 0x7fd5bc106f10 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc111e00 con 0x7fd5bc101de0 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5c10a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc112100 con 0x7fd5bc102790 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5bb59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 0x7fd5bc19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5bb59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 0x7fd5bc19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58464/0 (socket says 172.21.15.46:58464) 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5bb59e640 1 -- 172.21.15.46:0/2974930450 learned_addr learned my addr 172.21.15.46:0/2974930450 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.818+0000 7fd5bad9d640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5bc101de0 0x7fd5bc19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5ba59c640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc102790 0x7fd5bc19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5bb59e640 1 -- 172.21.15.46:0/2974930450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc102790 msgr2=0x7fd5bc19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5bb59e640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc102790 0x7fd5bc19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:36.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5bb59e640 1 -- 172.21.15.46:0/2974930450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5bc101de0 msgr2=0x7fd5bc19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5bb59e640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5bc101de0 0x7fd5bc19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5bb59e640 1 -- 172.21.15.46:0/2974930450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc19f670 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5bb59e640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 0x7fd5bc19ef90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400eaa0 tx=0x7fd5b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400cdb0 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b4005020 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40116b0 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc19f960 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.819+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc1a7240 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.820+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc1021c0 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.823+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd5b4005560 con 0x7fd5bc106f10 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.823+0000 7fd5a3fff640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd5a40a32c0 0x7fd5a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:36.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.823+0000 7fd5bad9d640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd5a40a32c0 0x7fd5a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:36.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.823+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd5b40cff00 con 0x7fd5bc106f10 2024-09-19T09:18:36.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.824+0000 7fd5bad9d640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd5a40a32c0 0x7fd5a40a5780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac000c00 tx=0x7fd5ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:36.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:36.827+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5b4016030 con 0x7fd5bc106f10 2024-09-19T09:18:37.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.042+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5bc19ba20 con 0x7fd5bc106f10 2024-09-19T09:18:37.043 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:36 smithi046 ceph-mon[31203]: pgmap v347: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:18:37.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.043+0000 7fd5a3fff640 1 -- 172.21.15.46:0/2974930450 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7fd5b409ccd0 con 0x7fd5bc106f10 2024-09-19T09:18:37.044 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:18:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:18:37.045 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:18:37.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.046+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd5a40a32c0 msgr2=0x7fd5a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.046+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd5a40a32c0 0x7fd5a40a5780 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac000c00 tx=0x7fd5ac005a20 comp rx=0 tx=0).stop 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.046+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 msgr2=0x7fd5bc19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 0x7fd5bc19ef90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400eaa0 tx=0x7fd5b400ef60 comp rx=0 tx=0).stop 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 shutdown_connections 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd5a40a32c0 0x7fd5a40a5780 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5bc106f10 0x7fd5bc19ef90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc102790 0x7fd5bc19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 --2- 172.21.15.46:0/2974930450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5bc101de0 0x7fd5bc19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 >> 172.21.15.46:0/2974930450 conn(0x7fd5bc0fd8c0 msgr2=0x7fd5bc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 shutdown_connections 2024-09-19T09:18:37.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:37.047+0000 7fd5c10a1640 1 -- 172.21.15.46:0/2974930450 wait complete. 2024-09-19T09:18:37.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:36 smithi115 ceph-mon[35055]: pgmap v347: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:18:37.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:36 smithi099 ceph-mon[35256]: pgmap v347: 97 pgs: 97 active+clean; 651 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T09:18:37.695 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:16:24.646046+0000', 'modified': '2024-09-19T09:18:14.470841+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24476, 'mds_1': 24472, 'mds_2': 24463, 'mds_3': 24451, 'mds_4': 24446}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14589': {'gid': 14589, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6839/1918563776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6838', 'nonce': 1918563776}, {'type': 'v1', 'addr': '172.21.15.46:6839', 'nonce': 1918563776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14601': {'gid': 14601, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.46:6841/321773391', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.46:6840', 'nonce': 321773391}, {'type': 'v1', 'addr': '172.21.15.46:6841', 'nonce': 321773391}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6833/51140188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 51140188}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 51140188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24421': {'gid': 24421, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6833/2187922257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6832', 'nonce': 2187922257}, {'type': 'v1', 'addr': '172.21.15.115:6833', 'nonce': 2187922257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6835/1791811881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 1791811881}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 1791811881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24446': {'gid': 24446, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.99:6837/58768930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 58768930}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 58768930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.115:6835/3610194671', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3610194671}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3610194671}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6837/1753777056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 1753777056}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1753777056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.115:6839/1737720182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1737720182}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1737720182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.99:6839/718433968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 718433968}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 718433968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24446, 24472, 24451, 24463, 24476]} 2024-09-19T09:18:37.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T09:18:37.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T09:18:38.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:37 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2974930450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:38.219 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:38.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:37 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2974930450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:38.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:37 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2974930450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 -- 172.21.15.46:0/271116974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c102d40 msgr2=0x7fbe9c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 --2- 172.21.15.46:0/271116974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c102d40 0x7fbe9c103120 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009900 tx=0x7fbe8c02a480 comp rx=0 tx=0).stop 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 -- 172.21.15.46:0/271116974 shutdown_connections 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 --2- 172.21.15.46:0/271116974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c10c170 0x7fbe9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 --2- 172.21.15.46:0/271116974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe9c103660 0x7fbe9c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 --2- 172.21.15.46:0/271116974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c102d40 0x7fbe9c103120 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 -- 172.21.15.46:0/271116974 >> 172.21.15.46:0/271116974 conn(0x7fbe9c0fc7a0 msgr2=0x7fbe9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 -- 172.21.15.46:0/271116974 shutdown_connections 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.682+0000 7fbea23d6640 1 -- 172.21.15.46:0/271116974 wait complete. 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 Processor -- start 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 -- start start 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe9c102d40 0x7fbe9c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c103660 0x7fbe9c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 0x7fbe9c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c111fb0 con 0x7fbe9c10c170 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c111e30 con 0x7fbe9c102d40 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.683+0000 7fbea23d6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c112130 con 0x7fbe9c103660 2024-09-19T09:18:38.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 0x7fbe9c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 0x7fbe9c19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47206/0 (socket says 172.21.15.46:47206) 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 -- 172.21.15.46:0/1125616976 learned_addr learned my addr 172.21.15.46:0/1125616976 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe9c102d40 0x7fbe9c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c103660 0x7fbe9c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 -- 172.21.15.46:0/1125616976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c103660 msgr2=0x7fbe9c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c103660 0x7fbe9c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 -- 172.21.15.46:0/1125616976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe9c102d40 msgr2=0x7fbe9c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe9c102d40 0x7fbe9c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 -- 172.21.15.46:0/1125616976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c19d3c0 con 0x7fbe9c10c170 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea0973640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 0x7fbe9c19cce0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b970 tx=0x7fbe9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:38.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbe997fa640 1 -- 172.21.15.46:0/1125616976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94019070 con 0x7fbe9c10c170 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c19d6b0 con 0x7fbe9c10c170 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbe997fa640 1 -- 172.21.15.46:0/1125616976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe9400cb40 con 0x7fbe9c10c170 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbe997fa640 1 -- 172.21.15.46:0/1125616976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94007610 con 0x7fbe9c10c170 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.684+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c1a4f90 con 0x7fbe9c10c170 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbe997fa640 1 -- 172.21.15.46:0/1125616976 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe9401c070 con 0x7fbe9c10c170 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 Processor -- start 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 -- start start 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477c2f0 0x55f564786670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 0x55f564788fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f5646e2090 con 0x55f564786bb0 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f564689a70 con 0x55f56477b9d0 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbea47af740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5646de050 con 0x55f56477c2f0 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbe997fa640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbe840a3240 0x7fbe840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 0x55f564788fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 0x55f564788fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47208/0 (socket says 172.21.15.46:47208) 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/4175656174 learned_addr learned my addr 172.21.15.46:0/4175656174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.687+0000 7fbe997fa640 1 -- 172.21.15.46:0/1125616976 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbe940cee50 con 0x7fbe9c10c170 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbea0973640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbe840a3240 0x7fbe840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477c2f0 0x55f564786670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/4175656174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477c2f0 msgr2=0x55f564786670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477c2f0 0x55f564786670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/4175656174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 msgr2=0x55f56477bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/4175656174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f564696130 con 0x55f564786bb0 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbea0973640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbe840a3240 0x7fbe840a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe9409b4e0 tx=0x7fbe94014d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 0x55f564788fa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe90014930 tx=0x7fbe9000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2829ddf288adec18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe827fc640 1 -- 172.21.15.46:0/4175656174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000ec60 con 0x55f564786bb0 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe827fc640 1 -- 172.21.15.46:0/4175656174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe9000ee00 con 0x55f564786bb0 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.688+0000 7fbe827fc640 1 -- 172.21.15.46:0/4175656174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9000a5d0 con 0x55f564786bb0 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 -- 172.21.15.46:0/4175656174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 msgr2=0x55f564788fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 0x55f564788fa0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbe90014930 tx=0x7fbe9000b650 comp rx=0 tx=0).stop 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 -- 172.21.15.46:0/4175656174 shutdown_connections 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f564786bb0 0x55f564788fa0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477c2f0 0x55f564786670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 --2- 172.21.15.46:0/4175656174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 -- 172.21.15.46:0/4175656174 >> 172.21.15.46:0/4175656174 conn(0x55f564777f60 msgr2=0x55f564778340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 -- 172.21.15.46:0/4175656174 shutdown_connections 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 -- 172.21.15.46:0/4175656174 wait complete. 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.689+0000 7fbea47af740 1 -- start start 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 Processor -- start 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 0x55f564786450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477c2f0 0x55f5647837a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f564783ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f564789780 con 0x55f56477b9d0 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f56469cf20 con 0x55f56477c2f0 2024-09-19T09:18:38.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f564789900 con 0x55f564786bb0 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbea47af740 10 client.0 _ll_register_callbacks cb 0x55f564666030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 0x55f564786450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 0x55f564786450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47212/0 (socket says 172.21.15.46:47212) 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/996719671 learned_addr learned my addr 172.21.15.46:0/996719671 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477c2f0 0x55f5647837a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f564783ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/996719671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 msgr2=0x55f564783ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f564783ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477c2f0 msgr2=0x55f5647837a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477c2f0 0x55f5647837a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 -- 172.21.15.46:0/996719671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5644532b0 con 0x55f56477b9d0 2024-09-19T09:18:38.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 0x55f564786450 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006010 tx=0x7fbe9000efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66371062b94ed510 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.690+0000 7fbe7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/996719671 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9001f3a0 con 0x55f56477b9d0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe9000ee00 con 0x55f56477b9d0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/996719671 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbe9001f540 con 0x55f56477b9d0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/996719671 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe90036050 con 0x55f56477b9d0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 10 client.15366 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f564795100 con 0x55f56477b9d0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/996719671 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe9000ee00 con 0x55f56477b9d0 2024-09-19T09:18:38.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/996719671 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe9001f860 con 0x55f56477b9d0 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 10 client.15366 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 10 client.15366 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 20 client.15366 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564798970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 4 client.15366 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.691+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5646ef600 con 0x55f564797500 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.692+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564798970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.692+0000 7fbe7b7fe640 10 client.15366 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.692+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564798970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f5914a7655379ca server_cookie=f77e970e51e7e5b2 in_seq=0 out_seq=0 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/996719671 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5646ef600 con 0x55f564797500 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbe7b7fe640 10 client.15366 handle_command_reply: tid=0 2024-09-19T09:18:38.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 client.15366 shutdown 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 msgr2=0x55f564786450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 0x55f564786450 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006010 tx=0x7fbe9000efd0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 shutdown_connections 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564798970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbe7b7fe640 0 client.15366 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f564783ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477c2f0 0x55f5647837a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 --2- 172.21.15.46:0/996719671 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477b9d0 0x55f564786450 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 >> 172.21.15.46:0/996719671 conn(0x55f564777f60 msgr2=0x55f56477dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 shutdown_connections 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 1 -- 172.21.15.46:0/996719671 wait complete. 2024-09-19T09:18:38.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.693+0000 7fbea47af740 20 client.15366 trim_cache size 0 max 16384 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 Processor -- start 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 -- start start 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477b9d0 0x55f564798970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564796e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f564786bb0 0x55f564783080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f564796cb0 con 0x55f56477c2f0 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f564797380 con 0x55f564786bb0 2024-09-19T09:18:38.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbea47af740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f564797a50 con 0x55f56477b9d0 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564796e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564796e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47216/0 (socket says 172.21.15.46:47216) 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.711+0000 7fbe9bfff640 1 -- 172.21.15.46:0/3410266951 learned_addr learned my addr 172.21.15.46:0/3410266951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f564786bb0 0x55f564783080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477b9d0 0x55f564798970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9bfff640 1 -- 172.21.15.46:0/3410266951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477b9d0 msgr2=0x55f564798970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477b9d0 0x55f564798970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9bfff640 1 -- 172.21.15.46:0/3410266951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f564786bb0 msgr2=0x55f564783080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f564786bb0 0x55f564783080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9bfff640 1 -- 172.21.15.46:0/3410266951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f56477c120 con 0x55f56477c2f0 2024-09-19T09:18:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f564786bb0 0x55f564783080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564796e30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009900 tx=0x7fbe8c031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa233ddd36e058e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe81ffb640 1 -- 172.21.15.46:0/3410266951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c035040 con 0x55f56477c2f0 2024-09-19T09:18:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe81ffb640 1 -- 172.21.15.46:0/3410266951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe8c004250 con 0x55f56477c2f0 2024-09-19T09:18:38.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.712+0000 7fbe81ffb640 1 -- 172.21.15.46:0/3410266951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c0487b0 con 0x55f56477c2f0 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 -- 172.21.15.46:0/3410266951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 msgr2=0x55f564796e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564796e30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009900 tx=0x7fbe8c031bb0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 -- 172.21.15.46:0/3410266951 shutdown_connections 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564796e30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f564786bb0 0x55f564783080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 --2- 172.21.15.46:0/3410266951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f56477b9d0 0x55f564798970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 -- 172.21.15.46:0/3410266951 >> 172.21.15.46:0/3410266951 conn(0x55f564777f60 msgr2=0x55f56477e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 -- 172.21.15.46:0/3410266951 shutdown_connections 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 -- 172.21.15.46:0/3410266951 wait complete. 2024-09-19T09:18:38.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.713+0000 7fbea47af740 1 -- start start 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 Processor -- start 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564780310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f56479fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f5647987f0 con 0x55f56477c2f0 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f564798120 con 0x55f56477b9d0 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f564798ec0 con 0x55f564786bb0 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbea47af740 10 client.0 _ll_register_callbacks cb 0x7fbe8c0314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564780310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbe9bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564780310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47228/0 (socket says 172.21.15.46:47228) 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbe9bfff640 1 -- 172.21.15.46:0/2966211762 learned_addr learned my addr 172.21.15.46:0/2966211762 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f56479fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.714+0000 7fbe9bfff640 1 -- 172.21.15.46:0/2966211762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 msgr2=0x55f56479fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f56479fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe9bfff640 1 -- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 msgr2=0x55f56477fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe9bfff640 1 -- 172.21.15.46:0/2966211762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5647a0140 con 0x55f56477c2f0 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f56479fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe9bfff640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564780310 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009230 tx=0x7fbe8c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bc0d9b0555980b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:38.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/2966211762 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c035070 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/2966211762 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbe8c0037f0 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe8c004250 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/2966211762 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe8c0039f0 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbea47af740 10 client.15372 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5647a1440 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/2966211762 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe8c004250 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.715+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/2966211762 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe8c03d570 con 0x55f56477c2f0 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 10 client.15372 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 10 client.15372 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 20 client.15372 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:38.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564804850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 4 client.15372 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "status"}) -- 0x55f5646e9b10 con 0x55f564797500 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564804850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbe7b7fe640 10 client.15372 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbe9b7fe640 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564804850 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c3ba55c26dc26955 server_cookie=521d9673608bf2b7 in_seq=0 out_seq=0 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbe7b7fe640 1 -- 172.21.15.46:0/2966211762 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f5646e9b10 con 0x55f564797500 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbe7b7fe640 10 client.15372 handle_command_reply: tid=0 2024-09-19T09:18:38.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.716+0000 7fbea47af740 1 client.15372 shutdown 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 msgr2=0x55f564780310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564780310 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009230 tx=0x7fbe8c02a480 comp rx=0 tx=0).stop 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 shutdown_connections 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f56477c2f0 0x55f564780310 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55f564797500 0x55f564804850 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f564786bb0 0x55f56479fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbe7b7fe640 0 client.15372 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 --2- 172.21.15.46:0/2966211762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f56477b9d0 0x55f56477fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 >> 172.21.15.46:0/2966211762 conn(0x55f564777f60 msgr2=0x55f56477eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 shutdown_connections 2024-09-19T09:18:38.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 1 -- 172.21.15.46:0/2966211762 wait complete. 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea47af740 20 client.15372 trim_cache size 0 max 16384 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 4, 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24446, 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:38.726 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 123.67247966799999, 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 28, 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 156.56583063100001 2024-09-19T09:18:38.727 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbe840a3240 msgr2=0x7fbe840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea23d6640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbe840a3240 0x7fbe840a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe9409b4e0 tx=0x7fbe94014d00 comp rx=0 tx=0).stop 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 msgr2=0x7fbe9c19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea23d6640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 0x7fbe9c19cce0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400b970 tx=0x7fbe9400be30 comp rx=0 tx=0).stop 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 shutdown_connections 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.717+0000 7fbea23d6640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbe840a3240 0x7fbe840a5700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.718+0000 7fbea23d6640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe9c10c170 0x7fbe9c19cce0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.718+0000 7fbea23d6640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe9c103660 0x7fbe9c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.718+0000 7fbea23d6640 1 --2- 172.21.15.46:0/1125616976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe9c102d40 0x7fbe9c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:38.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.718+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 >> 172.21.15.46:0/1125616976 conn(0x7fbe9c0fc7a0 msgr2=0x7fbe9c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:38.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.718+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 shutdown_connections 2024-09-19T09:18:38.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:38.718+0000 7fbea23d6640 1 -- 172.21.15.46:0/1125616976 wait complete. 2024-09-19T09:18:39.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:38 smithi115 ceph-mon[35055]: pgmap v348: 97 pgs: 97 active+clean; 660 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T09:18:39.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:38 smithi046 ceph-mon[31203]: pgmap v348: 97 pgs: 97 active+clean; 660 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T09:18:39.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:38 smithi099 ceph-mon[35256]: pgmap v348: 97 pgs: 97 active+clean; 660 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T09:18:39.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T09:18:39.675 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 -- 172.21.15.46:0/3205739304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64101420 msgr2=0x7f4d6410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/3205739304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64101420 0x7f4d6410d950 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c009cd0 tx=0x7f4d5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 -- 172.21.15.46:0/3205739304 shutdown_connections 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/3205739304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64101420 0x7f4d6410d950 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/3205739304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 0x7f4d64100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/3205739304 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d64106a80 0x7f4d64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 -- 172.21.15.46:0/3205739304 >> 172.21.15.46:0/3205739304 conn(0x7f4d640fc7a0 msgr2=0x7f4d640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 -- 172.21.15.46:0/3205739304 shutdown_connections 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.176+0000 7f4d6a47a640 1 -- 172.21.15.46:0/3205739304 wait complete. 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.177+0000 7f4d6a47a640 1 Processor -- start 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.177+0000 7f4d6a47a640 1 -- start start 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.177+0000 7f4d6a47a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 0x7f4d640fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d6a47a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d64101420 0x7f4d640fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d6a47a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 0x7f4d640fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d6a47a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64110e80 con 0x7f4d64106a80 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d6a47a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64110d00 con 0x7f4d64100a80 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d6a47a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4d64111000 con 0x7f4d64101420 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 0x7f4d640fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 0x7f4d640fd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47244/0 (socket says 172.21.15.46:47244) 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 -- 172.21.15.46:0/1395392542 learned_addr learned my addr 172.21.15.46:0/1395392542 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d637fe640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d64101420 0x7f4d640fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d63fff640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 0x7f4d640fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 -- 172.21.15.46:0/1395392542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d64101420 msgr2=0x7f4d640fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d64101420 0x7f4d640fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 -- 172.21.15.46:0/1395392542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 msgr2=0x7f4d640fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 0x7f4d640fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 -- 172.21.15.46:0/1395392542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d641a6930 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d63fff640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 0x7f4d640fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d68a17640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 0x7f4d640fd810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005cc0 tx=0x7f4d5c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d617fa640 1 -- 172.21.15.46:0/1395392542 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c003e00 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d617fa640 1 -- 172.21.15.46:0/1395392542 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d5c004520 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.178+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d641a6bc0 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.179+0000 7f4d617fa640 1 -- 172.21.15.46:0/1395392542 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c030db0 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.179+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d641a7150 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d617fa640 1 -- 172.21.15.46:0/1395392542 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4d5c0046d0 con 0x7f4d64106a80 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 Processor -- start 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 -- start start 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f0610cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f06117670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f06119fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561f06073090 con 0x561f0610d2f0 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561f0601aa70 con 0x561f06117bb0 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.181+0000 7f4d6c853740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561f0606f050 con 0x561f0610c9d0 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f06117670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f06117670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47254/0 (socket says 172.21.15.46:47254) 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 -- 172.21.15.46:0/2864291643 learned_addr learned my addr 172.21.15.46:0/2864291643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d617fa640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4d4c0a32c0 0x7f4d4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d637fe640 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f06119fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d637fe640 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f0610cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d68a17640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4d4c0a32c0 0x7f4d4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 -- 172.21.15.46:0/2864291643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 msgr2=0x561f0610cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f0610cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 -- 172.21.15.46:0/2864291643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 msgr2=0x561f06119fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f06119fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 -- 172.21.15.46:0/2864291643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f06027130 con 0x561f0610d2f0 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d637fe640 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f06119fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d617fa640 1 -- 172.21.15.46:0/1395392542 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4d5c02e030 con 0x7f4d64106a80 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d63fff640 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f06117670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ca0 tx=0x7f4d540117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34416ba494ff03f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d4a7fc640 1 -- 172.21.15.46:0/2864291643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54012450 con 0x561f0610d2f0 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d4a7fc640 1 -- 172.21.15.46:0/2864291643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d54012ad0 con 0x561f0610d2f0 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d4a7fc640 1 -- 172.21.15.46:0/2864291643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400fbc0 con 0x561f0610d2f0 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.182+0000 7f4d68a17640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4d4c0a32c0 0x7f4d4c0a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b8040 tx=0x7f4d5c0b1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 -- 172.21.15.46:0/2864291643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 msgr2=0x561f06117670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f06117670 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ca0 tx=0x7f4d540117b0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 -- 172.21.15.46:0/2864291643 shutdown_connections 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f06117670 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f06119fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 --2- 172.21.15.46:0/2864291643 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f0610cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 -- 172.21.15.46:0/2864291643 >> 172.21.15.46:0/2864291643 conn(0x561f06108f60 msgr2=0x561f06109340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 -- 172.21.15.46:0/2864291643 shutdown_connections 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 -- 172.21.15.46:0/2864291643 wait complete. 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.183+0000 7f4d6c853740 1 -- start start 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 Processor -- start 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 0x561f06117300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f06114650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f06117bb0 0x561f06114b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561f0611a780 con 0x561f0610c9d0 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561f0602df20 con 0x561f0610d2f0 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561f0611a900 con 0x561f06117bb0 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d6c853740 10 client.0 _ll_register_callbacks cb 0x561f05ff7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 0x561f06117300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 0x561f06117300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47256/0 (socket says 172.21.15.46:47256) 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 -- 172.21.15.46:0/458493926 learned_addr learned my addr 172.21.15.46:0/458493926 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d63fff640 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f06114650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 -- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f06117bb0 msgr2=0x561f06114b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f06117bb0 0x561f06114b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 -- 172.21.15.46:0/458493926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 msgr2=0x561f06114650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f06114650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.184+0000 7f4d637fe640 1 -- 172.21.15.46:0/458493926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f05de42b0 con 0x561f0610c9d0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d637fe640 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 0x561f06117300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4d58012860 tx=0x7f4d58012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f196d1a802e55c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d437fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d437fe640 1 -- 172.21.15.46:0/458493926 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58004260 con 0x561f0610c9d0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d437fe640 1 -- 172.21.15.46:0/458493926 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4d58004400 con 0x561f0610c9d0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d54012ad0 con 0x561f0610c9d0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d437fe640 1 -- 172.21.15.46:0/458493926 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d5800e930 con 0x561f0610c9d0 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 10 client.15384 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f06125ff0 con 0x561f0610c9d0 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d437fe640 1 -- 172.21.15.46:0/458493926 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d54012ad0 con 0x561f0610c9d0 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d437fe640 1 -- 172.21.15.46:0/458493926 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4d5801b070 con 0x561f0610c9d0 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 10 client.15384 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 10 client.15384 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 20 client.15384 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06128670 0x561f06129ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 4 client.15384 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.185+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f06080600 con 0x561f06128670 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.186+0000 7f4d63fff640 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06128670 0x561f06129ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.186+0000 7f4d63fff640 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06128670 0x561f06129ae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa91fe19033cfa61 server_cookie=2944b57996ba4f40 in_seq=0 out_seq=0 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.186+0000 7f4d437fe640 10 client.15384 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d437fe640 1 -- 172.21.15.46:0/458493926 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f06080600 con 0x561f06128670 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d437fe640 10 client.15384 handle_command_reply: tid=0 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 client.15384 shutdown 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 msgr2=0x561f06117300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 0x561f06117300 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4d58012860 tx=0x7f4d58012d20 comp rx=0 tx=0).stop 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 shutdown_connections 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06128670 0x561f06129ae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f06117bb0 0x561f06114b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f06114650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 --2- 172.21.15.46:0/458493926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610c9d0 0x561f06117300 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d437fe640 0 client.15384 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 >> 172.21.15.46:0/458493926 conn(0x561f06108f60 msgr2=0x561f0610ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 shutdown_connections 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 1 -- 172.21.15.46:0/458493926 wait complete. 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.187+0000 7f4d6c853740 20 client.15384 trim_cache size 0 max 16384 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 Processor -- start 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 -- start start 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06129410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f061164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 0x561f061118b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561f06127e20 con 0x561f06117bb0 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561f061284f0 con 0x561f0610d2f0 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d6c853740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561f06128bc0 con 0x561f0610c9d0 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 0x561f061118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 0x561f061118b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47262/0 (socket says 172.21.15.46:47262) 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.205+0000 7f4d637fe640 1 -- 172.21.15.46:0/790353836 learned_addr learned my addr 172.21.15.46:0/790353836 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d63fff640 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f061164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06129410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 -- 172.21.15.46:0/790353836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 msgr2=0x561f06129410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06129410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 -- 172.21.15.46:0/790353836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 msgr2=0x561f061164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f061164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 -- 172.21.15.46:0/790353836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f06108d90 con 0x561f06117bb0 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d637fe640 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 0x561f061118b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4d58012830 tx=0x7f4d58005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1198f7625cf8c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d49ffb640 1 -- 172.21.15.46:0/790353836 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58003b50 con 0x561f06117bb0 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d49ffb640 1 -- 172.21.15.46:0/790353836 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d58004260 con 0x561f06117bb0 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.206+0000 7f4d49ffb640 1 -- 172.21.15.46:0/790353836 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5801d730 con 0x561f06117bb0 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 -- 172.21.15.46:0/790353836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 msgr2=0x561f061118b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 0x561f061118b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4d58012830 tx=0x7f4d58005f90 comp rx=0 tx=0).stop 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 -- 172.21.15.46:0/790353836 shutdown_connections 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f06117bb0 0x561f061118b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f0610d2f0 0x561f061164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 --2- 172.21.15.46:0/790353836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06129410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 -- 172.21.15.46:0/790353836 >> 172.21.15.46:0/790353836 conn(0x561f06108f60 msgr2=0x561f06115da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 -- 172.21.15.46:0/790353836 shutdown_connections 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 -- 172.21.15.46:0/790353836 wait complete. 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 -- start start 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.207+0000 7f4d6c853740 1 Processor -- start 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06132530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f0612dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f0612e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561f06129960 con 0x561f0610d2f0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561f06129290 con 0x561f06117bb0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561f0612a030 con 0x561f0610c9d0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d6c853740 10 client.0 _ll_register_callbacks cb 0x7f4d58009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f0612dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f0612dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47264/0 (socket says 172.21.15.46:47264) 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 -- 172.21.15.46:0/3848982398 learned_addr learned my addr 172.21.15.46:0/3848982398 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d637fe640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f0612e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d637fe640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06132530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 -- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 msgr2=0x561f06132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06132530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 -- 172.21.15.46:0/3848982398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 msgr2=0x561f0612e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f0612e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 -- 172.21.15.46:0/3848982398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f061087f0 con 0x561f0610d2f0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d63fff640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f0612dfd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ca0 tx=0x7f4d5400f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfaef159ee1cd20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.208+0000 7f4d437fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d437fe640 1 -- 172.21.15.46:0/3848982398 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54035070 con 0x561f0610d2f0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d437fe640 1 -- 172.21.15.46:0/3848982398 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4d54005450 con 0x561f0610d2f0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d58004260 con 0x561f0610d2f0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d437fe640 1 -- 172.21.15.46:0/3848982398 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4d54040050 con 0x561f0610d2f0 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 10 client.15390 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f0610fd40 con 0x561f0610d2f0 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d437fe640 1 -- 172.21.15.46:0/3848982398 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d58004260 con 0x561f0610d2f0 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d437fe640 1 -- 172.21.15.46:0/3848982398 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4d54004a40 con 0x561f0610d2f0 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 10 client.15390 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 10 client.15390 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 20 client.15390 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06197410 0x561f06196120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 4 client.15390 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.209+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "status"}) -- 0x561f0607ab10 con 0x561f06197410 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d637fe640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06197410 0x561f06196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d637fe640 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06197410 0x561f06196120 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3848333f37190be3 server_cookie=2eec62e706f17f34 in_seq=0 out_seq=0 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d437fe640 10 client.15390 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d437fe640 1 -- 172.21.15.46:0/3848982398 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561f0607ab10 con 0x561f06197410 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d437fe640 10 client.15390 handle_command_reply: tid=0 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d6c853740 1 client.15390 shutdown 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 msgr2=0x561f0612dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d6c853740 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f0612dfd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ca0 tx=0x7f4d5400f4b0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 shutdown_connections 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d6c853740 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561f06197410 0x561f06196120 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.210+0000 7f4d6c853740 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561f0610d2f0 0x561f0612dfd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6c853740 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f06117bb0 0x561f0612e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6c853740 1 --2- 172.21.15.46:0/3848982398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561f0610c9d0 0x561f06132530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 >> 172.21.15.46:0/3848982398 conn(0x561f06108f60 msgr2=0x561f06108000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d437fe640 0 client.15390 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 shutdown_connections 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6c853740 1 -- 172.21.15.46:0/3848982398 wait complete. 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6c853740 20 client.15390 trim_cache size 0 max 16384 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 3, 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24451, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 126.17377081399999, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 28, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 163.317842383 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4d4c0a32c0 msgr2=0x7f4d4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4d4c0a32c0 0x7f4d4c0a5780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b8040 tx=0x7f4d5c0b1040 comp rx=0 tx=0).stop 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 msgr2=0x7f4d640fd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 0x7f4d640fd810 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c005cc0 tx=0x7f4d5c0093d0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 shutdown_connections 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4d4c0a32c0 0x7f4d4c0a5780 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64106a80 0x7f4d640fd810 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d64101420 0x7f4d640fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 --2- 172.21.15.46:0/1395392542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d64100a80 0x7f4d640fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 >> 172.21.15.46:0/1395392542 conn(0x7f4d640fc7a0 msgr2=0x7f4d6406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.211+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 shutdown_connections 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:40.212+0000 7f4d6a47a640 1 -- 172.21.15.46:0/1395392542 wait complete. 2024-09-19T09:18:40.957 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T09:18:41.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:40 smithi115 ceph-mon[35055]: pgmap v349: 97 pgs: 97 active+clean; 660 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-19T09:18:41.215 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:41.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:40 smithi046 ceph-mon[31203]: pgmap v349: 97 pgs: 97 active+clean; 660 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-19T09:18:41.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:40 smithi099 ceph-mon[35256]: pgmap v349: 97 pgs: 97 active+clean; 660 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-19T09:18:41.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1700878484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc101de0 msgr2=0x7fd3cc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1700878484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc101de0 0x7fd3cc1021c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009900 tx=0x7fd3bc02a410 comp rx=0 tx=0).stop 2024-09-19T09:18:41.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1700878484 shutdown_connections 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1700878484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3cc106f10 0x7fd3cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1700878484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3cc102790 0x7fd3cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1700878484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc101de0 0x7fd3cc1021c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1700878484 >> 172.21.15.46:0/1700878484 conn(0x7fd3cc0fd8c0 msgr2=0x7fd3cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1700878484 shutdown_connections 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.736+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1700878484 wait complete. 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 Processor -- start 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 -- start start 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3cc101de0 0x7fd3cc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 0x7fd3cc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3cc106f10 0x7fd3cc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc111f70 con 0x7fd3cc102790 2024-09-19T09:18:41.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc111df0 con 0x7fd3cc106f10 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.737+0000 7fd3d24ef640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc1120f0 con 0x7fd3cc101de0 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 0x7fd3cc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 0x7fd3cc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47274/0 (socket says 172.21.15.46:47274) 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/1349011461 learned_addr learned my addr 172.21.15.46:0/1349011461 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3cc101de0 0x7fd3cc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3cc106f10 0x7fd3cc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/1349011461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3cc101de0 msgr2=0x7fd3cc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3cc101de0 0x7fd3cc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/1349011461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3cc106f10 msgr2=0x7fd3cc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3cc106f10 0x7fd3cc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/1349011461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc19d3e0 con 0x7fd3cc102790 2024-09-19T09:18:41.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 0x7fd3cc198970 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000d950 tx=0x7fd3c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3c97fa640 1 -- 172.21.15.46:0/1349011461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0017070 con 0x7fd3cc102790 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3c97fa640 1 -- 172.21.15.46:0/1349011461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c0009c30 con 0x7fd3cc102790 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc19d6d0 con 0x7fd3cc102790 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3c97fa640 1 -- 172.21.15.46:0/1349011461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000f6b0 con 0x7fd3cc102790 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.738+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc1a4fb0 con 0x7fd3cc102790 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3c97fa640 1 -- 172.21.15.46:0/1349011461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd3c000f850 con 0x7fd3cc102790 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 Processor -- start 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 -- start start 2024-09-19T09:18:41.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e1872db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e187d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e187dbb0 0x5594e187ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5594e17d9090 con 0x5594e18732f0 2024-09-19T09:18:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5594e1780a70 con 0x5594e187dbb0 2024-09-19T09:18:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5594e17d5050 con 0x5594e18729d0 2024-09-19T09:18:41.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3cbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e187d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3cbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e187d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47284/0 (socket says 172.21.15.46:47284) 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3cbfff640 1 -- 172.21.15.46:0/1248700350 learned_addr learned my addr 172.21.15.46:0/1248700350 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.741+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e187dbb0 0x5594e187ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3c97fa640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd3b40a3240 0x7fd3b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e1872db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3cbfff640 1 -- 172.21.15.46:0/1248700350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 msgr2=0x5594e1872db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e1872db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3cbfff640 1 -- 172.21.15.46:0/1248700350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e187dbb0 msgr2=0x5594e187ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e187dbb0 0x5594e187ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3cbfff640 1 -- 172.21.15.46:0/1248700350 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e178d130 con 0x5594e18732f0 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd3b40a3240 0x7fd3b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3c97fa640 1 -- 172.21.15.46:0/1349011461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd3c00cf4a0 con 0x7fd3cc102790 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e187d670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009900 tx=0x7fd3bc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca5358552262eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3b27fc640 1 -- 172.21.15.46:0/1248700350 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc040070 con 0x5594e18732f0 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3b27fc640 1 -- 172.21.15.46:0/1248700350 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3bc0319f0 con 0x5594e18732f0 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3b27fc640 1 -- 172.21.15.46:0/1248700350 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc035040 con 0x5594e18732f0 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.742+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd3b40a3240 0x7fd3b40a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4005fd0 tx=0x7fd3c4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 -- 172.21.15.46:0/1248700350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 msgr2=0x5594e187d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e187d670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009900 tx=0x7fd3bc005e80 comp rx=0 tx=0).stop 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 -- 172.21.15.46:0/1248700350 shutdown_connections 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e187d670 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e187dbb0 0x5594e187ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/1248700350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e1872db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 -- 172.21.15.46:0/1248700350 >> 172.21.15.46:0/1248700350 conn(0x5594e186ef60 msgr2=0x5594e186f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 -- 172.21.15.46:0/1248700350 shutdown_connections 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 -- 172.21.15.46:0/1248700350 wait complete. 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 -- start start 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.743+0000 7fd3d48c8740 1 Processor -- start 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1881cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1882200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e18862d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5594e1880780 con 0x5594e18732f0 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5594e1793f20 con 0x5594e18729d0 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5594e1880900 con 0x5594e187dbb0 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d48c8740 10 client.0 _ll_register_callbacks cb 0x5594e175d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1882200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1882200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47292/0 (socket says 172.21.15.46:47292) 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/2634548173 learned_addr learned my addr 172.21.15.46:0/2634548173 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e18862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1881cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 msgr2=0x5594e18862d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e18862d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/2634548173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 msgr2=0x5594e1881cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1881cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/2634548173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594e154a2b0 con 0x5594e18732f0 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1881cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1882200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cd340 tx=0x7fd3c0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96aa8828d133ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.744+0000 7fd3ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:41.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2634548173 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0020050 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2634548173 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd3c00109d0 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3bc0319f0 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2634548173 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3c00a4760 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 10 client.15402 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594e1890420 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2634548173 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3bc0319f0 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2634548173 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3c000fb40 con 0x5594e18732f0 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 10 client.15402 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 10 client.15402 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:18:41.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 20 client.15402 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1892a30 0x5594e1893ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 4 client.15402 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.745+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594e17e6600 con 0x5594e1892a30 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.746+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1892a30 0x5594e1893ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.746+0000 7fd3ab7fe640 10 client.15402 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.746+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1892a30 0x5594e1893ea0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1dec348485604a2 server_cookie=9fde3e6ff033cbe7 in_seq=0 out_seq=0 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2634548173 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594e17e6600 con 0x5594e1892a30 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3ab7fe640 10 client.15402 handle_command_reply: tid=0 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 client.15402 shutdown 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 msgr2=0x5594e1882200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1882200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00cd340 tx=0x7fd3c0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 shutdown_connections 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1892a30 0x5594e1893ea0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1882200 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e18862d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3ab7fe640 0 client.15402 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2634548173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1881cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 >> 172.21.15.46:0/2634548173 conn(0x5594e186ef60 msgr2=0x5594e1874c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 shutdown_connections 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2634548173 wait complete. 2024-09-19T09:18:41.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.747+0000 7fd3d48c8740 20 client.15402 trim_cache size 0 max 16384 2024-09-19T09:18:41.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.765+0000 7fd3d48c8740 1 Processor -- start 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.765+0000 7fd3d48c8740 1 -- start start 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1893ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1886250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e186f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5594e18921e0 con 0x5594e18732f0 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5594e18928b0 con 0x5594e18729d0 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5594e1892f80 con 0x5594e187dbb0 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1886250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1886250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47300/0 (socket says 172.21.15.46:47300) 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/3263158598 learned_addr learned my addr 172.21.15.46:0/3263158598 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:41.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e186f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1893ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/3263158598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 msgr2=0x5594e186f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e186f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/3263158598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 msgr2=0x5594e1893ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1893ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 -- 172.21.15.46:0/3263158598 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594e1873120 con 0x5594e18732f0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e186f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1886250 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0010fd0 tx=0x7fd3c009a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5234f0eedac4e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.766+0000 7fd3b1ffb640 1 -- 172.21.15.46:0/3263158598 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0020070 con 0x5594e18732f0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3b1ffb640 1 -- 172.21.15.46:0/3263158598 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c0098360 con 0x5594e18732f0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3b1ffb640 1 -- 172.21.15.46:0/3263158598 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c00cf110 con 0x5594e18732f0 2024-09-19T09:18:41.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 -- 172.21.15.46:0/3263158598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 msgr2=0x5594e1886250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1886250 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0010fd0 tx=0x7fd3c009a200 comp rx=0 tx=0).stop 2024-09-19T09:18:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 -- 172.21.15.46:0/3263158598 shutdown_connections 2024-09-19T09:18:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e18732f0 0x5594e1886250 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e187dbb0 0x5594e186f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/3263158598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18729d0 0x5594e1893ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 -- 172.21.15.46:0/3263158598 >> 172.21.15.46:0/3263158598 conn(0x5594e186ef60 msgr2=0x5594e1869ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 -- 172.21.15.46:0/3263158598 shutdown_connections 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.767+0000 7fd3d48c8740 1 -- 172.21.15.46:0/3263158598 wait complete. 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 -- start start 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 Processor -- start 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e187c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18732f0 0x5594e188d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 0x5594e188d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5594e1893d20 con 0x5594e187dbb0 2024-09-19T09:18:41.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5594e1893650 con 0x5594e18732f0 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5594e18943f0 con 0x5594e18729d0 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d48c8740 10 client.0 _ll_register_callbacks cb 0x7fd3c000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d0a8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 0x5594e188d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d0a8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 0x5594e188d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47314/0 (socket says 172.21.15.46:47314) 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3d0a8c640 1 -- 172.21.15.46:0/2223689133 learned_addr learned my addr 172.21.15.46:0/2223689133 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.768+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e187c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3cb7fe640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18732f0 0x5594e188d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d0a8c640 1 -- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 msgr2=0x5594e187c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e187c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d0a8c640 1 -- 172.21.15.46:0/2223689133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18732f0 msgr2=0x5594e188d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18732f0 0x5594e188d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d0a8c640 1 -- 172.21.15.46:0/2223689133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594e188e150 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d0a8c640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 0x5594e188d920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40138c0 tx=0x7fd3c4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec561c8e6184f140 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2223689133 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c402c060 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3c0098360 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2223689133 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd3c401dd90 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2223689133 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3c40273f0 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d48c8740 10 client.15408 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.769+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594e18fd200 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2223689133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c0098360 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2223689133 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3c4026070 con 0x5594e187dbb0 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3d48c8740 10 client.15408 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3d48c8740 10 client.15408 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:18:41.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3d48c8740 20 client.15408 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1901d00 0x5594e1900a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3d48c8740 4 client.15408 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "status"}) -- 0x5594e17e0b10 con 0x5594e1901d00 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1901d00 0x5594e1900a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3cbfff640 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1901d00 0x5594e1900a10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a79e66c18261718f server_cookie=82b5205977eb77fd in_seq=0 out_seq=0 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.770+0000 7fd3ab7fe640 10 client.15408 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3ab7fe640 1 -- 172.21.15.46:0/2223689133 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5594e17e0b10 con 0x5594e1901d00 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3ab7fe640 10 client.15408 handle_command_reply: tid=0 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 client.15408 shutdown 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 msgr2=0x5594e188d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 0x5594e188d920 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40138c0 tx=0x7fd3c4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 shutdown_connections 2024-09-19T09:18:41.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x5594e1901d00 0x5594e1900a10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594e187dbb0 0x5594e188d920 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3ab7fe640 0 client.15408 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5594e18732f0 0x5594e188d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 --2- 172.21.15.46:0/2223689133 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5594e18729d0 0x5594e187c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 >> 172.21.15.46:0/2223689133 conn(0x5594e186ef60 msgr2=0x5594e186f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 shutdown_connections 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 1 -- 172.21.15.46:0/2223689133 wait complete. 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.771+0000 7fd3d48c8740 20 client.15408 trim_cache size 0 max 16384 2024-09-19T09:18:41.788 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 2, 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24463, 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 128.74136798500001, 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 28, 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 162.24904134299999 2024-09-19T09:18:41.789 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:41.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd3b40a3240 msgr2=0x7fd3b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd3b40a3240 0x7fd3b40a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4005fd0 tx=0x7fd3c4004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:41.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 msgr2=0x7fd3cc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 0x7fd3cc198970 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000d950 tx=0x7fd3c000de10 comp rx=0 tx=0).stop 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 shutdown_connections 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd3b40a3240 0x7fd3b40a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3cc102790 0x7fd3cc198970 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3cc106f10 0x7fd3cc19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 --2- 172.21.15.46:0/1349011461 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd3cc101de0 0x7fd3cc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 >> 172.21.15.46:0/1349011461 conn(0x7fd3cc0fd8c0 msgr2=0x7fd3cc0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 shutdown_connections 2024-09-19T09:18:41.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:41.772+0000 7fd3d24ef640 1 -- 172.21.15.46:0/1349011461 wait complete. 2024-09-19T09:18:42.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T09:18:42.730 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:43.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:42 smithi046 ceph-mon[31203]: pgmap v350: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T09:18:43.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:42 smithi115 ceph-mon[35055]: pgmap v350: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T09:18:43.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:42 smithi099 ceph-mon[35256]: pgmap v350: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 -- 172.21.15.46:0/2411245696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8100a80 msgr2=0x7f1ab8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/2411245696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8100a80 0x7f1ab8100ee0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009930 tx=0x7f1aa002a420 comp rx=0 tx=0).stop 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 -- 172.21.15.46:0/2411245696 shutdown_connections 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/2411245696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8100a80 0x7f1ab8100ee0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/2411245696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab8101420 0x7f1ab810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/2411245696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ab8106a80 0x7f1ab8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 -- 172.21.15.46:0/2411245696 >> 172.21.15.46:0/2411245696 conn(0x7f1ab80fc7a0 msgr2=0x7f1ab80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 -- 172.21.15.46:0/2411245696 shutdown_connections 2024-09-19T09:18:43.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.245+0000 7f1abe9fd640 1 -- 172.21.15.46:0/2411245696 wait complete. 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 Processor -- start 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 -- start start 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab8100a80 0x7f1ab81973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ab8101420 0x7f1ab81978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 0x7f1ab819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8110e80 con 0x7f1ab8106a80 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8110d00 con 0x7f1ab8101420 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abe9fd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab8111000 con 0x7f1ab8100a80 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abcf9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 0x7f1ab819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abcf9a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 0x7f1ab819bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47338/0 (socket says 172.21.15.46:47338) 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1abcf9a640 1 -- 172.21.15.46:0/686042859 learned_addr learned my addr 172.21.15.46:0/686042859 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1aaffff640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ab8101420 0x7f1ab81978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.246+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab8100a80 0x7f1ab81973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abcf9a640 1 -- 172.21.15.46:0/686042859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab8100a80 msgr2=0x7f1ab81973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abcf9a640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab8100a80 0x7f1ab81973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abcf9a640 1 -- 172.21.15.46:0/686042859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ab8101420 msgr2=0x7f1ab81978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abcf9a640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ab8101420 0x7f1ab81978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abcf9a640 1 -- 172.21.15.46:0/686042859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab819c350 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abcf9a640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 0x7f1ab819bc70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009fd0 tx=0x7f1ab000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1ab5ffb640 1 -- 172.21.15.46:0/686042859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0017070 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab819c640 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1ab5ffb640 1 -- 172.21.15.46:0/686042859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ab0003e50 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1ab5ffb640 1 -- 172.21.15.46:0/686042859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00106c0 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.247+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab81a3f20 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.249+0000 7f1ab5ffb640 1 -- 172.21.15.46:0/686042859 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ab0003970 con 0x7f1ab8106a80 2024-09-19T09:18:43.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.249+0000 7f1ac0dd6740 1 Processor -- start 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 -- start start 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1adf8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 0x561e1adf9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1ae05c70 0x561e1ae08060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561e1ad5d090 con 0x561e1adf9000 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561e1ad04a70 con 0x561e1adfa230 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561e1ad59050 con 0x561e1ae05c70 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 0x561e1adf9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 0x561e1adf9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47344/0 (socket says 172.21.15.46:47344) 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 -- 172.21.15.46:0/3900861075 learned_addr learned my addr 172.21.15.46:0/3900861075 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1adf8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab5ffb640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aa40a3240 0x7f1aa40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1ae05c70 0x561e1ae08060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 -- 172.21.15.46:0/3900861075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1ae05c70 msgr2=0x561e1ae08060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1ae05c70 0x561e1ae08060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 -- 172.21.15.46:0/3900861075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 msgr2=0x561e1adf8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1adf8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab7fff640 1 -- 172.21.15.46:0/3900861075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1ad11130 con 0x561e1adf9000 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1adf8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1ab5ffb640 1 -- 172.21.15.46:0/686042859 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1ab00cf650 con 0x7f1ab8106a80 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.250+0000 7f1abcf9a640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aa40a3240 0x7f1aa40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 0x561e1adf9460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800bc90 tx=0x7f1aa80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f58aa77cf18c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1aae7fc640 1 -- 172.21.15.46:0/3900861075 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa801c480 con 0x561e1adf9000 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1aae7fc640 1 -- 172.21.15.46:0/3900861075 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa801cb00 con 0x561e1adf9000 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1aae7fc640 1 -- 172.21.15.46:0/3900861075 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8011bb0 con 0x561e1adf9000 2024-09-19T09:18:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3900861075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 msgr2=0x561e1adf9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1abcf9a640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aa40a3240 0x7f1aa40a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ab009bc80 tx=0x7f1ab00044b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.251+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 0x561e1adf9460 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800bc90 tx=0x7f1aa80107a0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3900861075 shutdown_connections 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf9000 0x561e1adf9460 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1ae05c70 0x561e1ae08060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3900861075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1adf8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3900861075 >> 172.21.15.46:0/3900861075 conn(0x561e1adf5170 msgr2=0x561e1adf5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3900861075 shutdown_connections 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3900861075 wait complete. 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- start start 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 Processor -- start 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adf9000 0x561e1ae05570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adfa230 0x561e1ae02910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 0x561e1ae02e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae08b80 con 0x561e1ae05c70 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561e1ad17f20 con 0x561e1adf9000 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae08d00 con 0x561e1adfa230 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.252+0000 7f1ac0dd6740 10 client.0 _ll_register_callbacks cb 0x561e1ace1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 0x561e1ae02e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 0x561e1ae02e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47360/0 (socket says 172.21.15.46:47360) 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 -- 172.21.15.46:0/2564689789 learned_addr learned my addr 172.21.15.46:0/2564689789 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adf9000 0x561e1ae05570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adfa230 0x561e1ae02910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 -- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adfa230 msgr2=0x561e1ae02910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adfa230 0x561e1ae02910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 -- 172.21.15.46:0/2564689789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adf9000 msgr2=0x561e1ae05570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adf9000 0x561e1ae05570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 -- 172.21.15.46:0/2564689789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e1aace2b0 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adfa230 0x561e1ae02910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1aaffff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 0x561e1ae02e50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1aa002a940 tx=0x7f1aa0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df5043589fd472e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1a977fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1a977fe640 1 -- 172.21.15.46:0/2564689789 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0035040 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa801cb00 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.253+0000 7f1a977fe640 1 -- 172.21.15.46:0/2564689789 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1aa0004260 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1a977fe640 1 -- 172.21.15.46:0/2564689789 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1aa0004460 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 10 client.15420 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e1ae14530 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1a977fe640 1 -- 172.21.15.46:0/2564689789 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa801cb00 con 0x561e1ae05c70 2024-09-19T09:18:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1a977fe640 1 -- 172.21.15.46:0/2564689789 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1aa0003a60 con 0x561e1ae05c70 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 10 client.15420 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 10 client.15420 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 20 client.15420 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae16ab0 0x561e1ae17f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 4 client.15420 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e1ad6a600 con 0x561e1ae16ab0 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.254+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae16ab0 0x561e1ae17f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.255+0000 7f1a977fe640 10 client.15420 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.255+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae16ab0 0x561e1ae17f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76fbd92b44efcb5e server_cookie=ecf441cd7c4d83a in_seq=0 out_seq=0 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1a977fe640 1 -- 172.21.15.46:0/2564689789 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e1ad6a600 con 0x561e1ae16ab0 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1a977fe640 10 client.15420 handle_command_reply: tid=0 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 client.15420 shutdown 2024-09-19T09:18:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 msgr2=0x561e1ae02e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 0x561e1ae02e50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1aa002a940 tx=0x7f1aa0009260 comp rx=0 tx=0).stop 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 shutdown_connections 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae16ab0 0x561e1ae17f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1ae05c70 0x561e1ae02e50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adfa230 0x561e1ae02910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/2564689789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adf9000 0x561e1ae05570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1a977fe640 0 client.15420 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 >> 172.21.15.46:0/2564689789 conn(0x561e1adf5170 msgr2=0x561e1adfaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 shutdown_connections 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/2564689789 wait complete. 2024-09-19T09:18:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.256+0000 7f1ac0dd6740 20 client.15420 trim_cache size 0 max 16384 2024-09-19T09:18:43.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.274+0000 7f1ac0dd6740 1 Processor -- start 2024-09-19T09:18:43.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 -- start start 2024-09-19T09:18:43.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae17180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae011e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae01720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae16260 con 0x561e1adf5170 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae16930 con 0x561e1adfa230 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae17000 con 0x561e1adf9000 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae17180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae17180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47370/0 (socket says 172.21.15.46:47370) 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 -- 172.21.15.46:0/3847439354 learned_addr learned my addr 172.21.15.46:0/3847439354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae01720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 -- 172.21.15.46:0/3847439354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 msgr2=0x561e1ae011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 -- 172.21.15.46:0/3847439354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 msgr2=0x561e1ae01720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae01720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 -- 172.21.15.46:0/3847439354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1ae03450 con 0x561e1adf5170 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.275+0000 7f1aaffff640 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae17180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1aa002a460 tx=0x7f1aa0031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f352507d7551dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1aadffb640 1 -- 172.21.15.46:0/3847439354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0035040 con 0x561e1adf5170 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1aadffb640 1 -- 172.21.15.46:0/3847439354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa0043040 con 0x561e1adf5170 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1aadffb640 1 -- 172.21.15.46:0/3847439354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa004e880 con 0x561e1adf5170 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3847439354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 msgr2=0x561e1ae17180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae17180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1aa002a460 tx=0x7f1aa0031b40 comp rx=0 tx=0).stop 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3847439354 shutdown_connections 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae01720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/3847439354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae17180 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3847439354 >> 172.21.15.46:0/3847439354 conn(0x561e1adf1b50 msgr2=0x561e1ae028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:43.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3847439354 shutdown_connections 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.276+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/3847439354 wait complete. 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 -- start start 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 Processor -- start 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae20730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae1b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae17da0 con 0x561e1adf5170 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae176d0 con 0x561e1adfa230 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561e1ae18470 con 0x561e1adf9000 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1ac0dd6740 10 client.0 _ll_register_callbacks cb 0x7f1aa0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1aaffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae201f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47380/0 (socket says 172.21.15.46:47380) 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.277+0000 7f1aaffff640 1 -- 172.21.15.46:0/416203504 learned_addr learned my addr 172.21.15.46:0/416203504 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1aaffff640 1 -- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 msgr2=0x561e1ae20730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae20730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1aaffff640 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae20730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1aaffff640 1 -- 172.21.15.46:0/416203504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 msgr2=0x561e1ae1b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1aaffff640 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae1b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1aaffff640 1 -- 172.21.15.46:0/416203504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e1ae1b6e0 con 0x561e1adf5170 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1aaffff640 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae201f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0003eb0 tx=0x7f1aa004e270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903d87112de91d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1a977fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1a977fe640 1 -- 172.21.15.46:0/416203504 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0035070 con 0x561e1adf5170 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1a977fe640 1 -- 172.21.15.46:0/416203504 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1aa003e250 con 0x561e1adf5170 2024-09-19T09:18:43.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1aa0043040 con 0x561e1adf5170 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1a977fe640 1 -- 172.21.15.46:0/416203504 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1aa0031720 con 0x561e1adf5170 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1ac0dd6740 10 client.15426 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e1ae81890 con 0x561e1adf5170 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.278+0000 7f1a977fe640 1 -- 172.21.15.46:0/416203504 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aa0043040 con 0x561e1adf5170 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1a977fe640 1 -- 172.21.15.46:0/416203504 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1aa005e030 con 0x561e1adf5170 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ac0dd6740 10 client.15426 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ac0dd6740 10 client.15426 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ac0dd6740 20 client.15426 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae05c70 0x561e1ae84f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ac0dd6740 4 client.15426 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "status"}) -- 0x561e1ad64b10 con 0x561e1ae05c70 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae05c70 0x561e1ae84f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:43.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae05c70 0x561e1ae84f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b2f9f9a5a71e85a server_cookie=dbbbc26398c2ceca in_seq=0 out_seq=0 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1a977fe640 10 client.15426 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1a977fe640 1 -- 172.21.15.46:0/416203504 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561e1ad64b10 con 0x561e1ae05c70 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.279+0000 7f1a977fe640 10 client.15426 handle_command_reply: tid=0 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 client.15426 shutdown 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 msgr2=0x561e1ae201f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae201f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0003eb0 tx=0x7f1aa004e270 comp rx=0 tx=0).stop 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 shutdown_connections 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x561e1ae05c70 0x561e1ae84f50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561e1adfa230 0x561e1ae1b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561e1adf9000 0x561e1ae20730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 --2- 172.21.15.46:0/416203504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561e1adf5170 0x561e1ae201f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 >> 172.21.15.46:0/416203504 conn(0x561e1adf1b50 msgr2=0x561e1adffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:43.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1a977fe640 0 client.15426 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 shutdown_connections 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 1 -- 172.21.15.46:0/416203504 wait complete. 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1ac0dd6740 20 client.15426 trim_cache size 0 max 16384 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 1, 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24472, 2024-09-19T09:18:43.292 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 131.25709802700001, 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 28, 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 158.47630701400001 2024-09-19T09:18:43.293 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aa40a3240 msgr2=0x7f1aa40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aa40a3240 0x7f1aa40a5700 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ab009bc80 tx=0x7f1ab00044b0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 msgr2=0x7f1ab819bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.280+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 0x7f1ab819bc70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009fd0 tx=0x7f1ab000b260 comp rx=0 tx=0).stop 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 shutdown_connections 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aa40a3240 0x7f1aa40a5700 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ab8106a80 0x7f1ab819bc70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ab8101420 0x7f1ab81978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 --2- 172.21.15.46:0/686042859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ab8100a80 0x7f1ab81973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:43.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 >> 172.21.15.46:0/686042859 conn(0x7f1ab80fc7a0 msgr2=0x7f1ab80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:43.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 shutdown_connections 2024-09-19T09:18:43.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:43.281+0000 7f1abe9fd640 1 -- 172.21.15.46:0/686042859 wait complete. 2024-09-19T09:18:43.924 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:18:44.183 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/1537324961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc101de0 msgr2=0x7fe9bc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/1537324961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc101de0 0x7fe9bc1021c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009900 tx=0x7fe9ac02a410 comp rx=0 tx=0).stop 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/1537324961 shutdown_connections 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/1537324961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9bc106f10 0x7fe9bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/1537324961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9bc102790 0x7fe9bc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/1537324961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc101de0 0x7fe9bc1021c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.661+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/1537324961 >> 172.21.15.46:0/1537324961 conn(0x7fe9bc0fd8c0 msgr2=0x7fe9bc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/1537324961 shutdown_connections 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/1537324961 wait complete. 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 Processor -- start 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 -- start start 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9bc101de0 0x7fe9bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 0x7fe9bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9bc106f10 0x7fe9bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc111f70 con 0x7fe9bc102790 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc111df0 con 0x7fe9bc106f10 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9c1b1b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc1120f0 con 0x7fe9bc101de0 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.662+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 0x7fe9bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 0x7fe9bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47410/0 (socket says 172.21.15.46:47410) 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 -- 172.21.15.46:0/2546131005 learned_addr learned my addr 172.21.15.46:0/2546131005 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9bc101de0 0x7fe9bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9bc106f10 0x7fe9bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 -- 172.21.15.46:0/2546131005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9bc101de0 msgr2=0x7fe9bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9bc101de0 0x7fe9bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 -- 172.21.15.46:0/2546131005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9bc106f10 msgr2=0x7fe9bc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9bc106f10 0x7fe9bc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 -- 172.21.15.46:0/2546131005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc1a6900 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 0x7fe9bc074a30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400d950 tx=0x7fe9a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b97fa640 1 -- 172.21.15.46:0/2546131005 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4017070 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b97fa640 1 -- 172.21.15.46:0/2546131005 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a4009c30 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc1a6bf0 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9b97fa640 1 -- 172.21.15.46:0/2546131005 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400f6b0 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.663+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1a7130 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9b97fa640 1 -- 172.21.15.46:0/2546131005 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe9a40109d0 con 0x7fe9bc102790 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 Processor -- start 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 -- start start 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 0x5648fd2b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b42f0 0x5648fd2be670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2bebb0 0x5648fd2c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5648fd21a090 con 0x5648fd2b39d0 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5648fd1c1a70 con 0x5648fd2b42f0 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5648fd216050 con 0x5648fd2bebb0 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 0x5648fd2b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.666+0000 7fe9b97fa640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9a80a3240 0x7fe9a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 0x5648fd2b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47418/0 (socket says 172.21.15.46:47418) 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2761658386 learned_addr learned my addr 172.21.15.46:0/2761658386 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b42f0 0x5648fd2be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9a80a3240 0x7fe9a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9b97fa640 1 -- 172.21.15.46:0/2546131005 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe9a40cf530 con 0x7fe9bc102790 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2bebb0 0x5648fd2c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2761658386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2bebb0 msgr2=0x5648fd2c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2bebb0 0x5648fd2c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2761658386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b42f0 msgr2=0x5648fd2be670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b42f0 0x5648fd2be670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2761658386 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648fd1ce130 con 0x5648fd2b39d0 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 0x5648fd2b3db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4005c40 tx=0x7fe9b4014dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b520db3d2bb29f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9a80a3240 0x7fe9a80a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4012760 tx=0x7fe9b401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9b1ffb640 1 -- 172.21.15.46:0/2761658386 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4024070 con 0x5648fd2b39d0 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9b1ffb640 1 -- 172.21.15.46:0/2761658386 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b40108a0 con 0x5648fd2b39d0 2024-09-19T09:18:44.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.667+0000 7fe9b1ffb640 1 -- 172.21.15.46:0/2761658386 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b401d8e0 con 0x5648fd2b39d0 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2761658386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 msgr2=0x5648fd2b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 0x5648fd2b3db0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4005c40 tx=0x7fe9b4014dd0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2761658386 shutdown_connections 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2bebb0 0x5648fd2c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b42f0 0x5648fd2be670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2761658386 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b39d0 0x5648fd2b3db0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2761658386 >> 172.21.15.46:0/2761658386 conn(0x5648fd2aff60 msgr2=0x5648fd2b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2761658386 shutdown_connections 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2761658386 wait complete. 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.668+0000 7fe9c3ef4740 1 -- start start 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 Processor -- start 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2be480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2bb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2c1780 con 0x5648fd2bebb0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5648fd1d4f20 con 0x5648fd2b39d0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2c1900 con 0x5648fd2b42f0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9c3ef4740 10 client.0 _ll_register_callbacks cb 0x5648fd19e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2bbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47424/0 (socket says 172.21.15.46:47424) 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2697238188 learned_addr learned my addr 172.21.15.46:0/2697238188 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2bb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2697238188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 msgr2=0x5648fd2bb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2bb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 msgr2=0x5648fd2be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2be480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.669+0000 7fe9bbfff640 1 -- 172.21.15.46:0/2697238188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648fcf8b2b0 con 0x5648fd2bebb0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2bbd10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400a010 tx=0x7fe9b4014650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdc86b226b01b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe99affd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe99affd640 1 -- 172.21.15.46:0/2697238188 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b402c070 con 0x5648fd2bebb0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe99affd640 1 -- 172.21.15.46:0/2697238188 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe9b4010a50 con 0x5648fd2bebb0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b40108a0 con 0x5648fd2bebb0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe99affd640 1 -- 172.21.15.46:0/2697238188 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9b4038050 con 0x5648fd2bebb0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe9c3ef4740 10 client.15438 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648fd2cd090 con 0x5648fd2bebb0 2024-09-19T09:18:44.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe99affd640 1 -- 172.21.15.46:0/2697238188 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b40108a0 con 0x5648fd2bebb0 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe99affd640 1 -- 172.21.15.46:0/2697238188 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9b400f040 con 0x5648fd2bebb0 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.670+0000 7fe9c3ef4740 10 client.15438 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9c3ef4740 10 client.15438 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9c3ef4740 20 client.15438 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd2cf300 0x5648fd2d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9c3ef4740 4 client.15438 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648fd227600 con 0x5648fd2cf300 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd2cf300 0x5648fd2d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe99affd640 10 client.15438 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.671+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd2cf300 0x5648fd2d0770 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c404681e6a90cc39 server_cookie=cc5e34c0483ce19e in_seq=0 out_seq=0 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe99affd640 1 -- 172.21.15.46:0/2697238188 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648fd227600 con 0x5648fd2cf300 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe99affd640 10 client.15438 handle_command_reply: tid=0 2024-09-19T09:18:44.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 client.15438 shutdown 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 msgr2=0x5648fd2bbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2bbd10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400a010 tx=0x7fe9b4014650 comp rx=0 tx=0).stop 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 shutdown_connections 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd2cf300 0x5648fd2d0770 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2bbd10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2bb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/2697238188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe99affd640 0 client.15438 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 >> 172.21.15.46:0/2697238188 conn(0x5648fd2aff60 msgr2=0x5648fd2b5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 shutdown_connections 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/2697238188 wait complete. 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.672+0000 7fe9c3ef4740 20 client.15438 trim_cache size 0 max 16384 2024-09-19T09:18:44.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 Processor -- start 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 -- start start 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2ceab0 con 0x5648fd2bebb0 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2cf180 con 0x5648fd2b39d0 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2cf850 con 0x5648fd2b42f0 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2b8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47432/0 (socket says 172.21.15.46:47432) 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.690+0000 7fe9bbfff640 1 -- 172.21.15.46:0/3321847265 learned_addr learned my addr 172.21.15.46:0/3321847265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9bbfff640 1 -- 172.21.15.46:0/3321847265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 msgr2=0x5648fd2b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9bbfff640 1 -- 172.21.15.46:0/3321847265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 msgr2=0x5648fd2aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9bbfff640 1 -- 172.21.15.46:0/3321847265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648fd2be0a0 con 0x5648fd2bebb0 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2b8f90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4010fd0 tx=0x7fe9b4005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631cf943f9ef8791 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9b17fa640 1 -- 172.21.15.46:0/3321847265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4041070 con 0x5648fd2bebb0 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9b17fa640 1 -- 172.21.15.46:0/3321847265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b401d880 con 0x5648fd2bebb0 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.691+0000 7fe9b17fa640 1 -- 172.21.15.46:0/3321847265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b402c040 con 0x5648fd2bebb0 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3321847265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 msgr2=0x5648fd2b8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2b8f90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4010fd0 tx=0x7fe9b4005d30 comp rx=0 tx=0).stop 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3321847265 shutdown_connections 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2bebb0 0x5648fd2b8f90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b42f0 0x5648fd2b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3321847265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2b39d0 0x5648fd2aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3321847265 >> 172.21.15.46:0/3321847265 conn(0x5648fd2aff60 msgr2=0x5648fd2ae7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3321847265 shutdown_connections 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3321847265 wait complete. 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 -- start start 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.692+0000 7fe9c3ef4740 1 Processor -- start 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b39d0 0x5648fd2d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 0x5648fd2d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2bebb0 0x5648fd2d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2d05f0 con 0x5648fd2b42f0 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2cff20 con 0x5648fd2bebb0 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5648fd2d0cc0 con 0x5648fd2b39d0 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 10 client.0 _ll_register_callbacks cb 0x7fe9b4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:44.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 0x5648fd2d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 0x5648fd2d4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47436/0 (socket says 172.21.15.46:47436) 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 -- 172.21.15.46:0/3572935339 learned_addr learned my addr 172.21.15.46:0/3572935339 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b39d0 0x5648fd2d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2bebb0 0x5648fd2d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 -- 172.21.15.46:0/3572935339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b39d0 msgr2=0x5648fd2d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b39d0 0x5648fd2d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 -- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2bebb0 msgr2=0x5648fd2d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2bebb0 0x5648fd2d4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 -- 172.21.15.46:0/3572935339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648fd2d5320 con 0x5648fd2b42f0 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9bbfff640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2bebb0 0x5648fd2d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9b3fff640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 0x5648fd2d4590 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe9a409bb10 tx=0x7fe9a400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e457987ad45c7f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:44.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe99affd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe99affd640 1 -- 172.21.15.46:0/3572935339 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4020040 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe99affd640 1 -- 172.21.15.46:0/3572935339 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe9a40cf0b0 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.693+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b401d880 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe99affd640 1 -- 172.21.15.46:0/3572935339 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9a409bb80 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648fd339b00 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe99affd640 1 -- 172.21.15.46:0/3572935339 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b401d880 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe99affd640 1 -- 172.21.15.46:0/3572935339 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9a4086070 con 0x5648fd2b42f0 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 10 client.15444 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 20 client.15444 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:44.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd33e690 0x5648fd33d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 4 client.15444 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "status"}) -- 0x5648fd221b10 con 0x5648fd33e690 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.694+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd33e690 0x5648fd33d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe9bb7fe640 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd33e690 0x5648fd33d3a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53dc9f5c23538136 server_cookie=3a8e013897ad44d7 in_seq=0 out_seq=0 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe99affd640 10 client.15444 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe99affd640 1 -- 172.21.15.46:0/3572935339 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5648fd221b10 con 0x5648fd33e690 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe99affd640 10 client.15444 handle_command_reply: tid=0 2024-09-19T09:18:44.724 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "cluster_fsid": "a514acda-7666-11ef-bceb-c7b262605968", 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "whoami": 0, 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 24476, 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "want_state": "up:active", 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "state": "up:active", 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs", 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "rank_uptime": 139.70866342299999, 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "mdsmap_epoch": 28, 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch": 84, 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_epoch_barrier": 84, 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout: "uptime": 150.50502509500001 2024-09-19T09:18:44.725 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe9c3ef4740 1 client.15444 shutdown 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 msgr2=0x5648fd2d4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 0x5648fd2d4590 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe9a409bb10 tx=0x7fe9a400bf60 comp rx=0 tx=0).stop 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 shutdown_connections 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.695+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5648fd33e690 0x5648fd33d3a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5648fd2b42f0 0x5648fd2d4590 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5648fd2bebb0 0x5648fd2d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe99affd640 0 client.15444 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 1 --2- 172.21.15.46:0/3572935339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5648fd2b39d0 0x5648fd2d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 >> 172.21.15.46:0/3572935339 conn(0x5648fd2aff60 msgr2=0x5648fd2af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 shutdown_connections 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 1 -- 172.21.15.46:0/3572935339 wait complete. 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c3ef4740 20 client.15444 trim_cache size 0 max 16384 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9a80a3240 msgr2=0x7fe9a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9a80a3240 0x7fe9a80a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4012760 tx=0x7fe9b401e000 comp rx=0 tx=0).stop 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 msgr2=0x7fe9bc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 0x7fe9bc074a30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400d950 tx=0x7fe9a400de10 comp rx=0 tx=0).stop 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 shutdown_connections 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9a80a3240 0x7fe9a80a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9bc102790 0x7fe9bc074a30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9bc106f10 0x7fe9bc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 --2- 172.21.15.46:0/2546131005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9bc101de0 0x7fe9bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:44.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 >> 172.21.15.46:0/2546131005 conn(0x7fe9bc0fd8c0 msgr2=0x7fe9bc0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:44.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.696+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 shutdown_connections 2024-09-19T09:18:44.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:44.697+0000 7fe9c1b1b640 1 -- 172.21.15.46:0/2546131005 wait complete. 2024-09-19T09:18:45.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:44 smithi115 ceph-mon[35055]: pgmap v351: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T09:18:45.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:44 smithi046 ceph-mon[31203]: pgmap v351: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T09:18:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:44 smithi099 ceph-mon[35256]: pgmap v351: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T09:18:45.332 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T09:18:47.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:46 smithi115 ceph-mon[35055]: pgmap v352: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T09:18:47.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:46 smithi046 ceph-mon[31203]: pgmap v352: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T09:18:47.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:46 smithi099 ceph-mon[35256]: pgmap v352: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 -- 172.21.15.46:0/3738712442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a541025e0 msgr2=0x7f5a541049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 --2- 172.21.15.46:0/3738712442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a541025e0 0x7f5a541049d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009ca0 tx=0x7f5a4402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 -- 172.21.15.46:0/3738712442 shutdown_connections 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 --2- 172.21.15.46:0/3738712442 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a54107840 0x7f5a54109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 --2- 172.21.15.46:0/3738712442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a54104f10 0x7f5a54107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 --2- 172.21.15.46:0/3738712442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a541025e0 0x7f5a541049d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 -- 172.21.15.46:0/3738712442 >> 172.21.15.46:0/3738712442 conn(0x7f5a540fc1e0 msgr2=0x7f5a540fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 -- 172.21.15.46:0/3738712442 shutdown_connections 2024-09-19T09:18:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.639+0000 7f5a59277640 1 -- 172.21.15.46:0/3738712442 wait complete. 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 Processor -- start 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 -- start start 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a541025e0 0x7f5a54101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 0x7f5a54100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a54107840 0x7f5a54100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410d870 con 0x7f5a54104f10 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410d6f0 con 0x7f5a541025e0 2024-09-19T09:18:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a59277640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410d9f0 con 0x7f5a54107840 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 0x7f5a54100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 0x7f5a54100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58574/0 (socket says 172.21.15.46:58574) 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a527fc640 1 -- 172.21.15.46:0/2667828226 learned_addr learned my addr 172.21.15.46:0/2667828226 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.640+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a541025e0 0x7f5a54101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a54107840 0x7f5a54100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a527fc640 1 -- 172.21.15.46:0/2667828226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a54107840 msgr2=0x7f5a54100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a54107840 0x7f5a54100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a527fc640 1 -- 172.21.15.46:0/2667828226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a541025e0 msgr2=0x7f5a54101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a541025e0 0x7f5a54101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a527fc640 1 -- 172.21.15.46:0/2667828226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a54101010 con 0x7f5a54104f10 2024-09-19T09:18:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 0x7f5a54100590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800c970 tx=0x7f5a4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a3bfff640 1 -- 172.21.15.46:0/2667828226 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48014070 con 0x7f5a54104f10 2024-09-19T09:18:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a3bfff640 1 -- 172.21.15.46:0/2667828226 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a48004440 con 0x7f5a54104f10 2024-09-19T09:18:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a54101300 con 0x7f5a54104f10 2024-09-19T09:18:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a3bfff640 1 -- 172.21.15.46:0/2667828226 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800f450 con 0x7f5a54104f10 2024-09-19T09:18:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.641+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a541a68c0 con 0x7f5a54104f10 2024-09-19T09:18:48.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a3bfff640 1 -- 172.21.15.46:0/2667828226 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5a48017070 con 0x7f5a54104f10 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 Processor -- start 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 -- start start 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfa0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfa5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 0x55a9bdfa8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a9bdf042f0 con 0x55a9bdfa6370 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a9bdeac270 con 0x55a9bdfa09a0 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a5c011740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9bdf002b0 con 0x55a9bdfa12e0 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 0x55a9bdfa8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 0x55a9bdfa8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58586/0 (socket says 172.21.15.46:58586) 2024-09-19T09:18:48.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.644+0000 7f5a527fc640 1 -- 172.21.15.46:0/2167680379 learned_addr learned my addr 172.21.15.46:0/2167680379 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a3bfff640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5a3c0a3370 0x7f5a3c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfa0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfa5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5a3c0a3370 0x7f5a3c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a3bfff640 1 -- 172.21.15.46:0/2667828226 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a480cf6d0 con 0x7f5a54104f10 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a527fc640 1 -- 172.21.15.46:0/2167680379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa12e0 msgr2=0x55a9bdfa5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfa5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a527fc640 1 -- 172.21.15.46:0/2167680379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 msgr2=0x55a9bdfa0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfa0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a527fc640 1 -- 172.21.15.46:0/2167680379 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bdeab340 con 0x55a9bdfa6370 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfa0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 0x55a9bdfa8830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5a4809bcb0 tx=0x7f5a48007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144a6b88f28a8711 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5a3c0a3370 0x7f5a3c0a5830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0058c0 tx=0x7f5a4c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a397fa640 1 -- 172.21.15.46:0/2167680379 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a480a3450 con 0x55a9bdfa6370 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a397fa640 1 -- 172.21.15.46:0/2167680379 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a4809c420 con 0x55a9bdfa6370 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.645+0000 7f5a397fa640 1 -- 172.21.15.46:0/2167680379 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48098390 con 0x55a9bdfa6370 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 -- 172.21.15.46:0/2167680379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 msgr2=0x55a9bdfa8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 0x55a9bdfa8830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5a4809bcb0 tx=0x7f5a48007f60 comp rx=0 tx=0).stop 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 -- 172.21.15.46:0/2167680379 shutdown_connections 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa6370 0x55a9bdfa8830 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfa5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2167680379 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfa0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 -- 172.21.15.46:0/2167680379 >> 172.21.15.46:0/2167680379 conn(0x55a9bdf9c010 msgr2=0x55a9bdf9c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 -- 172.21.15.46:0/2167680379 shutdown_connections 2024-09-19T09:18:48.654 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.646+0000 7f5a5c011740 1 -- 172.21.15.46:0/2167680379 wait complete. 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 -- start start 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 Processor -- start 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfaab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a9bdfa9280 con 0x55a9bdfa12e0 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a9bde8d290 con 0x55a9bdfa09a0 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a9bdfa9400 con 0x55a9bdfa6370 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a5c011740 10 client.0 _ll_register_callbacks cb 0x55a9bdebe140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58594/0 (socket says 172.21.15.46:58594) 2024-09-19T09:18:48.655 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 -- 172.21.15.46:0/4114128843 learned_addr learned my addr 172.21.15.46:0/4114128843 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfaab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a537fe640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 -- 172.21.15.46:0/4114128843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 msgr2=0x55a9bdfb20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 -- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 msgr2=0x55a9bdfaab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfaab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.647+0000 7f5a527fc640 1 -- 172.21.15.46:0/4114128843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bdc17210 con 0x55a9bdfa12e0 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a527fc640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfab0d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5a480cd570 tx=0x7f5a480a3520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259dae5c8fce661f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a36ff5640 1 -- 172.21.15.46:0/4114128843 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a480a4700 con 0x55a9bdfa12e0 2024-09-19T09:18:48.656 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a36ff5640 1 -- 172.21.15.46:0/4114128843 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a480cfb80 con 0x55a9bdfa12e0 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a4809c420 con 0x55a9bdfa12e0 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a36ff5640 1 -- 172.21.15.46:0/4114128843 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a4809bd20 con 0x55a9bdfa12e0 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a5c011740 10 client.15456 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9bdce3620 con 0x55a9bdfa12e0 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a36ff5640 1 -- 172.21.15.46:0/4114128843 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a4809c420 con 0x55a9bdfa12e0 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a36ff5640 1 -- 172.21.15.46:0/4114128843 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5a4809abe0 con 0x55a9bdfa12e0 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a5c011740 10 client.15456 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a5c011740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.648+0000 7f5a5c011740 20 client.15456 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.649+0000 7f5a5c011740 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9bdfb63a0 0x55a9bdfb8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.649+0000 7f5a5c011740 4 client.15456 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:48.657 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.649+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9bdf11a20 con 0x55a9bdfb63a0 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.649+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9bdfb63a0 0x55a9bdfb8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.649+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9bdfb63a0 0x55a9bdfb8790 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e27cce8955c7890e server_cookie=82494465a7300706 in_seq=0 out_seq=0 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.649+0000 7f5a36ff5640 10 client.15456 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a36ff5640 1 -- 172.21.15.46:0/4114128843 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9bdf11a20 con 0x55a9bdfb63a0 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a36ff5640 10 client.15456 handle_command_reply: tid=0 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 client.15456 shutdown 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 msgr2=0x55a9bdfab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfab0d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5a480cd570 tx=0x7f5a480a3520 comp rx=0 tx=0).stop 2024-09-19T09:18:48.658 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 shutdown_connections 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9bdfb63a0 0x55a9bdfb8790 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfab0d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a36ff5640 0 client.15456 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 --2- 172.21.15.46:0/4114128843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfaab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 >> 172.21.15.46:0/4114128843 conn(0x55a9bdf9c010 msgr2=0x55a9bdf9d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 shutdown_connections 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 1 -- 172.21.15.46:0/4114128843 wait complete. 2024-09-19T09:18:48.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.650+0000 7f5a5c011740 20 client.15456 trim_cache size 0 max 16384 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 Processor -- start 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 -- start start 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa09a0 0x55a9bdf9b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfb2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa6370 0x55a9bdf9d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541af520 con 0x55a9bdfa12e0 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b1060 con 0x55a9bdfa6370 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a5c011740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541afbf0 con 0x55a9bdfa09a0 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfb2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfb2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58598/0 (socket says 172.21.15.46:58598) 2024-09-19T09:18:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 -- 172.21.15.46:0/1455257367 learned_addr learned my addr 172.21.15.46:0/1455257367 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a537fe640 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa6370 0x55a9bdf9d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 -- 172.21.15.46:0/1455257367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa09a0 msgr2=0x55a9bdf9b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa09a0 0x55a9bdf9b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 -- 172.21.15.46:0/1455257367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa6370 msgr2=0x55a9bdf9d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa6370 0x55a9bdf9d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.665+0000 7f5a527fc640 1 -- 172.21.15.46:0/1455257367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9bdfb8b00 con 0x55a9bdfa12e0 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a537fe640 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa6370 0x55a9bdf9d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a527fc640 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfb2060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5a48098180 tx=0x7f5a48007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821959db94519cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a38ff9640 1 -- 172.21.15.46:0/1455257367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48097fc0 con 0x55a9bdfa12e0 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a38ff9640 1 -- 172.21.15.46:0/1455257367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a4807e020 con 0x55a9bdfa12e0 2024-09-19T09:18:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a38ff9640 1 -- 172.21.15.46:0/1455257367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4809b170 con 0x55a9bdfa12e0 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 -- 172.21.15.46:0/1455257367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 msgr2=0x55a9bdfb2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfb2060 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5a48098180 tx=0x7f5a48007f60 comp rx=0 tx=0).stop 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 -- 172.21.15.46:0/1455257367 shutdown_connections 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfb2060 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa6370 0x55a9bdf9d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 --2- 172.21.15.46:0/1455257367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa09a0 0x55a9bdf9b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 -- 172.21.15.46:0/1455257367 >> 172.21.15.46:0/1455257367 conn(0x55a9bdf9c010 msgr2=0x55a9bdf9a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.666+0000 7f5a5c011740 1 -- 172.21.15.46:0/1455257367 shutdown_connections 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 -- 172.21.15.46:0/1455257367 wait complete. 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 -- start start 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 Processor -- start 2024-09-19T09:18:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfafa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfaff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b0990 con 0x55a9bdfa12e0 2024-09-19T09:18:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b02c0 con 0x55a9bdfa09a0 2024-09-19T09:18:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541ad500 con 0x55a9bdfa6370 2024-09-19T09:18:48.674 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a5c011740 10 client.0 _ll_register_callbacks cb 0x7f5a44005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfaff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfaff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58608/0 (socket says 172.21.15.46:58608) 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 -- 172.21.15.46:0/2962439656 learned_addr learned my addr 172.21.15.46:0/2962439656 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfafa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 -- 172.21.15.46:0/2962439656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 msgr2=0x55a9bdfb0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 -- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 msgr2=0x55a9bdfafa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfafa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a527fc640 1 -- 172.21.15.46:0/2962439656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9bdfb1570 con 0x55a9bdfa12e0 2024-09-19T09:18:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.667+0000 7f5a537fe640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a527fc640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfaff50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5a4809afe0 tx=0x7f5a480a34c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960c9f6ad53c3b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a36ff5640 1 -- 172.21.15.46:0/2962439656 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4809c420 con 0x55a9bdfa12e0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a36ff5640 1 -- 172.21.15.46:0/2962439656 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5a4809abe0 con 0x55a9bdfa12e0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a4807e020 con 0x55a9bdfa12e0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a36ff5640 1 -- 172.21.15.46:0/2962439656 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a480ab050 con 0x55a9bdfa12e0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a9bdfb1570 con 0x55a9bdfa12e0 2024-09-19T09:18:48.676 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a36ff5640 1 -- 172.21.15.46:0/2962439656 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a4807e020 con 0x55a9bdfa12e0 2024-09-19T09:18:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a36ff5640 1 -- 172.21.15.46:0/2962439656 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5a480cfb30 con 0x55a9bdfa12e0 2024-09-19T09:18:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 20 client.15462 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9be0215d0 0x55a9be0239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:48.677 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 4 client.15462 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:18:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.668+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9bdf0bd70 con 0x55a9be0215d0 2024-09-19T09:18:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.669+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9be0215d0 0x55a9be0239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.669+0000 7f5a52ffd640 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9be0215d0 0x55a9be0239f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d992eff715483210 server_cookie=539270fd18277c74 in_seq=0 out_seq=0 2024-09-19T09:18:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.669+0000 7f5a36ff5640 10 client.15462 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.676+0000 7f5a36ff5640 1 -- 172.21.15.46:0/2962439656 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9bdf0bd70 con 0x55a9be0215d0 2024-09-19T09:18:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a36ff5640 10 client.15462 handle_command_reply: tid=0 2024-09-19T09:18:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 client.15462 shutdown 2024-09-19T09:18:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 msgr2=0x55a9bdfaff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfaff50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5a4809afe0 tx=0x7f5a480a34c0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 shutdown_connections 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a9be0215d0 0x55a9be0239f0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a9bdfa12e0 0x55a9bdfaff50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a36ff5640 0 client.15462 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a9bdfa6370 0x55a9bdfb0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 --2- 172.21.15.46:0/2962439656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a9bdfa09a0 0x55a9bdfafa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 >> 172.21.15.46:0/2962439656 conn(0x55a9bdf9c010 msgr2=0x55a9bdf9b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 shutdown_connections 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 1 -- 172.21.15.46:0/2962439656 wait complete. 2024-09-19T09:18:48.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.677+0000 7f5a5c011740 20 client.15462 trim_cache size 0 max 16384 2024-09-19T09:18:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:18:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:18:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:18:48.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:18:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5a3c0a3370 msgr2=0x7f5a3c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5a3c0a3370 0x7f5a3c0a5830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0058c0 tx=0x7f5a4c004730 comp rx=0 tx=0).stop 2024-09-19T09:18:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 msgr2=0x7f5a54100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 0x7f5a54100590 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800c970 tx=0x7f5a4800ce30 comp rx=0 tx=0).stop 2024-09-19T09:18:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 shutdown_connections 2024-09-19T09:18:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5a3c0a3370 0x7f5a3c0a5830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a54104f10 0x7f5a54100590 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a54107840 0x7f5a54100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 --2- 172.21.15.46:0/2667828226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5a541025e0 0x7f5a54101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 >> 172.21.15.46:0/2667828226 conn(0x7f5a540fc1e0 msgr2=0x7f5a54102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 shutdown_connections 2024-09-19T09:18:48.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:18:48.678+0000 7f5a59277640 1 -- 172.21.15.46:0/2667828226 wait complete. 2024-09-19T09:18:49.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:48 smithi115 ceph-mon[35055]: pgmap v353: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-19T09:18:49.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:48 smithi046 ceph-mon[31203]: pgmap v353: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-19T09:18:49.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:48 smithi099 ceph-mon[35256]: pgmap v353: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.6 KiB/s wr, 16 op/s 2024-09-19T09:18:51.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:50 smithi115 ceph-mon[35055]: pgmap v354: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-19T09:18:51.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:50 smithi046 ceph-mon[31203]: pgmap v354: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-19T09:18:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:50 smithi099 ceph-mon[35256]: pgmap v354: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-19T09:18:53.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:52 smithi115 ceph-mon[35055]: pgmap v355: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:18:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:52 smithi046 ceph-mon[31203]: pgmap v355: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:18:53.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:52 smithi099 ceph-mon[35256]: pgmap v355: 97 pgs: 97 active+clean; 661 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:18:55.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:54 smithi115 ceph-mon[35055]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-19T09:18:55.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:54 smithi046 ceph-mon[31203]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-19T09:18:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:54 smithi099 ceph-mon[35256]: pgmap v356: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-19T09:18:56.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:18:57.115 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:56 smithi115 ceph-mon[35055]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:18:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:56 smithi046 ceph-mon[31203]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:18:57.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:56 smithi099 ceph-mon[35256]: pgmap v357: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T09:18:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.620+0000 7f19ae36c640 1 -- 172.21.15.46:0/3856228072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81082a0 msgr2=0x7f19a810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.620+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3856228072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81082a0 0x7f19a810ec40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009cd0 tx=0x7f19a002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 -- 172.21.15.46:0/3856228072 shutdown_connections 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3856228072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81082a0 0x7f19a810ec40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3856228072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a81036e0 0x7f19a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3856228072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a8102d30 0x7f19a8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 -- 172.21.15.46:0/3856228072 >> 172.21.15.46:0/3856228072 conn(0x7f19a80fc7d0 msgr2=0x7f19a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 -- 172.21.15.46:0/3856228072 shutdown_connections 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 -- 172.21.15.46:0/3856228072 wait complete. 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 Processor -- start 2024-09-19T09:18:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.621+0000 7f19ae36c640 1 -- start start 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ae36c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a8102d30 0x7f19a81a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ae36c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 0x7f19a81a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ae36c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a81082a0 0x7f19a819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ae36c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81120d0 con 0x7f19a81036e0 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ae36c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f19a8111f50 con 0x7f19a81082a0 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ae36c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19a8112250 con 0x7f19a8102d30 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 0x7f19a81a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 0x7f19a81a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58622/0 (socket says 172.21.15.46:58622) 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 -- 172.21.15.46:0/3150384198 learned_addr learned my addr 172.21.15.46:0/3150384198 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a7fff640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a8102d30 0x7f19a81a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ac909640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a81082a0 0x7f19a819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 -- 172.21.15.46:0/3150384198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a8102d30 msgr2=0x7f19a81a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a8102d30 0x7f19a81a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 -- 172.21.15.46:0/3150384198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a81082a0 msgr2=0x7f19a819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a81082a0 0x7f19a819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 -- 172.21.15.46:0/3150384198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a819ace0 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19ac909640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a81082a0 0x7f19a819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.622+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 0x7f19a81a0930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c970 tx=0x7f199c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.623+0000 7f19a57fa640 1 -- 172.21.15.46:0/3150384198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c007bb0 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.623+0000 7f19a57fa640 1 -- 172.21.15.46:0/3150384198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f199c007d50 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.623+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a819afd0 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.623+0000 7f19a57fa640 1 -- 172.21.15.46:0/3150384198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c00f450 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.623+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a81a72c0 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.625+0000 7f19a57fa640 1 -- 172.21.15.46:0/3150384198 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f199c004f60 con 0x7f19a81036e0 2024-09-19T09:18:57.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.626+0000 7f19a57fa640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.626+0000 7f19a7fff640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.626+0000 7f19a57fa640 1 -- 172.21.15.46:0/3150384198 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f199c0cf640 con 0x7f19a81036e0 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.626+0000 7f19b0745740 1 Processor -- start 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.626+0000 7f19a7fff640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f19900a3240 0x7f19900a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f199800bbe0 tx=0x7f199800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.626+0000 7f19b0745740 1 -- start start 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19b0745740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b04a0 0x558c648b0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19b0745740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19b0745740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 0x558c648bda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19b0745740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558c648162e0 con 0x558c648bb680 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19b0745740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558c647bdce0 con 0x558c648b0dc0 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19b0745740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558c648122a0 con 0x558c648b04a0 2024-09-19T09:18:57.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 0x558c648bda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 0x558c648bda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58630/0 (socket says 172.21.15.46:58630) 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 -- 172.21.15.46:0/183737114 learned_addr learned my addr 172.21.15.46:0/183737114 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19a7fff640 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b04a0 0x558c648b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19a77fe640 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 -- 172.21.15.46:0/183737114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b04a0 msgr2=0x558c648b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b04a0 0x558c648b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 -- 172.21.15.46:0/183737114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 msgr2=0x558c648bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 -- 172.21.15.46:0/183737114 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c647a2440 con 0x558c648bb680 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.627+0000 7f19ac909640 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 0x558c648bda70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f19a0035000 tx=0x7f19a00315f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c752f477112027b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.628+0000 7f198e7fc640 1 -- 172.21.15.46:0/183737114 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0031ac0 con 0x558c648bb680 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.628+0000 7f198e7fc640 1 -- 172.21.15.46:0/183737114 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a0036040 con 0x558c648bb680 2024-09-19T09:18:57.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.628+0000 7f198e7fc640 1 -- 172.21.15.46:0/183737114 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004610 con 0x558c648bb680 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.628+0000 7f19b0745740 1 -- 172.21.15.46:0/183737114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 msgr2=0x558c648bda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.628+0000 7f19b0745740 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 0x558c648bda70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f19a0035000 tx=0x7f19a00315f0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.628+0000 7f19b0745740 1 -- 172.21.15.46:0/183737114 shutdown_connections 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648bb680 0x558c648bda70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 --2- 172.21.15.46:0/183737114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b04a0 0x558c648b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 -- 172.21.15.46:0/183737114 >> 172.21.15.46:0/183737114 conn(0x558c648aca30 msgr2=0x558c648ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 -- 172.21.15.46:0/183737114 shutdown_connections 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 -- 172.21.15.46:0/183737114 wait complete. 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.629+0000 7f19b0745740 1 -- start start 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 Processor -- start 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b0dc0 0x558c648b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648bb680 0x558c648b8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558c648be250 con 0x558c648b04a0 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558c647d1050 con 0x558c648bb680 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558c648be3d0 con 0x558c648b0dc0 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648baf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58644/0 (socket says 172.21.15.46:58644) 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19a7fff640 1 -- 172.21.15.46:0/3580074999 learned_addr learned my addr 172.21.15.46:0/3580074999 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19b0745740 10 client.0 _ll_register_callbacks cb 0x558c64811160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19ac909640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648bb680 0x558c648b8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.630+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b0dc0 0x558c648b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a7fff640 1 -- 172.21.15.46:0/3580074999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b0dc0 msgr2=0x558c648b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a7fff640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b0dc0 0x558c648b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a7fff640 1 -- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648bb680 msgr2=0x558c648b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a7fff640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648bb680 0x558c648b8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a7fff640 1 -- 172.21.15.46:0/3580074999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c645873c0 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b0dc0 0x558c648b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19a7fff640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648baf60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f19980117c0 tx=0x7f1998004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71428a93ca5467b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19877fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19877fe640 1 -- 172.21.15.46:0/3580074999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199801fbb0 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19877fe640 1 -- 172.21.15.46:0/3580074999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f199801fd50 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19a0036040 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19877fe640 1 -- 172.21.15.46:0/3580074999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1998028440 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19b0745740 10 client.15474 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.631+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c648c9c20 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19877fe640 1 -- 172.21.15.46:0/3580074999 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a0036040 con 0x558c648b04a0 2024-09-19T09:18:57.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19877fe640 1 -- 172.21.15.46:0/3580074999 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1998026070 con 0x558c648b04a0 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19b0745740 10 client.15474 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19b0745740 10 client.15474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19b0745740 20 client.15474 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19b0745740 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c648cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19b0745740 4 client.15474 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c64823850 con 0x558c648cb0e0 2024-09-19T09:18:57.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.632+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c648cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.633+0000 7f19a77fe640 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c648cd570 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3545eb532da27a95 server_cookie=207bdd1dc5f4a7a5 in_seq=0 out_seq=0 2024-09-19T09:18:57.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.633+0000 7f19877fe640 10 client.15474 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:57.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.633+0000 7f19877fe640 1 -- 172.21.15.46:0/3580074999 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c64823850 con 0x558c648cb0e0 2024-09-19T09:18:57.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.633+0000 7f19877fe640 10 client.15474 handle_command_reply: tid=0 2024-09-19T09:18:57.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.633+0000 7f19b0745740 1 client.15474 shutdown 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 msgr2=0x558c648baf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648baf60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f19980117c0 tx=0x7f1998004730 comp rx=0 tx=0).stop 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 shutdown_connections 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c648cd570 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648bb680 0x558c648b8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648b0dc0 0x558c648b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19877fe640 0 client.15474 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 --2- 172.21.15.46:0/3580074999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648baf60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 >> 172.21.15.46:0/3580074999 conn(0x558c648aca30 msgr2=0x558c648b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 shutdown_connections 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 1 -- 172.21.15.46:0/3580074999 wait complete. 2024-09-19T09:18:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.634+0000 7f19b0745740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T09:18:57.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.651+0000 7f19b0745740 1 Processor -- start 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.651+0000 7f19b0745740 1 -- start start 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19b0745740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 0x558c648c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19b0745740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 0x558c648d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19b0745740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648d33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19b0745740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81af830 con 0x558c648b0dc0 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19b0745740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81b1370 con 0x558c648b04a0 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19b0745740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81aff00 con 0x558c648bb680 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 0x558c648d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 0x558c648c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 0x558c648d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58658/0 (socket says 172.21.15.46:58658) 2024-09-19T09:18:57.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 0x558c648c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:50332/0 (socket says 172.21.15.46:50332) 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 -- 172.21.15.46:0/1696769176 learned_addr learned my addr 172.21.15.46:0/1696769176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19ac909640 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648d33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 -- 172.21.15.46:0/1696769176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 msgr2=0x558c648d33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648d33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 -- 172.21.15.46:0/1696769176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 msgr2=0x558c648c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 0x558c648c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 -- 172.21.15.46:0/1696769176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c648b8d30 con 0x558c648b0dc0 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a7fff640 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 0x558c648c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:57.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.652+0000 7f19a77fe640 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 0x558c648d2e60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f199c09b930 tx=0x7f199c0ccfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6aaf4ce48b337c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f198dffb640 1 -- 172.21.15.46:0/1696769176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c01d040 con 0x558c648b0dc0 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f198dffb640 1 -- 172.21.15.46:0/1696769176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f199c09ffe0 con 0x558c648b0dc0 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f198dffb640 1 -- 172.21.15.46:0/1696769176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c099fc0 con 0x558c648b0dc0 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 -- 172.21.15.46:0/1696769176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 msgr2=0x558c648d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 0x558c648d2e60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f199c09b930 tx=0x7f199c0ccfe0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 -- 172.21.15.46:0/1696769176 shutdown_connections 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b0dc0 0x558c648d2e60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648d33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 --2- 172.21.15.46:0/1696769176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b04a0 0x558c648c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.653+0000 7f19b0745740 1 -- 172.21.15.46:0/1696769176 >> 172.21.15.46:0/1696769176 conn(0x558c648aca30 msgr2=0x558c648b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 -- 172.21.15.46:0/1696769176 shutdown_connections 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 -- 172.21.15.46:0/1696769176 wait complete. 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 -- start start 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 Processor -- start 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648bf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.654+0000 7f19b0745740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19b0745740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81b0ca0 con 0x558c648b04a0 2024-09-19T09:18:57.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19b0745740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81b05d0 con 0x558c648b0dc0 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19b0745740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81ad830 con 0x558c648bb680 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19b0745740 10 client.0 _ll_register_callbacks cb 0x7f1998010cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648bf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58660/0 (socket says 172.21.15.46:58660) 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 -- 172.21.15.46:0/786038768 learned_addr learned my addr 172.21.15.46:0/786038768 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a77fe640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19ac909640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 -- 172.21.15.46:0/786038768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 msgr2=0x558c648bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 -- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 msgr2=0x558c648bf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 -- 172.21.15.46:0/786038768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c64934ee0 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19ac909640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19a7fff640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648bf420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f19980338a0 tx=0x7f19980336d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcc5f1a85bf138c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19877fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19877fe640 1 -- 172.21.15.46:0/786038768 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199801fc10 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19877fe640 1 -- 172.21.15.46:0/786038768 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f199801fdb0 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.655+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f199c09ffe0 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19877fe640 1 -- 172.21.15.46:0/786038768 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1998005850 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558c649361d0 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19877fe640 1 -- 172.21.15.46:0/786038768 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f199c09ffe0 con 0x558c648b04a0 2024-09-19T09:18:57.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19877fe640 1 -- 172.21.15.46:0/786038768 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1998026040 con 0x558c648b04a0 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 20 client.15480 populate_metadata read hostname 'smithi046' 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c649389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 4 client.15480 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c648b8ae0 con 0x558c648cb0e0 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.656+0000 7f19a77fe640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c649389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19a77fe640 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c649389b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f8b339139cc04c server_cookie=dae7ef9e76acd059 in_seq=0 out_seq=0 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19877fe640 10 client.15480 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19877fe640 1 -- 172.21.15.46:0/786038768 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c648b8ae0 con 0x558c648cb0e0 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19877fe640 10 client.15480 handle_command_reply: tid=0 2024-09-19T09:18:57.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 client.15480 shutdown 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 msgr2=0x558c648bf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648bf420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f19980338a0 tx=0x7f19980336d0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 shutdown_connections 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c648cb0e0 0x558c649389b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c648bb680 0x558c648bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c648b0dc0 0x558c648bf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 --2- 172.21.15.46:0/786038768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c648b04a0 0x558c648bf420 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 >> 172.21.15.46:0/786038768 conn(0x558c648aca30 msgr2=0x558c648b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19877fe640 0 client.15480 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.657+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 shutdown_connections 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19b0745740 1 -- 172.21.15.46:0/786038768 wait complete. 2024-09-19T09:18:57.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19b0745740 20 client.15480 trim_cache size 0 max 16384 2024-09-19T09:18:57.666 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:18:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-19T09:18:57.666 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {} 2024-09-19T09:18:57.666 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:18:57.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f19900a3240 msgr2=0x7f19900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f19900a3240 0x7f19900a5700 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f199800bbe0 tx=0x7f199800b390 comp rx=0 tx=0).stop 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 msgr2=0x7f19a81a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 0x7f19a81a0930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f199c00c970 tx=0x7f199c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 shutdown_connections 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f19a81036e0 0x7f19a81a0930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19a81082a0 0x7f19a819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 --2- 172.21.15.46:0/3150384198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a8102d30 0x7f19a81a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.658+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 >> 172.21.15.46:0/3150384198 conn(0x7f19a80fc7d0 msgr2=0x7f19a80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.659+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 shutdown_connections 2024-09-19T09:18:57.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:18:57.659+0000 7f19ae36c640 1 -- 172.21.15.46:0/3150384198 wait complete. 2024-09-19T09:18:58.883 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:18:58.883 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:18:59.155 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:18:59.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:18:58 smithi115 ceph-mon[35055]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:18:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:18:58 smithi046 ceph-mon[31203]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:18:59.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:18:58 smithi099 ceph-mon[35256]: pgmap v358: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:19:00.333 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T09:19:00.333 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:01.092 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:00 smithi046 ceph-mon[31203]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:19:01.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/1873316641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b181027a0 msgr2=0x7f4b181067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/1873316641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b181027a0 0x7f4b181067f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009900 tx=0x7f4b0802a410 comp rx=0 tx=0).stop 2024-09-19T09:19:01.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/1873316641 shutdown_connections 2024-09-19T09:19:01.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/1873316641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b181027a0 0x7f4b181067f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/1873316641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18106f20 0x7f4b1810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/1873316641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b18101df0 0x7f4b181021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/1873316641 >> 172.21.15.46:0/1873316641 conn(0x7f4b180fd8f0 msgr2=0x7f4b180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/1873316641 shutdown_connections 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.090+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/1873316641 wait complete. 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 Processor -- start 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 -- start start 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18101df0 0x7f4b18108b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 0x7f4b18109060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 0x7f4b181095a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18111fd0 con 0x7f4b18106f20 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18111e50 con 0x7f4b181027a0 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1ffd9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18112150 con 0x7f4b18101df0 2024-09-19T09:19:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1e576640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 0x7f4b181095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1d574640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 0x7f4b18109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1e576640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 0x7f4b181095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40422/0 (socket says 172.21.15.46:40422) 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1e576640 1 -- 172.21.15.46:0/3259124018 learned_addr learned my addr 172.21.15.46:0/3259124018 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1d574640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 0x7f4b18109060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45602/0 (socket says 172.21.15.46:45602) 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.091+0000 7f4b1dd75640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18101df0 0x7f4b18108b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1d574640 1 -- 172.21.15.46:0/3259124018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18101df0 msgr2=0x7f4b18108b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1d574640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18101df0 0x7f4b18108b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1d574640 1 -- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 msgr2=0x7f4b181095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1d574640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 0x7f4b181095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1d574640 1 -- 172.21.15.46:0/3259124018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b181aad20 con 0x7f4b181027a0 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1dd75640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18101df0 0x7f4b18108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1e576640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 0x7f4b181095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:01.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.092+0000 7f4b1d574640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 0x7f4b18109060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009900 tx=0x7f4b08003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.093+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0803f070 con 0x7f4b181027a0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.093+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b08031c90 con 0x7f4b181027a0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.093+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08035030 con 0x7f4b181027a0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.093+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b181aafb0 con 0x7f4b181027a0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.093+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181ab410 con 0x7f4b181027a0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.094+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b181032d0 con 0x7f4b181027a0 2024-09-19T09:19:01.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.096+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4b08042070 con 0x7f4b181027a0 2024-09-19T09:19:01.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.097+0000 7f4b0effd640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b040a32c0 0x7f4b040a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.097+0000 7f4b1dd75640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b040a32c0 0x7f4b040a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.097+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4b080f07c0 con 0x7f4b181027a0 2024-09-19T09:19:01.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.097+0000 7f4b1dd75640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b040a32c0 0x7f4b040a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400bfd0 tx=0x7f4b1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.099+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b080bcec0 con 0x7f4b181027a0 2024-09-19T09:19:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:01.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:00 smithi115 ceph-mon[35055]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:19:01.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:00 smithi099 ceph-mon[35256]: pgmap v359: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:19:01.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.352+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b181ab7a0 con 0x7f4b181027a0 2024-09-19T09:19:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.353+0000 7f4b0effd640 1 -- 172.21.15.46:0/3259124018 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f4b080c11c0 con 0x7f4b181027a0 2024-09-19T09:19:01.355 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:19:01.356 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:19:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b040a32c0 msgr2=0x7f4b040a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b040a32c0 0x7f4b040a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400bfd0 tx=0x7f4b1400b390 comp rx=0 tx=0).stop 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 msgr2=0x7f4b18109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 0x7f4b18109060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009900 tx=0x7f4b08003b90 comp rx=0 tx=0).stop 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 shutdown_connections 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4b040a32c0 0x7f4b040a5780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4b18106f20 0x7f4b181095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4b181027a0 0x7f4b18109060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 --2- 172.21.15.46:0/3259124018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b18101df0 0x7f4b18108b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 >> 172.21.15.46:0/3259124018 conn(0x7f4b180fd8f0 msgr2=0x7f4b180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 shutdown_connections 2024-09-19T09:19:01.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:01.357+0000 7f4b1ffd9640 1 -- 172.21.15.46:0/3259124018 wait complete. 2024-09-19T09:19:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 -- 172.21.15.46:0/2454907329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540102d50 msgr2=0x7f85401031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 --2- 172.21.15.46:0/2454907329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540102d50 0x7f85401031d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8534009900 tx=0x7f853402a410 comp rx=0 tx=0).stop 2024-09-19T09:19:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 -- 172.21.15.46:0/2454907329 shutdown_connections 2024-09-19T09:19:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 --2- 172.21.15.46:0/2454907329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540102d50 0x7f85401031d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 --2- 172.21.15.46:0/2454907329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8540103710 0x7f8540109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 --2- 172.21.15.46:0/2454907329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 0x7f8540101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 -- 172.21.15.46:0/2454907329 >> 172.21.15.46:0/2454907329 conn(0x7f85400fd2e0 msgr2=0x7f85400ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 -- 172.21.15.46:0/2454907329 shutdown_connections 2024-09-19T09:19:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.774+0000 7f8546065640 1 -- 172.21.15.46:0/2454907329 wait complete. 2024-09-19T09:19:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 Processor -- start 2024-09-19T09:19:01.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 -- start start 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 0x7f8540075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8540102d50 0x7f85400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 0x7f8540074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f854010d830 con 0x7f8540103710 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f854010d6b0 con 0x7f8540102d50 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f8546065640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f854010d9b0 con 0x7f8540101b60 2024-09-19T09:19:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f853ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 0x7f8540074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f853ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 0x7f8540074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40434/0 (socket says 172.21.15.46:40434) 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.775+0000 7f853ffff640 1 -- 172.21.15.46:0/4195997523 learned_addr learned my addr 172.21.15.46:0/4195997523 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853effd640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8540102d50 0x7f85400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853f7fe640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 0x7f8540075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853ffff640 1 -- 172.21.15.46:0/4195997523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 msgr2=0x7f8540075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853ffff640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 0x7f8540075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853ffff640 1 -- 172.21.15.46:0/4195997523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8540102d50 msgr2=0x7f85400745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853ffff640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8540102d50 0x7f85400745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853ffff640 1 -- 172.21.15.46:0/4195997523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85400753b0 con 0x7f8540103710 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853f7fe640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 0x7f8540075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:01.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853ffff640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 0x7f8540074b20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f853800eb10 tx=0x7f853800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853cff9640 1 -- 172.21.15.46:0/4195997523 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538004b20 con 0x7f8540103710 2024-09-19T09:19:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853cff9640 1 -- 172.21.15.46:0/4195997523 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8538004cc0 con 0x7f8540103710 2024-09-19T09:19:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f853cff9640 1 -- 172.21.15.46:0/4195997523 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538010760 con 0x7f8540103710 2024-09-19T09:19:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.776+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85401a1f10 con 0x7f8540103710 2024-09-19T09:19:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.777+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401a2320 con 0x7f8540103710 2024-09-19T09:19:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.779+0000 7f8548e05740 1 Processor -- start 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f853cff9640 1 -- 172.21.15.46:0/4195997523 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8538005020 con 0x7f8540103710 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 -- start start 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a447dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447e2e0 0x55e6a4482da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 0x55e6a4485830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e6a43e12f0 con 0x55e6a4483370 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e6a4389270 con 0x55e6a447d9a0 2024-09-19T09:19:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f8548e05740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e6a43dd2b0 con 0x55e6a447e2e0 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f853effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 0x55e6a4485830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f853effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 0x55e6a4485830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40446/0 (socket says 172.21.15.46:40446) 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f853effd640 1 -- 172.21.15.46:0/445550971 learned_addr learned my addr 172.21.15.46:0/445550971 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f853effd640 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a447dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.780+0000 7f853f7fe640 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447e2e0 0x55e6a4482da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853effd640 1 -- 172.21.15.46:0/445550971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447e2e0 msgr2=0x55e6a4482da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853effd640 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447e2e0 0x55e6a4482da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853effd640 1 -- 172.21.15.46:0/445550971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 msgr2=0x55e6a447dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853effd640 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a447dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853effd640 1 -- 172.21.15.46:0/445550971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a4388340 con 0x55e6a4483370 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853cff9640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f85280a3370 0x7f85280a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853f7fe640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f85280a3370 0x7f85280a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853cff9640 1 -- 172.21.15.46:0/4195997523 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f85380cff20 con 0x7f8540103710 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f853effd640 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 0x55e6a4485830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8534005de0 tx=0x7f8534005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ce200ccfff089a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f8525ffb640 1 -- 172.21.15.46:0/445550971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534035030 con 0x55e6a4483370 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f8525ffb640 1 -- 172.21.15.46:0/445550971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8534045070 con 0x55e6a4483370 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.781+0000 7f8525ffb640 1 -- 172.21.15.46:0/445550971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853403d450 con 0x55e6a4483370 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 -- 172.21.15.46:0/445550971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 msgr2=0x55e6a4485830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 0x55e6a4485830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8534005de0 tx=0x7f8534005780 comp rx=0 tx=0).stop 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f853f7fe640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f85280a3370 0x7f85280a5830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55e6a447ed10 tx=0x7f853000b710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 -- 172.21.15.46:0/445550971 shutdown_connections 2024-09-19T09:19:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a4483370 0x55e6a4485830 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447e2e0 0x55e6a4482da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 --2- 172.21.15.46:0/445550971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a447dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 -- 172.21.15.46:0/445550971 >> 172.21.15.46:0/445550971 conn(0x55e6a4479010 msgr2=0x55e6a4479410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 -- 172.21.15.46:0/445550971 shutdown_connections 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.782+0000 7f8548e05740 1 -- 172.21.15.46:0/445550971 wait complete. 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 -- start start 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 Processor -- start 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a4487b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a44880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a448f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e6a44862e0 con 0x55e6a447e2e0 2024-09-19T09:19:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e6a436a290 con 0x55e6a447d9a0 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e6a4486460 con 0x55e6a4483370 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f8548e05740 10 client.0 _ll_register_callbacks cb 0x55e6a439b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f853effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a44880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f853effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a44880a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40460/0 (socket says 172.21.15.46:40460) 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f853effd640 1 -- 172.21.15.46:0/2569071222 learned_addr learned my addr 172.21.15.46:0/2569071222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.783+0000 7f853f7fe640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a4487b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853ffff640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a448f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853effd640 1 -- 172.21.15.46:0/2569071222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 msgr2=0x55e6a448f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853effd640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a448f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853effd640 1 -- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 msgr2=0x55e6a4487b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853effd640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a4487b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853effd640 1 -- 172.21.15.46:0/2569071222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a40f4210 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853ffff640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a448f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f853effd640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a44880a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f853402a930 tx=0x7f8534003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0da47c151f7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f851effd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f851effd640 1 -- 172.21.15.46:0/2569071222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853404d070 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f851effd640 1 -- 172.21.15.46:0/2569071222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f85340316b0 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8534045070 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f851effd640 1 -- 172.21.15.46:0/2569071222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8534059050 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f8548e05740 10 client.15498 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6a41c0620 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.784+0000 7f851effd640 1 -- 172.21.15.46:0/2569071222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8534045070 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f851effd640 1 -- 172.21.15.46:0/2569071222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f853403da10 con 0x55e6a447e2e0 2024-09-19T09:19:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f8548e05740 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f8548e05740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f8548e05740 20 client.15498 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f8548e05740 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44933e0 0x55e6a4495800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f8548e05740 4 client.15498 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6a43eea20 con 0x55e6a44933e0 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.785+0000 7f853f7fe640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44933e0 0x55e6a4495800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f851effd640 10 client.15498 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:01.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f853f7fe640 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44933e0 0x55e6a4495800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db1437e22c74802f server_cookie=26e48e85b3002e48 in_seq=0 out_seq=0 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f851effd640 1 -- 172.21.15.46:0/2569071222 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6a43eea20 con 0x55e6a44933e0 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f851effd640 10 client.15498 handle_command_reply: tid=0 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f8548e05740 1 client.15498 shutdown 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 msgr2=0x55e6a44880a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.786+0000 7f8548e05740 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a44880a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f853402a930 tx=0x7f8534003f20 comp rx=0 tx=0).stop 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 shutdown_connections 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44933e0 0x55e6a4495800 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a44880a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a448f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f851effd640 0 client.15498 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 --2- 172.21.15.46:0/2569071222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447d9a0 0x55e6a4487b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 >> 172.21.15.46:0/2569071222 conn(0x55e6a4479010 msgr2=0x55e6a447a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 shutdown_connections 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 1 -- 172.21.15.46:0/2569071222 wait complete. 2024-09-19T09:19:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.787+0000 7f8548e05740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 Processor -- start 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 -- start start 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 0x55e6a448fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447e2e0 0x55e6a448f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a4490090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f85401aaf70 con 0x55e6a447d9a0 2024-09-19T09:19:01.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f85401acab0 con 0x55e6a447e2e0 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f8548e05740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f85401ab640 con 0x55e6a4483370 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f853f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 0x55e6a448fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f853f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 0x55e6a448fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40474/0 (socket says 172.21.15.46:40474) 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.815+0000 7f853f7fe640 1 -- 172.21.15.46:0/1435672569 learned_addr learned my addr 172.21.15.46:0/1435672569 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853ffff640 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a4490090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853effd640 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447e2e0 0x55e6a448f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853f7fe640 1 -- 172.21.15.46:0/1435672569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 msgr2=0x55e6a4490090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853f7fe640 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a4490090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853f7fe640 1 -- 172.21.15.46:0/1435672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447e2e0 msgr2=0x55e6a448f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853f7fe640 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447e2e0 0x55e6a448f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853f7fe640 1 -- 172.21.15.46:0/1435672569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a44742d0 con 0x55e6a447d9a0 2024-09-19T09:19:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f853f7fe640 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 0x55e6a448fb50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8530005fd0 tx=0x7f8530014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cbf778fa9b3684 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f85257fa640 1 -- 172.21.15.46:0/1435672569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530020900 con 0x55e6a447d9a0 2024-09-19T09:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f85257fa640 1 -- 172.21.15.46:0/1435672569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853002f070 con 0x55e6a447d9a0 2024-09-19T09:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.816+0000 7f85257fa640 1 -- 172.21.15.46:0/1435672569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853001f450 con 0x55e6a447d9a0 2024-09-19T09:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 -- 172.21.15.46:0/1435672569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 msgr2=0x55e6a448fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 0x55e6a448fb50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8530005fd0 tx=0x7f8530014000 comp rx=0 tx=0).stop 2024-09-19T09:19:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 -- 172.21.15.46:0/1435672569 shutdown_connections 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a4483370 0x55e6a4490090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a447e2e0 0x55e6a448f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 --2- 172.21.15.46:0/1435672569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447d9a0 0x55e6a448fb50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 -- 172.21.15.46:0/1435672569 >> 172.21.15.46:0/1435672569 conn(0x55e6a4479010 msgr2=0x55e6a4487b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 -- 172.21.15.46:0/1435672569 shutdown_connections 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.817+0000 7f8548e05740 1 -- 172.21.15.46:0/1435672569 wait complete. 2024-09-19T09:19:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 -- start start 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 Processor -- start 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447d9a0 0x55e6a448bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a448c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a4483370 0x55e6a44fc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f85401ac3e0 con 0x55e6a447e2e0 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f85401abd10 con 0x55e6a4483370 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f85401a8f50 con 0x55e6a447d9a0 2024-09-19T09:19:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f8548e05740 10 client.0 _ll_register_callbacks cb 0x7f8534004310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f853effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a448c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f853effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a448c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40480/0 (socket says 172.21.15.46:40480) 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f853effd640 1 -- 172.21.15.46:0/1191006088 learned_addr learned my addr 172.21.15.46:0/1191006088 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f853f7fe640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447d9a0 0x55e6a448bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.818+0000 7f853ffff640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a4483370 0x55e6a44fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f853effd640 1 -- 172.21.15.46:0/1191006088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447d9a0 msgr2=0x55e6a448bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f853effd640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447d9a0 0x55e6a448bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f853effd640 1 -- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a4483370 msgr2=0x55e6a44fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f853effd640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a4483370 0x55e6a44fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f853effd640 1 -- 172.21.15.46:0/1191006088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a448c980 con 0x55e6a447e2e0 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f853effd640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a448c310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f85340095d0 tx=0x7f853403c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702b5b4b9c41c1a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f851effd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f851effd640 1 -- 172.21.15.46:0/1191006088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534061070 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f851effd640 1 -- 172.21.15.46:0/1191006088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f8534003a00 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f853002f070 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f851effd640 1 -- 172.21.15.46:0/1191006088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f853406d050 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f8548e05740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.819+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6a44fd6d0 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f851effd640 1 -- 172.21.15.46:0/1191006088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853002f070 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f851effd640 1 -- 172.21.15.46:0/1191006088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f853403d6f0 con 0x55e6a447e2e0 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f8548e05740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f8548e05740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f8548e05740 20 client.15504 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f8548e05740 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44fe0b0 0x55e6a45004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f8548e05740 4 client.15504 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e6a43e8d70 con 0x55e6a44fe0b0 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.820+0000 7f853f7fe640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44fe0b0 0x55e6a45004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.821+0000 7f851effd640 10 client.15504 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.821+0000 7f853f7fe640 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44fe0b0 0x55e6a45004a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fbde189774d4284 server_cookie=f8698cbdd18bb9de in_seq=0 out_seq=0 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f851effd640 1 -- 172.21.15.46:0/1191006088 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e6a43e8d70 con 0x55e6a44fe0b0 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f851effd640 10 client.15504 handle_command_reply: tid=0 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 client.15504 shutdown 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 msgr2=0x55e6a448c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a448c310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f85340095d0 tx=0x7f853403c670 comp rx=0 tx=0).stop 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 shutdown_connections 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e6a44fe0b0 0x55e6a45004a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e6a447e2e0 0x55e6a448c310 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e6a4483370 0x55e6a44fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f851effd640 0 client.15504 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 --2- 172.21.15.46:0/1191006088 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e6a447d9a0 0x55e6a448bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 >> 172.21.15.46:0/1191006088 conn(0x55e6a4479010 msgr2=0x55e6a4487b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 shutdown_connections 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.824+0000 7f8548e05740 1 -- 172.21.15.46:0/1191006088 wait complete. 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8548e05740 20 client.15504 trim_cache size 0 max 16384 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:19:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f85280a3370 msgr2=0x7f85280a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f85280a3370 0x7f85280a5830 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55e6a447ed10 tx=0x7f853000b710 comp rx=0 tx=0).stop 2024-09-19T09:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 msgr2=0x7f8540074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 0x7f8540074b20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f853800eb10 tx=0x7f853800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 shutdown_connections 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f85280a3370 0x7f85280a5830 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8540103710 0x7f8540074b20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8540102d50 0x7f85400745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 --2- 172.21.15.46:0/4195997523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8540101b60 0x7f8540075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 >> 172.21.15.46:0/4195997523 conn(0x7f85400fd2e0 msgr2=0x7f8540106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 shutdown_connections 2024-09-19T09:19:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:01.825+0000 7f8546065640 1 -- 172.21.15.46:0/4195997523 wait complete. 2024-09-19T09:19:02.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:01 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3259124018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:02.182 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:19:02.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:01 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3259124018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:02.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:01 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3259124018' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:02.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 -- 172.21.15.46:0/2560671331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed00745c0 msgr2=0x7f9ed00749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 --2- 172.21.15.46:0/2560671331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed00745c0 0x7f9ed00749a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009900 tx=0x7f9ec002a480 comp rx=0 tx=0).stop 2024-09-19T09:19:02.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 -- 172.21.15.46:0/2560671331 shutdown_connections 2024-09-19T09:19:02.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 --2- 172.21.15.46:0/2560671331 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ed010e420 0x7f9ed0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 --2- 172.21.15.46:0/2560671331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed0074ee0 0x7f9ed010dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 --2- 172.21.15.46:0/2560671331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed00745c0 0x7f9ed00749a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 -- 172.21.15.46:0/2560671331 >> 172.21.15.46:0/2560671331 conn(0x7f9ed00fd880 msgr2=0x7f9ed00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:02.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 -- 172.21.15.46:0/2560671331 shutdown_connections 2024-09-19T09:19:02.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.367+0000 7f9ed590e640 1 -- 172.21.15.46:0/2560671331 wait complete. 2024-09-19T09:19:02.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 Processor -- start 2024-09-19T09:19:02.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 -- start start 2024-09-19T09:19:02.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ed00745c0 0x7f9ed019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 0x7f9ed019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed010e420 0x7f9ed019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0114170 con 0x7f9ed0074ee0 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0113ff0 con 0x7f9ed010e420 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ed590e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed01142f0 con 0x7f9ed00745c0 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ece7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 0x7f9ed019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ece7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 0x7f9ed019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40498/0 (socket says 172.21.15.46:40498) 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.368+0000 7f9ece7fc640 1 -- 172.21.15.46:0/3927798297 learned_addr learned my addr 172.21.15.46:0/3927798297 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:02.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9eceffd640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ed00745c0 0x7f9ed019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ecf7fe640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed010e420 0x7f9ed019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ece7fc640 1 -- 172.21.15.46:0/3927798297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ed00745c0 msgr2=0x7f9ed019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ece7fc640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ed00745c0 0x7f9ed019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ece7fc640 1 -- 172.21.15.46:0/3927798297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed010e420 msgr2=0x7f9ed019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ece7fc640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed010e420 0x7f9ed019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ece7fc640 1 -- 172.21.15.46:0/3927798297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed019f640 con 0x7f9ed0074ee0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ece7fc640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 0x7f9ed019abd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d950 tx=0x7f9ec400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4017030 con 0x7f9ed0074ee0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed019f930 con 0x7f9ed0074ee0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ec4004020 con 0x7f9ed0074ee0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.369+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40047a0 con 0x7f9ed0074ee0 2024-09-19T09:19:02.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.370+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed01a7210 con 0x7f9ed0074ee0 2024-09-19T09:19:02.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.371+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed00749a0 con 0x7f9ed0074ee0 2024-09-19T09:19:02.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.372+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9ec40041d0 con 0x7f9ed0074ee0 2024-09-19T09:19:02.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.373+0000 7f9ed490c640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9eb80a32c0 0x7f9eb80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.373+0000 7f9eceffd640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9eb80a32c0 0x7f9eb80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.373+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f9ec40cf830 con 0x7f9ed0074ee0 2024-09-19T09:19:02.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.374+0000 7f9eceffd640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9eb80a32c0 0x7f9eb80a5780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009230 tx=0x7f9ec00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:02.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.380+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ec409c600 con 0x7f9ed0074ee0 2024-09-19T09:19:02.462 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:02.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.638+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ed019b9f0 con 0x7f9ed0074ee0 2024-09-19T09:19:02.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.639+0000 7f9ed490c640 1 -- 172.21.15.46:0/3927798297 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f9ed019b9f0 con 0x7f9ed0074ee0 2024-09-19T09:19:02.641 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:19:02.641 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:19:02.641 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:19:02.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9eb80a32c0 msgr2=0x7f9eb80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9eb80a32c0 0x7f9eb80a5780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009230 tx=0x7f9ec00058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 msgr2=0x7f9ed019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 0x7f9ed019abd0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d950 tx=0x7f9ec400de10 comp rx=0 tx=0).stop 2024-09-19T09:19:02.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 shutdown_connections 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9eb80a32c0 0x7f9eb80a5780 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ed0074ee0 0x7f9ed019abd0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9ed010e420 0x7f9ed019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 --2- 172.21.15.46:0/3927798297 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9ed00745c0 0x7f9ed019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 >> 172.21.15.46:0/3927798297 conn(0x7f9ed00fd880 msgr2=0x7f9ed00fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 shutdown_connections 2024-09-19T09:19:02.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:02.642+0000 7f9ed590e640 1 -- 172.21.15.46:0/3927798297 wait complete. 2024-09-19T09:19:03.193 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:02 smithi046 ceph-mon[31203]: pgmap v360: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:19:03.194 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:02 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3927798297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:03.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:02 smithi115 ceph-mon[35055]: pgmap v360: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:19:03.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:02 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3927798297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:03.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:02 smithi099 ceph-mon[35256]: pgmap v360: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T09:19:03.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:02 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3927798297' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:03.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 -- 172.21.15.46:0/3697072946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8101de0 msgr2=0x7f81e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/3697072946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8101de0 0x7f81e81021c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009900 tx=0x7f81e402a410 comp rx=0 tx=0).stop 2024-09-19T09:19:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 -- 172.21.15.46:0/3697072946 shutdown_connections 2024-09-19T09:19:03.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/3697072946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81e8106f10 0x7f81e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/3697072946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e8102790 0x7f81e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/3697072946 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8101de0 0x7f81e81021c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 -- 172.21.15.46:0/3697072946 >> 172.21.15.46:0/3697072946 conn(0x7f81e80fd880 msgr2=0x7f81e80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 -- 172.21.15.46:0/3697072946 shutdown_connections 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.278+0000 7f81ef2a7640 1 -- 172.21.15.46:0/3697072946 wait complete. 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 Processor -- start 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 -- start start 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81e8101de0 0x7f81e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 0x7f81e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e8106f10 0x7f81e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8111f70 con 0x7f81e8102790 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f81e8111df0 con 0x7f81e8106f10 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ef2a7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81120f0 con 0x7f81e8101de0 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.279+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 0x7f81e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 0x7f81e8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40512/0 (socket says 172.21.15.46:40512) 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 -- 172.21.15.46:0/1199333183 learned_addr learned my addr 172.21.15.46:0/1199333183 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ed043640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81e8101de0 0x7f81e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ed844640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e8106f10 0x7f81e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 -- 172.21.15.46:0/1199333183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81e8101de0 msgr2=0x7f81e80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81e8101de0 0x7f81e80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 -- 172.21.15.46:0/1199333183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e8106f10 msgr2=0x7f81e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e8106f10 0x7f81e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 -- 172.21.15.46:0/1199333183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e81a68d0 con 0x7f81e8102790 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ec842640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 0x7f81e8074a30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f81d800d950 tx=0x7f81d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81de7fc640 1 -- 172.21.15.46:0/1199333183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8017070 con 0x7f81e8102790 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e81a6bc0 con 0x7f81e8102790 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81de7fc640 1 -- 172.21.15.46:0/1199333183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81d8009c30 con 0x7f81e8102790 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81de7fc640 1 -- 172.21.15.46:0/1199333183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d800f6b0 con 0x7f81e8102790 2024-09-19T09:19:03.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.280+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e81a7100 con 0x7f81e8102790 2024-09-19T09:19:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.282+0000 7f81de7fc640 1 -- 172.21.15.46:0/1199333183 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f81d80109d0 con 0x7f81e8102790 2024-09-19T09:19:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.283+0000 7f81de7fc640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f81d40a3240 0x7f81d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.283+0000 7f81f1680740 1 Processor -- start 2024-09-19T09:19:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.283+0000 7f81f1680740 1 -- start start 2024-09-19T09:19:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81de7fc640 1 -- 172.21.15.46:0/1199333183 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f81d80cf530 con 0x7f81e8102790 2024-09-19T09:19:03.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ed043640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f81d40a3240 0x7f81d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81f1680740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81f1680740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5efa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81f1680740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81f1680740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55ea8b5552f0 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81f1680740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ea8b4fccf0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81f1680740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ea8b5512b0 con 0x55ea8b5fa370 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40522/0 (socket says 172.21.15.46:40522) 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 -- 172.21.15.46:0/3655489108 learned_addr learned my addr 172.21.15.46:0/3655489108 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ed043640 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ed844640 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ed043640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f81d40a3240 0x7f81d40a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009230 tx=0x7f81e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 -- 172.21.15.46:0/3655489108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 msgr2=0x55ea8b5fc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 -- 172.21.15.46:0/3655489108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 msgr2=0x55ea8b5ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.284+0000 7f81ec842640 1 -- 172.21.15.46:0/3655489108 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8b4e13a0 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.285+0000 7f81ec842640 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5efa10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f81d809bb10 tx=0x7f81d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99a36bc1099d882 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.285+0000 7f81d37fe640 1 -- 172.21.15.46:0/3655489108 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8020040 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.285+0000 7f81d37fe640 1 -- 172.21.15.46:0/3655489108 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81d809ff30 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.285+0000 7f81d37fe640 1 -- 172.21.15.46:0/3655489108 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80860d0 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 -- 172.21.15.46:0/3655489108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 msgr2=0x55ea8b5efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5efa10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f81d809bb10 tx=0x7f81d8005880 comp rx=0 tx=0).stop 2024-09-19T09:19:03.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 -- 172.21.15.46:0/3655489108 shutdown_connections 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5efa10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 --2- 172.21.15.46:0/3655489108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 -- 172.21.15.46:0/3655489108 >> 172.21.15.46:0/3655489108 conn(0x55ea8b5b8310 msgr2=0x55ea8b5ebc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 -- 172.21.15.46:0/3655489108 shutdown_connections 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 -- 172.21.15.46:0/3655489108 wait complete. 2024-09-19T09:19:03.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 -- start start 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.286+0000 7f81f1680740 1 Processor -- start 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55ea8b5fcfb0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55ea8b510060 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ea8b5fd130 con 0x55ea8b5fa370 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81f1680740 10 client.0 _ll_register_callbacks cb 0x55ea8b2638c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40526/0 (socket says 172.21.15.46:40526) 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 -- 172.21.15.46:0/1973786739 learned_addr learned my addr 172.21.15.46:0/1973786739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:03.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ed043640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ed844640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 -- 172.21.15.46:0/1973786739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 msgr2=0x55ea8b5f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 -- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5ef5d0 msgr2=0x55ea8b5f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5f9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ec842640 1 -- 172.21.15.46:0/1973786739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8b2c63c0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.287+0000 7f81ed844640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81ec842640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f7080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f81d80a42c0 tx=0x7f81d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4ba7fc24d792d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81d0ff9640 1 -- 172.21.15.46:0/1973786739 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80b9060 con 0x55ea8b5f0b40 2024-09-19T09:19:03.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81d0ff9640 1 -- 172.21.15.46:0/1973786739 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f81d80860d0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81d809ff30 con 0x55ea8b5f0b40 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81d0ff9640 1 -- 172.21.15.46:0/1973786739 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81d8020070 con 0x55ea8b5f0b40 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 10 client.15522 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea8b608ad0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81d0ff9640 1 -- 172.21.15.46:0/1973786739 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81d809ff30 con 0x55ea8b5f0b40 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81d0ff9640 1 -- 172.21.15.46:0/1973786739 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f81d80978d0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 10 client.15522 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 10 client.15522 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 20 client.15522 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b609e20 0x55ea8b60c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 4 client.15522 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.288+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea8b562860 con 0x55ea8b609e20 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.289+0000 7f81ed043640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b609e20 0x55ea8b60c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.289+0000 7f81d0ff9640 10 client.15522 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.289+0000 7f81ed043640 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b609e20 0x55ea8b60c210 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d8a141f0235e8fb8 server_cookie=d836019b227277b8 in_seq=0 out_seq=0 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81d0ff9640 1 -- 172.21.15.46:0/1973786739 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea8b562860 con 0x55ea8b609e20 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81d0ff9640 10 client.15522 handle_command_reply: tid=0 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 client.15522 shutdown 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 msgr2=0x55ea8b5f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f7080 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f81d80a42c0 tx=0x7f81d8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 shutdown_connections 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f7080 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b609e20 0x55ea8b60c210 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 --2- 172.21.15.46:0/1973786739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81d0ff9640 0 client.15522 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 >> 172.21.15.46:0/1973786739 conn(0x55ea8b5b8310 msgr2=0x55ea8b5f1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 shutdown_connections 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 1 -- 172.21.15.46:0/1973786739 wait complete. 2024-09-19T09:19:03.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.290+0000 7f81f1680740 20 client.15522 trim_cache size 0 max 16384 2024-09-19T09:19:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 Processor -- start 2024-09-19T09:19:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 -- start start 2024-09-19T09:19:03.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81af630 con 0x55ea8b5f0b40 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81b1170 con 0x55ea8b5fa370 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.304+0000 7f81f1680740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81afd00 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ec842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40536/0 (socket says 172.21.15.46:40536) 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed844640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ec842640 1 -- 172.21.15.46:0/666419452 learned_addr learned my addr 172.21.15.46:0/666419452 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:03.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed043640 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed844640 1 -- 172.21.15.46:0/666419452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 msgr2=0x55ea8b5ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed844640 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5ebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed844640 1 -- 172.21.15.46:0/666419452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 msgr2=0x55ea8b5f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed844640 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ed844640 1 -- 172.21.15.46:0/666419452 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8b5fd100 con 0x55ea8b5fa370 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.305+0000 7f81ec842640 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.306+0000 7f81ed844640 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f2120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81e0005fd0 tx=0x7f81e0003d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ff9a9cbe02141c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.306+0000 7f81d2ffd640 1 -- 172.21.15.46:0/666419452 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0004d20 con 0x55ea8b5fa370 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.306+0000 7f81d2ffd640 1 -- 172.21.15.46:0/666419452 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e0012450 con 0x55ea8b5fa370 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.306+0000 7f81d2ffd640 1 -- 172.21.15.46:0/666419452 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e00106a0 con 0x55ea8b5fa370 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 -- 172.21.15.46:0/666419452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5fa370 msgr2=0x55ea8b5f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f2120 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f81e0005fd0 tx=0x7f81e0003d40 comp rx=0 tx=0).stop 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 -- 172.21.15.46:0/666419452 shutdown_connections 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5fa370 0x55ea8b5f2120 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 --2- 172.21.15.46:0/666419452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b5ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 -- 172.21.15.46:0/666419452 >> 172.21.15.46:0/666419452 conn(0x55ea8b5b8310 msgr2=0x55ea8b5f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 -- 172.21.15.46:0/666419452 shutdown_connections 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 -- 172.21.15.46:0/666419452 wait complete. 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 -- start start 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.307+0000 7f81f1680740 1 Processor -- start 2024-09-19T09:19:03.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b602cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5fdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81b0aa0 con 0x55ea8b5fa370 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81b03d0 con 0x55ea8b5f0b40 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81ad610 con 0x55ea8b5ef5d0 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81f1680740 10 client.0 _ll_register_callbacks cb 0x7f81e4040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fe780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40546/0 (socket says 172.21.15.46:40546) 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 -- 172.21.15.46:0/358679107 learned_addr learned my addr 172.21.15.46:0/358679107 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:03.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed043640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b602cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ec842640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 -- 172.21.15.46:0/358679107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 msgr2=0x55ea8b602cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b602cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 -- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 msgr2=0x55ea8b5fdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5fdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.308+0000 7f81ed844640 1 -- 172.21.15.46:0/358679107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8b6737b0 con 0x55ea8b5fa370 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81ed844640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fe780 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f81e0000f80 tx=0x7f81e0012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562e608ea4d233b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81d0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81d0ff9640 1 -- 172.21.15.46:0/358679107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0029060 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81d0ff9640 1 -- 172.21.15.46:0/358679107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f81e0004a40 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81e0012450 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81d0ff9640 1 -- 172.21.15.46:0/358679107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81e0004c40 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81f1680740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea8b674970 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81d0ff9640 1 -- 172.21.15.46:0/358679107 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e0012450 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81d0ff9640 1 -- 172.21.15.46:0/358679107 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f81e001a030 con 0x55ea8b5fa370 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.309+0000 7f81f1680740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81f1680740 10 client.15528 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81f1680740 20 client.15528 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81f1680740 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b674fe0 0x55ea8b677400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81f1680740 4 client.15528 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea8b55cd70 con 0x55ea8b674fe0 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81ed043640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b674fe0 0x55ea8b677400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81ed043640 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b674fe0 0x55ea8b677400 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f580c02ad9915b64 server_cookie=bf979731f43422d in_seq=0 out_seq=0 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.310+0000 7f81d0ff9640 10 client.15528 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81d0ff9640 1 -- 172.21.15.46:0/358679107 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea8b55cd70 con 0x55ea8b674fe0 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81d0ff9640 10 client.15528 handle_command_reply: tid=0 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 client.15528 shutdown 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 msgr2=0x55ea8b5fe780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fe780 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f81e0000f80 tx=0x7f81e0012830 comp rx=0 tx=0).stop 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 shutdown_connections 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55ea8b5fa370 0x55ea8b5fe780 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55ea8b674fe0 0x55ea8b677400 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea8b5f0b40 0x55ea8b5fdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 --2- 172.21.15.46:0/358679107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ea8b5ef5d0 0x55ea8b602cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 >> 172.21.15.46:0/358679107 conn(0x55ea8b5b8310 msgr2=0x55ea8b5f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81d0ff9640 0 client.15528 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 shutdown_connections 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 1 -- 172.21.15.46:0/358679107 wait complete. 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.311+0000 7f81f1680740 20 client.15528 trim_cache size 0 max 16384 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f81d40a3240 msgr2=0x7f81d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f81d40a3240 0x7f81d40a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009230 tx=0x7f81e40058d0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 msgr2=0x7f81e8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 0x7f81e8074a30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f81d800d950 tx=0x7f81d800de10 comp rx=0 tx=0).stop 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 shutdown_connections 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f81d40a3240 0x7f81d40a5700 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81e8102790 0x7f81e8074a30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81e8106f10 0x7f81e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 --2- 172.21.15.46:0/1199333183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81e8101de0 0x7f81e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 >> 172.21.15.46:0/1199333183 conn(0x7f81e80fd880 msgr2=0x7f81e80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 shutdown_connections 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:03.312+0000 7f81ef2a7640 1 -- 172.21.15.46:0/1199333183 wait complete. 2024-09-19T09:19:03.819 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T09:19:03.819 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T09:19:04.458 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:19:04.529 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:04.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:04 smithi046 ceph-mon[31203]: pgmap v361: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-19T09:19:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 -- 172.21.15.46:0/3788386174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc101360 msgr2=0x7f0cfc10df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3788386174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc101360 0x7f0cfc10df90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009900 tx=0x7f0cf002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 -- 172.21.15.46:0/3788386174 shutdown_connections 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3788386174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc101360 0x7f0cfc10df90 secure :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009900 tx=0x7f0cf002a3f0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3788386174 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3788386174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cfc1009b0 0x7f0cfc100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.082+0000 7f0d01c25640 1 -- 172.21.15.46:0/3788386174 >> 172.21.15.46:0/3788386174 conn(0x7f0cfc0fc7d0 msgr2=0x7f0cfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.083+0000 7f0d01c25640 1 -- 172.21.15.46:0/3788386174 shutdown_connections 2024-09-19T09:19:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.083+0000 7f0d01c25640 1 -- 172.21.15.46:0/3788386174 wait complete. 2024-09-19T09:19:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.083+0000 7f0d01c25640 1 Processor -- start 2024-09-19T09:19:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 -- start start 2024-09-19T09:19:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cfc1009b0 0x7f0cfc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cfc19a6f0 0x7f0cfc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc114200 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc114080 con 0x7f0cfc19a6f0 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0d01c25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc114380 con 0x7f0cfc1009b0 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40566/0 (socket says 172.21.15.46:40566) 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 -- 172.21.15.46:0/3098962256 learned_addr learned my addr 172.21.15.46:0/3098962256 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cfc19a6f0 0x7f0cfc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cfc1009b0 0x7f0cfc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 -- 172.21.15.46:0/3098962256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cfc1009b0 msgr2=0x7f0cfc1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cfc1009b0 0x7f0cfc1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 -- 172.21.15.46:0/3098962256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cfc19a6f0 msgr2=0x7f0cfc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.084+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cfc19a6f0 0x7f0cfc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0cfaffd640 1 -- 172.21.15.46:0/3098962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc19b2a0 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1a0b60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0005940 tx=0x7f0cf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0cf8ff9640 1 -- 172.21.15.46:0/3098962256 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf003f030 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cfc19b530 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0cf8ff9640 1 -- 172.21.15.46:0/3098962256 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cf0003ce0 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0cf8ff9640 1 -- 172.21.15.46:0/3098962256 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0035070 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.085+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cfc1a7660 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0cf8ff9640 1 -- 172.21.15.46:0/3098962256 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0cf0042030 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0d03ffe740 1 Processor -- start 2024-09-19T09:19:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0d03ffe740 1 -- start start 2024-09-19T09:19:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d25b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d26080 0x5586b8d30400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d32d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.089+0000 7f0cf8ff9640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ce40a3240 0x7f0ce40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d25b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ce40a3240 0x7f0ce40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cf8ff9640 1 -- 172.21.15.46:0/3098962256 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0cf00ef670 con 0x7f0cfc10e4d0 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d26080 0x5586b8d30400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d25b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:47216/0 (socket says 172.21.15.46:47216) 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d26080 0x5586b8d30400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45750/0 (socket says 172.21.15.46:45750) 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d32d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d32d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40568/0 (socket says 172.21.15.46:40568) 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5586b8c8b2a0 con 0x5586b8d30940 2024-09-19T09:19:05.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfbfff640 1 -- 172.21.15.46:0/4175762334 learned_addr learned my addr 172.21.15.46:0/4175762334 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5586b8c32b10 con 0x5586b8d26080 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5586b8c87260 con 0x5586b8d25760 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 -- 172.21.15.46:0/4175762334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 msgr2=0x5586b8d25b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d25b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 -- 172.21.15.46:0/4175762334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d26080 msgr2=0x5586b8d30400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d26080 0x5586b8d30400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfaffd640 1 -- 172.21.15.46:0/4175762334 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b89fcb90 con 0x5586b8d30940 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.090+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ce40a3240 0x7f0ce40a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4014be0 tx=0x7f0cf4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.091+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d32d30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00ed1f0 tx=0x7f0cf0031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c393b23d1cfd931 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.091+0000 7f0ce1ffb640 1 -- 172.21.15.46:0/4175762334 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00044e0 con 0x5586b8d30940 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.091+0000 7f0ce1ffb640 1 -- 172.21.15.46:0/4175762334 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cf00bc3c0 con 0x5586b8d30940 2024-09-19T09:19:05.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.091+0000 7f0ce1ffb640 1 -- 172.21.15.46:0/4175762334 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00c44a0 con 0x5586b8d30940 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 msgr2=0x5586b8d32d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d32d30 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00ed1f0 tx=0x7f0cf0031a60 comp rx=0 tx=0).stop 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 shutdown_connections 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d32d30 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d26080 0x5586b8d30400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/4175762334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d25b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.092+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 >> 172.21.15.46:0/4175762334 conn(0x5586b8d21cf0 msgr2=0x5586b8d220d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.093+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 shutdown_connections 2024-09-19T09:19:05.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.093+0000 7f0d03ffe740 1 -- 172.21.15.46:0/4175762334 wait complete. 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.093+0000 7f0d03ffe740 1 -- start start 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.094+0000 7f0d03ffe740 1 Processor -- start 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.094+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d2d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.094+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d2ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.094+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5586b8c8b2a0 con 0x5586b8d26080 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5586b8c136e0 con 0x5586b8d30940 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5586b8d332d0 con 0x5586b8d25760 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d2ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d2ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40572/0 (socket says 172.21.15.46:40572) 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfaffd640 1 -- 172.21.15.46:0/1127725239 learned_addr learned my addr 172.21.15.46:0/1127725239 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0d03ffe740 10 client.0 _ll_register_callbacks cb 0x5586b8c37a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d2d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 -- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 msgr2=0x5586b8d2e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 -- 172.21.15.46:0/1127725239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 msgr2=0x5586b8d2ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d2ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 -- 172.21.15.46:0/1127725239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b8d3c600 con 0x5586b8d25760 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d2ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d2d880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00d9e0 tx=0x7f0cec00dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c560beeb9164d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.095+0000 7f0cdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:05.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1127725239 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec01b640 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1127725239 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0cec01b7e0 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cf00bc3c0 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1127725239 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0cec022070 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0d03ffe740 10 client.25147 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586b8d3eff0 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.096+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1127725239 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cec011440 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1127725239 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0cec019020 con 0x5586b8d25760 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0d03ffe740 10 client.25147 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0d03ffe740 10 client.25147 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0d03ffe740 20 client.25147 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8d428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0d03ffe740 4 client.25147 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0cf00bc3c0 con 0x5586b8d404b0 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8d428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0cdaffd640 10 client.25147 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.097+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8d428f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a92b90aa3545f4 server_cookie=277fcba4d026b6dd in_seq=0 out_seq=0 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.098+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1127725239 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0cf00bc3c0 con 0x5586b8d404b0 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.098+0000 7f0cdaffd640 10 client.25147 handle_command_reply: tid=0 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.098+0000 7f0d03ffe740 1 client.25147 shutdown 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 msgr2=0x5586b8d2d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d2d880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cec00d9e0 tx=0x7f0cec00dea0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 shutdown_connections 2024-09-19T09:19:05.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8d428f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d2ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0cdaffd640 0 client.25147 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1127725239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d2d880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 >> 172.21.15.46:0/1127725239 conn(0x5586b8d21cf0 msgr2=0x5586b8d20e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 shutdown_connections 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1127725239 wait complete. 2024-09-19T09:19:05.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.099+0000 7f0d03ffe740 20 client.25147 trim_cache size 0 max 16384 2024-09-19T09:19:05.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 Processor -- start 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 -- start start 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d481c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc1afbf0 con 0x5586b8d26080 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc1b1730 con 0x5586b8d30940 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.123+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc1b02c0 con 0x5586b8d25760 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d48700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40574/0 (socket says 172.21.15.46:40574) 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfaffd640 1 -- 172.21.15.46:0/1258522589 learned_addr learned my addr 172.21.15.46:0/1258522589 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 -- 172.21.15.46:0/1258522589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 msgr2=0x5586b8d2ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 -- 172.21.15.46:0/1258522589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 msgr2=0x5586b8d48700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d48700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 -- 172.21.15.46:0/1258522589 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586b8d1d260 con 0x5586b8d25760 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:05.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.124+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d481c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0cec004380 tx=0x7f0cec026560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db69fe8329e44e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.125+0000 7f0ce17fa640 1 -- 172.21.15.46:0/1258522589 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec005480 con 0x5586b8d25760 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.125+0000 7f0ce17fa640 1 -- 172.21.15.46:0/1258522589 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cec005620 con 0x5586b8d25760 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.125+0000 7f0ce17fa640 1 -- 172.21.15.46:0/1258522589 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec004cf0 con 0x5586b8d25760 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.125+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1258522589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 msgr2=0x5586b8d481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.125+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d481c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0cec004380 tx=0x7f0cec026560 comp rx=0 tx=0).stop 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.125+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1258522589 shutdown_connections 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d26080 0x5586b8d48700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d30940 0x5586b8d2ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1258522589 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d25760 0x5586b8d481c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1258522589 >> 172.21.15.46:0/1258522589 conn(0x5586b8d21cf0 msgr2=0x5586b8d2c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1258522589 shutdown_connections 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1258522589 wait complete. 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 -- start start 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.126+0000 7f0d03ffe740 1 Processor -- start 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d25760 0x5586b8d388e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 0x5586b8d35440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d35980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc1b1060 con 0x5586b8d30940 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc1b0990 con 0x5586b8d25760 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc1adbf0 con 0x5586b8d26080 2024-09-19T09:19:05.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0d03ffe740 10 client.0 _ll_register_callbacks cb 0x7f0cec004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 0x5586b8d35440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 0x5586b8d35440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:47230/0 (socket says 172.21.15.46:47230) 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 -- 172.21.15.46:0/1081471786 learned_addr learned my addr 172.21.15.46:0/1081471786 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d25760 0x5586b8d388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d35980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 -- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d25760 msgr2=0x5586b8d388e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d25760 0x5586b8d388e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 -- 172.21.15.46:0/1081471786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 msgr2=0x5586b8d35980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d35980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.127+0000 7f0cfaffd640 1 -- 172.21.15.46:0/1081471786 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586b8d35ec0 con 0x5586b8d26080 2024-09-19T09:19:05.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d25760 0x5586b8d388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cfbfff640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d35980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cfaffd640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 0x5586b8d35440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00bbab0 tx=0x7f0cf0005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2e8116597ff5041 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cdaffd640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1081471786 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00bc3c0 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cec005620 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1081471786 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0cf00b9d60 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1081471786 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0cf00c9050 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0d03ffe740 10 client.25153 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586b8dabe90 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.128+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1081471786 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cf00c4930 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1081471786 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0cf00cc020 con 0x5586b8d26080 2024-09-19T09:19:05.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0d03ffe740 10 client.25153 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0d03ffe740 10 client.25153 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0d03ffe740 20 client.25153 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8dae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0d03ffe740 4 client.25153 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x7f0cec005620 con 0x5586b8d404b0 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8dae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0cdaffd640 10 client.25153 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:05.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.129+0000 7f0cfb7fe640 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8dae610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e362d8b9536d1c server_cookie=2f31744672cc6396 in_seq=0 out_seq=0 2024-09-19T09:19:05.136 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.143+0000 7f0cdaffd640 1 -- 172.21.15.46:0/1081471786 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x7f0cec005620 con 0x5586b8d404b0 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.143+0000 7f0cdaffd640 10 client.25153 handle_command_reply: tid=0 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.143+0000 7f0d03ffe740 1 client.25153 shutdown 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 msgr2=0x5586b8d35440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 0x5586b8d35440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00bbab0 tx=0x7f0cf0005bd0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 shutdown_connections 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5586b8d404b0 0x5586b8dae610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0cdaffd640 0 client.25153 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5586b8d30940 0x5586b8d35980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5586b8d26080 0x5586b8d35440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 --2- 172.21.15.46:0/1081471786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5586b8d25760 0x5586b8d388e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 >> 172.21.15.46:0/1081471786 conn(0x5586b8d21cf0 msgr2=0x5586b8d20650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 shutdown_connections 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 1 -- 172.21.15.46:0/1081471786 wait complete. 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.144+0000 7f0d03ffe740 20 client.25153 trim_cache size 0 max 16384 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 28, 2024-09-19T09:19:05.147 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 2, 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "77a5d8": { 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 2, 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:19:05.148 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 131.2, 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:19:05.149 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:05.150 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:05.150 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:05.150 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:05.150 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:05.150 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:19:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ce40a3240 msgr2=0x7f0ce40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ce40a3240 0x7f0ce40a5700 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4014be0 tx=0x7f0cf4005c50 comp rx=0 tx=0).stop 2024-09-19T09:19:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 msgr2=0x7f0cfc1a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1a0b60 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0005940 tx=0x7f0cf00042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 shutdown_connections 2024-09-19T09:19:05.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0ce40a3240 0x7f0ce40a5700 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0cfc10e4d0 0x7f0cfc1a0b60 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cfc19a6f0 0x7f0cfc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 --2- 172.21.15.46:0/3098962256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0cfc1009b0 0x7f0cfc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.145+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 >> 172.21.15.46:0/3098962256 conn(0x7f0cfc0fc7d0 msgr2=0x7f0cfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.146+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 shutdown_connections 2024-09-19T09:19:05.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:05.146+0000 7f0d01c25640 1 -- 172.21.15.46:0/3098962256 wait complete. 2024-09-19T09:19:05.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:04 smithi115 ceph-mon[35055]: pgmap v361: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-19T09:19:05.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:04 smithi099 ceph-mon[35256]: pgmap v361: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-19T09:19:06.147 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '77a5d8', quiesce took 5.8 seconds. Will release after: 5.3999999999999995 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 -- 172.21.15.46:0/3148028860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc100e20 msgr2=0x7fe9fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 --2- 172.21.15.46:0/3148028860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc100e20 0x7fe9fc101200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009900 tx=0x7fe9ec02a480 comp rx=0 tx=0).stop 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 -- 172.21.15.46:0/3148028860 shutdown_connections 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 --2- 172.21.15.46:0/3148028860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc102ef0 0x7fe9fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 --2- 172.21.15.46:0/3148028860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc102570 0x7fe9fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 --2- 172.21.15.46:0/3148028860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc100e20 0x7fe9fc101200 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 -- 172.21.15.46:0/3148028860 >> 172.21.15.46:0/3148028860 conn(0x7fe9fc0fc7d0 msgr2=0x7fe9fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 -- 172.21.15.46:0/3148028860 shutdown_connections 2024-09-19T09:19:06.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 -- 172.21.15.46:0/3148028860 wait complete. 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.425+0000 7fea01595640 1 Processor -- start 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 -- start start 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 0x7fe9fc0739b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc102570 0x7fe9fc06c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc102ef0 0x7fe9fc06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc110f50 con 0x7fe9fc102570 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc110dd0 con 0x7fe9fc100e20 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fea01595640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1110d0 con 0x7fe9fc102ef0 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 0x7fe9fc0739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fe9fa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc102570 0x7fe9fc06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 0x7fe9fc0739b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45810/0 (socket says 172.21.15.46:45810) 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fe9faffd640 1 -- 172.21.15.46:0/3668563612 learned_addr learned my addr 172.21.15.46:0/3668563612 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:06.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.426+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc102ef0 0x7fe9fc06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9faffd640 1 -- 172.21.15.46:0/3668563612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc102ef0 msgr2=0x7fe9fc06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9faffd640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc102ef0 0x7fe9fc06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9faffd640 1 -- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc102570 msgr2=0x7fe9fc06c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9faffd640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc102570 0x7fe9fc06c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9faffd640 1 -- 172.21.15.46:0/3668563612 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc06d3d0 con 0x7fe9fc100e20 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc102570 0x7fe9fc06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9faffd640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 0x7fe9fc0739b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006010 tx=0x7fe9ec003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9e3fff640 1 -- 172.21.15.46:0/3668563612 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec03f070 con 0x7fe9fc100e20 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fe9e3fff640 1 -- 172.21.15.46:0/3668563612 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9ec031c30 con 0x7fe9fc100e20 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.427+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc06d600 con 0x7fe9fc100e20 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.428+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc1b3e10 con 0x7fe9fc100e20 2024-09-19T09:19:06.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.428+0000 7fe9e3fff640 1 -- 172.21.15.46:0/3668563612 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec035030 con 0x7fe9fc100e20 2024-09-19T09:19:06.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.430+0000 7fe9e3fff640 1 -- 172.21.15.46:0/3668563612 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe9ec042070 con 0x7fe9fc100e20 2024-09-19T09:19:06.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.431+0000 7fe9e3fff640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9e40a3240 0x7fe9e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.431+0000 7fe9e3fff640 1 -- 172.21.15.46:0/3668563612 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe9ec0efb10 con 0x7fe9fc100e20 2024-09-19T09:19:06.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.431+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9e40a3240 0x7fe9e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.431+0000 7fea0396e740 1 Processor -- start 2024-09-19T09:19:06.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 -- start start 2024-09-19T09:19:06.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9e40a3240 0x7fe9e40a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc06aab0 tx=0x7fe9f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 0x561d3d803090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d803a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d810760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561d3d7692f0 con 0x561d3d804b40 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561d3d710cf0 con 0x561d3d8035d0 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fea0396e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561d3d7652b0 con 0x561d3d80e370 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 0x561d3d803090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 0x561d3d803090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40592/0 (socket says 172.21.15.46:40592) 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 -- 172.21.15.46:0/1592607625 learned_addr learned my addr 172.21.15.46:0/1592607625 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:06.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d803a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d810760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 -- 172.21.15.46:0/1592607625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 msgr2=0x561d3d810760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d810760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 -- 172.21.15.46:0/1592607625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 msgr2=0x561d3d803a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d803a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.432+0000 7fe9faffd640 1 -- 172.21.15.46:0/1592607625 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3d6f53a0 con 0x561d3d804b40 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.433+0000 7fe9faffd640 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 0x561d3d803090 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0b8670 tx=0x7fe9ec0bc110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa137e19232bf9df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.433+0000 7fe9e17fa640 1 -- 172.21.15.46:0/1592607625 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec049070 con 0x561d3d804b40 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.433+0000 7fe9e17fa640 1 -- 172.21.15.46:0/1592607625 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9ec0c0510 con 0x561d3d804b40 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.433+0000 7fe9e17fa640 1 -- 172.21.15.46:0/1592607625 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0dc210 con 0x561d3d804b40 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 -- 172.21.15.46:0/1592607625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 msgr2=0x561d3d803090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 0x561d3d803090 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0b8670 tx=0x7fe9ec0bc110 comp rx=0 tx=0).stop 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 -- 172.21.15.46:0/1592607625 shutdown_connections 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d810760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d803a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 --2- 172.21.15.46:0/1592607625 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d804b40 0x561d3d803090 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 -- 172.21.15.46:0/1592607625 >> 172.21.15.46:0/1592607625 conn(0x561d3d7cc310 msgr2=0x561d3d7ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 -- 172.21.15.46:0/1592607625 shutdown_connections 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.434+0000 7fea0396e740 1 -- 172.21.15.46:0/1592607625 wait complete. 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 -- start start 2024-09-19T09:19:06.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 Processor -- start 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d80dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d80b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d80b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x561d3d810e30 con 0x561d3d80e370 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x561d3d724060 con 0x561d3d8035d0 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561d3d810fb0 con 0x561d3d804b40 2024-09-19T09:19:06.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fea0396e740 10 client.0 _ll_register_callbacks cb 0x561d3d4778c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fe9fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d80b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d80dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fe9fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d80b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40606/0 (socket says 172.21.15.46:40606) 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/1804670192 learned_addr learned my addr 172.21.15.46:0/1804670192 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.435+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d80b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 msgr2=0x561d3d80b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d80b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/1804670192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 msgr2=0x561d3d80dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d80dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/1804670192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3d4da3c0 con 0x561d3d80e370 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d80b5d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4012980 tx=0x7fe9f4012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222d68701d9226bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9deff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:06.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9deff5640 1 -- 172.21.15.46:0/1804670192 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4003e40 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fe9deff5640 1 -- 172.21.15.46:0/1804670192 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe9f4004b20 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.436+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ec0c0510 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fe9deff5640 1 -- 172.21.15.46:0/1804670192 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9f4022070 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 10 client.15558 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d3d81c900 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fe9deff5640 1 -- 172.21.15.46:0/1804670192 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9f4010e50 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fe9deff5640 1 -- 172.21.15.46:0/1804670192 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9f4005020 con 0x561d3d80e370 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 10 client.15558 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:06.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 10 client.15558 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:19:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 20 client.15558 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d81de60 0x561d3d8202a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 4 client.15558 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.437+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe9ec0c0510 con 0x561d3d81de60 2024-09-19T09:19:06.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.438+0000 7fe9faffd640 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d81de60 0x561d3d8202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.438+0000 7fe9deff5640 10 client.15558 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.438+0000 7fe9faffd640 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d81de60 0x561d3d8202a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f26acbad391c7373 server_cookie=f0205621756fd2a1 in_seq=0 out_seq=0 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fe9deff5640 1 -- 172.21.15.46:0/1804670192 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe9ec0c0510 con 0x561d3d81de60 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fe9deff5640 10 client.15558 handle_command_reply: tid=0 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 client.15558 shutdown 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 msgr2=0x561d3d80b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d80b5d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4012980 tx=0x7fe9f4012e40 comp rx=0 tx=0).stop 2024-09-19T09:19:06.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 shutdown_connections 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d81de60 0x561d3d8202a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d80b5d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d80b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 --2- 172.21.15.46:0/1804670192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d80dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 >> 172.21.15.46:0/1804670192 conn(0x561d3d7cc310 msgr2=0x561d3d805990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fe9deff5640 0 client.15558 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 shutdown_connections 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.439+0000 7fea0396e740 1 -- 172.21.15.46:0/1804670192 wait complete. 2024-09-19T09:19:06.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.440+0000 7fea0396e740 20 client.15558 trim_cache size 0 max 16384 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 Processor -- start 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 -- start start 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d81a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d825bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d8260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e800e1f0 con 0x561d3d80e370 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e800fd30 con 0x561d3d8035d0 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fea0396e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e800e8c0 con 0x561d3d804b40 2024-09-19T09:19:06.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d8260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9fb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d8260f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40612/0 (socket says 172.21.15.46:40612) 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/3468436306 learned_addr learned my addr 172.21.15.46:0/3468436306 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d825bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9faffd640 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d81a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/3468436306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 msgr2=0x561d3d825bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.453+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d825bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/3468436306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 msgr2=0x561d3d81a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d81a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9fb7fe640 1 -- 172.21.15.46:0/3468436306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3d7ff4f0 con 0x561d3d80e370 2024-09-19T09:19:06.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9faffd640 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d81a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:06.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9fb7fe640 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d8260f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4005460 tx=0x7fe9f4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48b95a71df07da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9e0ff9640 1 -- 172.21.15.46:0/3468436306 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4005220 con 0x561d3d80e370 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9e0ff9640 1 -- 172.21.15.46:0/3468436306 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9f4010970 con 0x561d3d80e370 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.454+0000 7fe9e0ff9640 1 -- 172.21.15.46:0/3468436306 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4027b00 con 0x561d3d80e370 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 -- 172.21.15.46:0/3468436306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 msgr2=0x561d3d8260f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d8260f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4005460 tx=0x7fe9f4005bd0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 -- 172.21.15.46:0/3468436306 shutdown_connections 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d80e370 0x561d3d8260f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d804b40 0x561d3d825bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 --2- 172.21.15.46:0/3468436306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d8035d0 0x561d3d81a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 -- 172.21.15.46:0/3468436306 >> 172.21.15.46:0/3468436306 conn(0x561d3d7cc310 msgr2=0x561d3d80afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 -- 172.21.15.46:0/3468436306 shutdown_connections 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 -- 172.21.15.46:0/3468436306 wait complete. 2024-09-19T09:19:06.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.455+0000 7fea0396e740 1 -- start start 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 Processor -- start 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 0x561d3d811940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d804b40 0x561d3d811e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d880b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e800f660 con 0x561d3d8035d0 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e800ef90 con 0x561d3d804b40 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e800c280 con 0x561d3d80e370 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fea0396e740 10 client.0 _ll_register_callbacks cb 0x7fe9f4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 0x561d3d811940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 0x561d3d811940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40626/0 (socket says 172.21.15.46:40626) 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 -- 172.21.15.46:0/373664357 learned_addr learned my addr 172.21.15.46:0/373664357 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d804b40 0x561d3d811e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 -- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 msgr2=0x561d3d880b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d880b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 -- 172.21.15.46:0/373664357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d804b40 msgr2=0x561d3d811e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d804b40 0x561d3d811e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.456+0000 7fe9faffd640 1 -- 172.21.15.46:0/373664357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3d881180 con 0x561d3d8035d0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fe9faffd640 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 0x561d3d811940 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec005d00 tx=0x7fe9ec005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8ffb2c4529e27b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fe9deff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fe9deff5640 1 -- 172.21.15.46:0/373664357 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec049040 con 0x561d3d8035d0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fe9deff5640 1 -- 172.21.15.46:0/373664357 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe9ec0dc0b0 con 0x561d3d8035d0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9f4010970 con 0x561d3d8035d0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fe9deff5640 1 -- 172.21.15.46:0/373664357 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9ec0bbb70 con 0x561d3d8035d0 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fea0396e740 10 client.15564 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:06.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.457+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d3d8884d0 con 0x561d3d8035d0 2024-09-19T09:19:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fe9deff5640 1 -- 172.21.15.46:0/373664357 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9ec0a1080 con 0x561d3d8035d0 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fe9deff5640 1 -- 172.21.15.46:0/373664357 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe9ec0c4940 con 0x561d3d8035d0 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fea0396e740 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fea0396e740 10 client.15564 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fea0396e740 20 client.15564 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fea0396e740 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d888a10 0x561d3d88ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fea0396e740 4 client.15564 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d3d776860 con 0x561d3d888a10 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.458+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d888a10 0x561d3d88ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fe9deff5640 10 client.15564 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fe9fa7fc640 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d888a10 0x561d3d88ae00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ce31a60802537a4e server_cookie=67671333a2a099b2 in_seq=0 out_seq=0 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fe9deff5640 1 -- 172.21.15.46:0/373664357 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d3d776860 con 0x561d3d888a10 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fe9deff5640 10 client.15564 handle_command_reply: tid=0 2024-09-19T09:19:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 client.15564 shutdown 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 msgr2=0x561d3d811940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 0x561d3d811940 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec005d00 tx=0x7fe9ec005c90 comp rx=0 tx=0).stop 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 shutdown_connections 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x561d3d888a10 0x561d3d88ae00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fe9deff5640 0 client.15564 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561d3d80e370 0x561d3d880b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561d3d804b40 0x561d3d811e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 --2- 172.21.15.46:0/373664357 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x561d3d8035d0 0x561d3d811940 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.459+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 >> 172.21.15.46:0/373664357 conn(0x561d3d7cc310 msgr2=0x561d3d8098d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 shutdown_connections 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea0396e740 1 -- 172.21.15.46:0/373664357 wait complete. 2024-09-19T09:19:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea0396e740 20 client.15564 trim_cache size 0 max 16384 2024-09-19T09:19:06.465 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9e40a3240 msgr2=0x7fe9e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea01595640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9e40a3240 0x7fe9e40a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc06aab0 tx=0x7fe9f000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 msgr2=0x7fe9fc0739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.460+0000 7fea01595640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 0x7fe9fc0739b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec006010 tx=0x7fe9ec003c10 comp rx=0 tx=0).stop 2024-09-19T09:19:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 shutdown_connections 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe9e40a3240 0x7fe9e40a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9fc102570 0x7fe9fc06c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9fc102ef0 0x7fe9fc06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 --2- 172.21.15.46:0/3668563612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9fc100e20 0x7fe9fc0739b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 >> 172.21.15.46:0/3668563612 conn(0x7fe9fc0fc7d0 msgr2=0x7fe9fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 shutdown_connections 2024-09-19T09:19:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:06.461+0000 7fea01595640 1 -- 172.21.15.46:0/3668563612 wait complete. 2024-09-19T09:19:07.166 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:06 smithi046 ceph-mon[31203]: pgmap v362: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T09:19:07.194 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:19:07.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:06 smithi115 ceph-mon[35055]: pgmap v362: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T09:19:07.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:06 smithi099 ceph-mon[35256]: pgmap v362: 97 pgs: 97 active+clean; 662 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T09:19:07.468 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.010+0000 7fbe12082640 1 -- 172.21.15.46:0/695518905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 msgr2=0x7fbe0c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.010+0000 7fbe12082640 1 --2- 172.21.15.46:0/695518905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c10ea90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009ca0 tx=0x7fbe0402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 -- 172.21.15.46:0/695518905 shutdown_connections 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 --2- 172.21.15.46:0/695518905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c10ea90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 --2- 172.21.15.46:0/695518905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0c102790 0x7fbe0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 --2- 172.21.15.46:0/695518905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c101de0 0x7fbe0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 -- 172.21.15.46:0/695518905 >> 172.21.15.46:0/695518905 conn(0x7fbe0c0fd8e0 msgr2=0x7fbe0c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 -- 172.21.15.46:0/695518905 shutdown_connections 2024-09-19T09:19:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.011+0000 7fbe12082640 1 -- 172.21.15.46:0/695518905 wait complete. 2024-09-19T09:19:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.012+0000 7fbe12082640 1 Processor -- start 2024-09-19T09:19:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.012+0000 7fbe12082640 1 -- start start 2024-09-19T09:19:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.012+0000 7fbe12082640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c101de0 0x7fbe0c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.012+0000 7fbe12082640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0c102790 0x7fbe0c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.012+0000 7fbe12082640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c19ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe12082640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c111f70 con 0x7fbe0c106f10 2024-09-19T09:19:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe12082640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c111df0 con 0x7fbe0c102790 2024-09-19T09:19:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe12082640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1120f0 con 0x7fbe0c101de0 2024-09-19T09:19:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c19ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c19ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40644/0 (socket says 172.21.15.46:40644) 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 -- 172.21.15.46:0/3756396624 learned_addr learned my addr 172.21.15.46:0/3756396624 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c101de0 0x7fbe0c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0affd640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0c102790 0x7fbe0c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 -- 172.21.15.46:0/3756396624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c101de0 msgr2=0x7fbe0c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c101de0 0x7fbe0c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 -- 172.21.15.46:0/3756396624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0c102790 msgr2=0x7fbe0c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0c102790 0x7fbe0c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 -- 172.21.15.46:0/3756396624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c19f500 con 0x7fbe0c106f10 2024-09-19T09:19:08.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.013+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c19ee20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbe04031a20 tx=0x7fbe04031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.014+0000 7fbe08ff9640 1 -- 172.21.15.46:0/3756396624 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04003b70 con 0x7fbe0c106f10 2024-09-19T09:19:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.014+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c19f790 con 0x7fbe0c106f10 2024-09-19T09:19:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.014+0000 7fbe08ff9640 1 -- 172.21.15.46:0/3756396624 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe04003d10 con 0x7fbe0c106f10 2024-09-19T09:19:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.014+0000 7fbe08ff9640 1 -- 172.21.15.46:0/3756396624 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0402fc80 con 0x7fbe0c106f10 2024-09-19T09:19:08.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.014+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c1a70d0 con 0x7fbe0c106f10 2024-09-19T09:19:08.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.016+0000 7fbe08ff9640 1 -- 172.21.15.46:0/3756396624 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbe040046a0 con 0x7fbe0c106f10 2024-09-19T09:19:08.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.017+0000 7fbe1445b740 1 Processor -- start 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.017+0000 7fbe1445b740 1 -- start start 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.017+0000 7fbe08ff9640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdf40a3240 0x7fbdf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487bb40 0x55e7c487a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe08ff9640 1 -- 172.21.15.46:0/3756396624 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbe040f0a90 con 0x7fbe0c106f10 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 0x55e7c487aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 0x55e7c4887760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe1445b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e7c47e02f0 con 0x55e7c487a5d0 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe1445b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e7c4787cf0 con 0x55e7c4885370 2024-09-19T09:19:08.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe1445b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e7c47dc2b0 con 0x55e7c487bb40 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdf40a3240 0x7fbdf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 0x55e7c487aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 0x55e7c487aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40648/0 (socket says 172.21.15.46:40648) 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 -- 172.21.15.46:0/295754202 learned_addr learned my addr 172.21.15.46:0/295754202 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487bb40 0x55e7c487a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 -- 172.21.15.46:0/295754202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487bb40 msgr2=0x55e7c487a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487bb40 0x55e7c487a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 -- 172.21.15.46:0/295754202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 msgr2=0x55e7c4887760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 0x55e7c4887760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 -- 172.21.15.46:0/295754202 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c476c3a0 con 0x55e7c487a5d0 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdf40a3240 0x7fbdf40a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000bfd0 tx=0x7fbe0000bb00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.018+0000 7fbe0affd640 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 0x55e7c487aa10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbe00000b60 tx=0x7fbe0001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbab3343dabb6b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.019+0000 7fbdf1ffb640 1 -- 172.21.15.46:0/295754202 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00010dd0 con 0x55e7c487a5d0 2024-09-19T09:19:08.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.019+0000 7fbdf1ffb640 1 -- 172.21.15.46:0/295754202 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0000dc30 con 0x55e7c487a5d0 2024-09-19T09:19:08.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.019+0000 7fbdf1ffb640 1 -- 172.21.15.46:0/295754202 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00020a50 con 0x55e7c487a5d0 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 -- 172.21.15.46:0/295754202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 msgr2=0x55e7c487aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 0x55e7c487aa10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbe00000b60 tx=0x7fbe0001c000 comp rx=0 tx=0).stop 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 -- 172.21.15.46:0/295754202 shutdown_connections 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487a5d0 0x55e7c487aa10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 0x55e7c4887760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 --2- 172.21.15.46:0/295754202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487bb40 0x55e7c487a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 -- 172.21.15.46:0/295754202 >> 172.21.15.46:0/295754202 conn(0x55e7c4843310 msgr2=0x55e7c4876c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 -- 172.21.15.46:0/295754202 shutdown_connections 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 -- 172.21.15.46:0/295754202 wait complete. 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 -- start start 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.020+0000 7fbe1445b740 1 Processor -- start 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4884df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 0x55e7c48820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 0x55e7c48827e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e7c4888010 con 0x55e7c487bb40 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e7c479b060 con 0x55e7c4885370 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e7c4888190 con 0x55e7c487a5d0 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe1445b740 10 client.0 _ll_register_callbacks cb 0x55e7c44ee8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 0x55e7c48820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 0x55e7c48820a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40658/0 (socket says 172.21.15.46:40658) 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 -- 172.21.15.46:0/675852469 learned_addr learned my addr 172.21.15.46:0/675852469 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4884df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 -- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 msgr2=0x55e7c4884df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4884df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 -- 172.21.15.46:0/675852469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 msgr2=0x55e7c48827e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 0x55e7c48827e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.021+0000 7fbe0affd640 1 -- 172.21.15.46:0/675852469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c45513c0 con 0x55e7c487bb40 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbe0affd640 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 0x55e7c48820a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbe000205b0 tx=0x7fbe0000de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2432e041ff774182 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbdeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbdeaffd640 1 -- 172.21.15.46:0/675852469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0002e070 con 0x55e7c487bb40 2024-09-19T09:19:08.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbdeaffd640 1 -- 172.21.15.46:0/675852469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbe00005240 con 0x55e7c487bb40 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe0000dc30 con 0x55e7c487bb40 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbdeaffd640 1 -- 172.21.15.46:0/675852469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe00038050 con 0x55e7c487bb40 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbe1445b740 10 client.15576 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7c489c3a0 con 0x55e7c487bb40 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.022+0000 7fbdeaffd640 1 -- 172.21.15.46:0/675852469 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe0000dc30 con 0x55e7c487bb40 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbdeaffd640 1 -- 172.21.15.46:0/675852469 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe0001f070 con 0x55e7c487bb40 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe1445b740 10 client.15576 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe1445b740 10 client.15576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe1445b740 20 client.15576 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe1445b740 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c489d6f0 0x55e7c489fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe1445b740 4 client.15576 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7c47ed860 con 0x55e7c489d6f0 2024-09-19T09:19:08.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.023+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c489d6f0 0x55e7c489fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.024+0000 7fbdeaffd640 10 client.15576 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.024+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c489d6f0 0x55e7c489fae0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d9429a1be23035b server_cookie=2285528fb3c9f2b0 in_seq=0 out_seq=0 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.024+0000 7fbdeaffd640 1 -- 172.21.15.46:0/675852469 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7c47ed860 con 0x55e7c489d6f0 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.024+0000 7fbdeaffd640 10 client.15576 handle_command_reply: tid=0 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 client.15576 shutdown 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 msgr2=0x55e7c48820a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 0x55e7c48820a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbe000205b0 tx=0x7fbe0000de60 comp rx=0 tx=0).stop 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 shutdown_connections 2024-09-19T09:19:08.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c489d6f0 0x55e7c489fae0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbdeaffd640 0 client.15576 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c487bb40 0x55e7c48820a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c4885370 0x55e7c48827e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 --2- 172.21.15.46:0/675852469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4884df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 >> 172.21.15.46:0/675852469 conn(0x55e7c4843310 msgr2=0x55e7c487c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 shutdown_connections 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 1 -- 172.21.15.46:0/675852469 wait complete. 2024-09-19T09:19:08.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.025+0000 7fbe1445b740 20 client.15576 trim_cache size 0 max 16384 2024-09-19T09:19:08.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 Processor -- start 2024-09-19T09:19:08.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 -- start start 2024-09-19T09:19:08.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4899b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c4875bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c48a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1ab1d0 con 0x55e7c4885370 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1acd10 con 0x55e7c489d6f0 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe1445b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1ab8a0 con 0x55e7c487a5d0 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c4875bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c4875bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40664/0 (socket says 172.21.15.46:40664) 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.051+0000 7fbe0affd640 1 -- 172.21.15.46:0/448871398 learned_addr learned my addr 172.21.15.46:0/448871398 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4899b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c48a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0affd640 1 -- 172.21.15.46:0/448871398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 msgr2=0x55e7c4899b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0affd640 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4899b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0affd640 1 -- 172.21.15.46:0/448871398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 msgr2=0x55e7c48a5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0affd640 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c48a5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0affd640 1 -- 172.21.15.46:0/448871398 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7c4882b50 con 0x55e7c4885370 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c48a5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbe0affd640 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c4875bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbe00020560 tx=0x7fbe0000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383753a70fcd603c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbdf17fa640 1 -- 172.21.15.46:0/448871398 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0002e040 con 0x55e7c4885370 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbdf17fa640 1 -- 172.21.15.46:0/448871398 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe00012590 con 0x55e7c4885370 2024-09-19T09:19:08.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.052+0000 7fbdf17fa640 1 -- 172.21.15.46:0/448871398 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00033440 con 0x55e7c4885370 2024-09-19T09:19:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 -- 172.21.15.46:0/448871398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 msgr2=0x55e7c4875bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c4875bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbe00020560 tx=0x7fbe0000ded0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 -- 172.21.15.46:0/448871398 shutdown_connections 2024-09-19T09:19:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c4875bf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c48a5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 --2- 172.21.15.46:0/448871398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c4899b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 -- 172.21.15.46:0/448871398 >> 172.21.15.46:0/448871398 conn(0x55e7c4843310 msgr2=0x55e7c48754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 -- 172.21.15.46:0/448871398 shutdown_connections 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.053+0000 7fbe1445b740 1 -- 172.21.15.46:0/448871398 wait complete. 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 -- start start 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 Processor -- start 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c487f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c487f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c487fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1ac640 con 0x55e7c4885370 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1abf70 con 0x55e7c489d6f0 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1a91b0 con 0x55e7c487a5d0 2024-09-19T09:19:08.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.054+0000 7fbe1445b740 10 client.0 _ll_register_callbacks cb 0x7fbe0000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c487f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c487f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c487f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:47302/0 (socket says 172.21.15.46:47302) 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0b7fe640 1 -- 172.21.15.46:0/2095611530 learned_addr learned my addr 172.21.15.46:0/2095611530 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 -- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 msgr2=0x55e7c487f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c487fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c487f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 -- 172.21.15.46:0/2095611530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 msgr2=0x55e7c487fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c487fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 -- 172.21.15.46:0/2095611530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7c49072d0 con 0x55e7c4885370 2024-09-19T09:19:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c487f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0bfff640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c487fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbe0affd640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c487f5e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e7c4880900 tx=0x7fbe0000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab58835bd2f7c42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbdeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.055+0000 7fbdeaffd640 1 -- 172.21.15.46:0/2095611530 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0004a060 con 0x55e7c4885370 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7c47e7d70 con 0x55e7c4885370 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbdeaffd640 1 -- 172.21.15.46:0/2095611530 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbe000205e0 con 0x55e7c4885370 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbdeaffd640 1 -- 172.21.15.46:0/2095611530 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe00020860 con 0x55e7c4885370 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7c4908560 con 0x55e7c4885370 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbdeaffd640 1 -- 172.21.15.46:0/2095611530 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e7c47e7d70 con 0x55e7c4885370 2024-09-19T09:19:08.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbdeaffd640 1 -- 172.21.15.46:0/2095611530 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe0003d440 con 0x55e7c4885370 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 10 client.15582 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 20 client.15582 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c4908c60 0x55e7c490b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 4 client.15582 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.056+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7c4764170 con 0x55e7c4908c60 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c4908c60 0x55e7c490b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbdeaffd640 10 client.15582 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbe0b7fe640 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c4908c60 0x55e7c490b080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69515a2d92ab0ded server_cookie=25dd19a19607b752 in_seq=0 out_seq=0 2024-09-19T09:19:08.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbdeaffd640 1 -- 172.21.15.46:0/2095611530 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7c4764170 con 0x55e7c4908c60 2024-09-19T09:19:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbdeaffd640 10 client.15582 handle_command_reply: tid=0 2024-09-19T09:19:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbe1445b740 1 client.15582 shutdown 2024-09-19T09:19:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 msgr2=0x55e7c487f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.057+0000 7fbe1445b740 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c487f5e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e7c4880900 tx=0x7fbe0000dd20 comp rx=0 tx=0).stop 2024-09-19T09:19:08.066 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 shutdown_connections 2024-09-19T09:19:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55e7c4908c60 0x55e7c490b080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbdeaffd640 0 client.15582 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e7c4885370 0x55e7c487f5e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e7c489d6f0 0x55e7c487fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 --2- 172.21.15.46:0/2095611530 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e7c487a5d0 0x55e7c487f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 >> 172.21.15.46:0/2095611530 conn(0x55e7c4843310 msgr2=0x55e7c4884120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 shutdown_connections 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 1 -- 172.21.15.46:0/2095611530 wait complete. 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe1445b740 20 client.15582 trim_cache size 0 max 16384 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdf40a3240 msgr2=0x7fbdf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdf40a3240 0x7fbdf40a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000bfd0 tx=0x7fbe0000bb00 comp rx=0 tx=0).stop 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 msgr2=0x7fbe0c19ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c19ee20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbe04031a20 tx=0x7fbe04031a50 comp rx=0 tx=0).stop 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 shutdown_connections 2024-09-19T09:19:08.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbdf40a3240 0x7fbdf40a5700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe0c106f10 0x7fbe0c19ee20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe0c102790 0x7fbe0c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 --2- 172.21.15.46:0/3756396624 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe0c101de0 0x7fbe0c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.058+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 >> 172.21.15.46:0/3756396624 conn(0x7fbe0c0fd8e0 msgr2=0x7fbe0c0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.059+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 shutdown_connections 2024-09-19T09:19:08.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:08.059+0000 7fbe12082640 1 -- 172.21.15.46:0/3756396624 wait complete. 2024-09-19T09:19:08.736 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:19:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:08 smithi046 ceph-mon[31203]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:19:09.085 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:09.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:08 smithi115 ceph-mon[35055]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:19:09.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:08 smithi099 ceph-mon[35256]: pgmap v363: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 -- 172.21.15.46:0/1762880274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c1082a0 msgr2=0x7f307c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 --2- 172.21.15.46:0/1762880274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c1082a0 0x7f307c10ec40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3074009cd0 tx=0x7f307402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 -- 172.21.15.46:0/1762880274 shutdown_connections 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 --2- 172.21.15.46:0/1762880274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c1082a0 0x7f307c10ec40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 --2- 172.21.15.46:0/1762880274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307c1036e0 0x7f307c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 --2- 172.21.15.46:0/1762880274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f307c102d30 0x7f307c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 -- 172.21.15.46:0/1762880274 >> 172.21.15.46:0/1762880274 conn(0x7f307c0fc7d0 msgr2=0x7f307c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 -- 172.21.15.46:0/1762880274 shutdown_connections 2024-09-19T09:19:09.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.591+0000 7f30839c3640 1 -- 172.21.15.46:0/1762880274 wait complete. 2024-09-19T09:19:09.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 Processor -- start 2024-09-19T09:19:09.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 -- start start 2024-09-19T09:19:09.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 0x7f307c1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307c1036e0 0x7f307c1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f307c1082a0 0x7f307c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f307c1120a0 con 0x7f307c102d30 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f307c111f20 con 0x7f307c1036e0 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f30839c3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f307c112220 con 0x7f307c1082a0 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f308175f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 0x7f307c1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f308175f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 0x7f307c1a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50188/0 (socket says 172.21.15.46:50188) 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f308175f640 1 -- 172.21.15.46:0/247776490 learned_addr learned my addr 172.21.15.46:0/247776490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.592+0000 7f3081f60640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f307c1082a0 0x7f307c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f308175f640 1 -- 172.21.15.46:0/247776490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f307c1082a0 msgr2=0x7f307c19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f308175f640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f307c1082a0 0x7f307c19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f308175f640 1 -- 172.21.15.46:0/247776490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307c1036e0 msgr2=0x7f307c1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f308175f640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307c1036e0 0x7f307c1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f308175f640 1 -- 172.21.15.46:0/247776490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c19acd0 con 0x7f307c102d30 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f308175f640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 0x7f307c1a03e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f307800d770 tx=0x7f307800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.593+0000 7f30727fc640 1 -- 172.21.15.46:0/247776490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078017070 con 0x7f307c102d30 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.594+0000 7f30727fc640 1 -- 172.21.15.46:0/247776490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3078005500 con 0x7f307c102d30 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.594+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c19afc0 con 0x7f307c102d30 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.594+0000 7f30727fc640 1 -- 172.21.15.46:0/247776490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078004e00 con 0x7f307c102d30 2024-09-19T09:19:09.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.594+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c1a72b0 con 0x7f307c102d30 2024-09-19T09:19:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 Processor -- start 2024-09-19T09:19:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f30727fc640 1 -- 172.21.15.46:0/247776490 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3078010460 con 0x7f307c102d30 2024-09-19T09:19:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 -- start start 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d69a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d69aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55702d6002f0 con 0x55702d6a5370 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55702d5a7cf0 con 0x55702d69a5d0 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3085d9c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55702d5fc2b0 con 0x55702d69bb40 2024-09-19T09:19:09.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3081f60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d69a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3081f60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d69a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57140/0 (socket says 172.21.15.46:57140) 2024-09-19T09:19:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3081f60640 1 -- 172.21.15.46:0/1497138632 learned_addr learned my addr 172.21.15.46:0/1497138632 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f308175f640 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d69aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f30727fc640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30680a32c0 0x7f30680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3081f60640 1 -- 172.21.15.46:0/1497138632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 msgr2=0x55702d69aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3081f60640 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d69aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3081f60640 1 -- 172.21.15.46:0/1497138632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 msgr2=0x55702d6a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f30727fc640 1 -- 172.21.15.46:0/247776490 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f30780cf200 con 0x7f307c102d30 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.597+0000 7f3080f5e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3081f60640 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3081f60640 1 -- 172.21.15.46:0/1497138632 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55702d58c3a0 con 0x55702d69bb40 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3080f5e640 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.598+0000 7f3081f60640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30680a32c0 0x7f30680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.599+0000 7f3081f60640 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d69a090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3074004ab0 tx=0x7f30740315b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6039f346f83f10d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.599+0000 7f3081f60640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30680a32c0 0x7f30680a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3074045000 tx=0x7f3074047000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.599+0000 7f30677fe640 1 -- 172.21.15.46:0/1497138632 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074041040 con 0x55702d69bb40 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.599+0000 7f30677fe640 1 -- 172.21.15.46:0/1497138632 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f307404b020 con 0x55702d69bb40 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.599+0000 7f30677fe640 1 -- 172.21.15.46:0/1497138632 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074030cf0 con 0x55702d69bb40 2024-09-19T09:19:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 -- 172.21.15.46:0/1497138632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 msgr2=0x55702d69a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d69a090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3074004ab0 tx=0x7f30740315b0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 -- 172.21.15.46:0/1497138632 shutdown_connections 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d69aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1497138632 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d69a090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 -- 172.21.15.46:0/1497138632 >> 172.21.15.46:0/1497138632 conn(0x55702d663310 msgr2=0x55702d696c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 -- 172.21.15.46:0/1497138632 shutdown_connections 2024-09-19T09:19:09.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.600+0000 7f3085d9c740 1 -- 172.21.15.46:0/1497138632 wait complete. 2024-09-19T09:19:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.601+0000 7f3085d9c740 1 -- start start 2024-09-19T09:19:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.601+0000 7f3085d9c740 1 Processor -- start 2024-09-19T09:19:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69bb40 0x55702d6a2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55702d6a8010 con 0x55702d6a5370 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f308175f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55702d5bb060 con 0x55702d69bb40 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55702d6a8190 con 0x55702d69a5d0 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3080f5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69bb40 0x55702d6a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3080f5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69bb40 0x55702d6a2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45746/0 (socket says 172.21.15.46:45746) 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3080f5e640 1 -- 172.21.15.46:0/1866934994 learned_addr learned my addr 172.21.15.46:0/1866934994 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3081f60640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.602+0000 7f3085d9c740 10 client.0 _ll_register_callbacks cb 0x55702d30e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:09.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f308175f640 1 -- 172.21.15.46:0/1866934994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69bb40 msgr2=0x55702d6a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f308175f640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69bb40 0x55702d6a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f308175f640 1 -- 172.21.15.46:0/1866934994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 msgr2=0x55702d6a27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f308175f640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f308175f640 1 -- 172.21.15.46:0/1866934994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55702d3713c0 con 0x55702d69a5d0 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f3081f60640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f308175f640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a4da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3078097cb0 tx=0x7f307809b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ca0a78e9c30125c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f3064ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f3064ff9640 1 -- 172.21.15.46:0/1866934994 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078020050 con 0x55702d69a5d0 2024-09-19T09:19:09.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f3064ff9640 1 -- 172.21.15.46:0/1866934994 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3078009c30 con 0x55702d69a5d0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.603+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f307404b020 con 0x55702d69a5d0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.604+0000 7f3064ff9640 1 -- 172.21.15.46:0/1866934994 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3078009e30 con 0x55702d69a5d0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.604+0000 7f3085d9c740 10 client.25189 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.604+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55702d6b3aa0 con 0x55702d69a5d0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.604+0000 7f3064ff9640 1 -- 172.21.15.46:0/1866934994 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f307809bf50 con 0x55702d69a5d0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3064ff9640 1 -- 172.21.15.46:0/1866934994 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3078084ba0 con 0x55702d69a5d0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3085d9c740 10 client.25189 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3085d9c740 10 client.25189 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3085d9c740 20 client.25189 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d6b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3085d9c740 4 client.25189 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f307404b020 con 0x55702d6b4eb0 2024-09-19T09:19:09.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3080f5e640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d6b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3080f5e640 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d6b72d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=315c1586e3a303f4 server_cookie=67dd77f6da698389 in_seq=0 out_seq=0 2024-09-19T09:19:09.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.605+0000 7f3064ff9640 10 client.25189 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.606+0000 7f3064ff9640 1 -- 172.21.15.46:0/1866934994 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f307404b020 con 0x55702d6b4eb0 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.606+0000 7f3064ff9640 10 client.25189 handle_command_reply: tid=0 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.606+0000 7f3085d9c740 1 client.25189 shutdown 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.606+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 msgr2=0x55702d6a4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.606+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a4da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3078097cb0 tx=0x7f307809b390 comp rx=0 tx=0).stop 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 shutdown_connections 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d6b72d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3064ff9640 0 client.25189 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6a27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69bb40 0x55702d6a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 --2- 172.21.15.46:0/1866934994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a4da0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 >> 172.21.15.46:0/1866934994 conn(0x55702d663310 msgr2=0x55702d69c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 shutdown_connections 2024-09-19T09:19:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 1 -- 172.21.15.46:0/1866934994 wait complete. 2024-09-19T09:19:09.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.607+0000 7f3085d9c740 20 client.25189 trim_cache size 0 max 16384 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 Processor -- start 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 -- start start 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d6a2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d6bcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6bd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f306000e3e0 con 0x55702d6a5370 2024-09-19T09:19:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f306000ff20 con 0x55702d69a5d0 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.631+0000 7f3085d9c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f306000eab0 con 0x55702d69bb40 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f308175f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d6a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6bd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f308175f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d6a2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45756/0 (socket says 172.21.15.46:45756) 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f308175f640 1 -- 172.21.15.46:0/793098293 learned_addr learned my addr 172.21.15.46:0/793098293 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3080f5e640 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d6bcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 -- 172.21.15.46:0/793098293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 msgr2=0x55702d6bcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d6bcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 -- 172.21.15.46:0/793098293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 msgr2=0x55702d6a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d6a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 -- 172.21.15.46:0/793098293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55702d697dd0 con 0x55702d6a5370 2024-09-19T09:19:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3080f5e640 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d6bcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3081f60640 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6bd0c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3074006010 tx=0x7f307403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e47236c27b330c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.632+0000 7f3066ffd640 1 -- 172.21.15.46:0/793098293 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074041040 con 0x55702d6a5370 2024-09-19T09:19:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3066ffd640 1 -- 172.21.15.46:0/793098293 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f307405d070 con 0x55702d6a5370 2024-09-19T09:19:09.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3066ffd640 1 -- 172.21.15.46:0/793098293 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3074047870 con 0x55702d6a5370 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 -- 172.21.15.46:0/793098293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 msgr2=0x55702d6bd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6bd0c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3074006010 tx=0x7f307403d040 comp rx=0 tx=0).stop 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 -- 172.21.15.46:0/793098293 shutdown_connections 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d6a5370 0x55702d6bd0c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69bb40 0x55702d6bcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 --2- 172.21.15.46:0/793098293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d69a5d0 0x55702d6a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 -- 172.21.15.46:0/793098293 >> 172.21.15.46:0/793098293 conn(0x55702d663310 msgr2=0x55702d6a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 -- 172.21.15.46:0/793098293 shutdown_connections 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.633+0000 7f3085d9c740 1 -- 172.21.15.46:0/793098293 wait complete. 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 -- start start 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 Processor -- start 2024-09-19T09:19:09.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 0x55702d6a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d6a5370 0x55702d71eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f306000f850 con 0x55702d69bb40 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f306000f180 con 0x55702d6a5370 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f306000c3c0 con 0x55702d69a5d0 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3085d9c740 10 client.0 _ll_register_callbacks cb 0x7f30780056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3080f5e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 0x55702d6a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3080f5e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 0x55702d6a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50226/0 (socket says 172.21.15.46:50226) 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.634+0000 7f3080f5e640 1 -- 172.21.15.46:0/775915315 learned_addr learned my addr 172.21.15.46:0/775915315 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f308175f640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3081f60640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d6a5370 0x55702d71eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3080f5e640 1 -- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 msgr2=0x55702d6a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3080f5e640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3080f5e640 1 -- 172.21.15.46:0/775915315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d6a5370 msgr2=0x55702d71eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3080f5e640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d6a5370 0x55702d71eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3080f5e640 1 -- 172.21.15.46:0/775915315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55702d697960 con 0x55702d69bb40 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3081f60640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d6a5370 0x55702d71eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3080f5e640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 0x55702d6a9b40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x55702d6a18e0 tx=0x7f306c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4955fe00352838 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3064ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3064ff9640 1 -- 172.21.15.46:0/775915315 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c01f070 con 0x55702d69bb40 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3064ff9640 1 -- 172.21.15.46:0/775915315 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f306c01b300 con 0x55702d69bb40 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f307405d070 con 0x55702d69bb40 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3064ff9640 1 -- 172.21.15.46:0/775915315 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f306c02b050 con 0x55702d69bb40 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3085d9c740 10 client.15597 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.635+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55702d7200d0 con 0x55702d69bb40 2024-09-19T09:19:09.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3064ff9640 1 -- 172.21.15.46:0/775915315 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f307405d070 con 0x55702d69bb40 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3064ff9640 1 -- 172.21.15.46:0/775915315 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f306c00f040 con 0x55702d69bb40 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3085d9c740 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3085d9c740 10 client.15597 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3085d9c740 20 client.15597 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3085d9c740 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d722870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3085d9c740 4 client.15597 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55702d60d860 con 0x55702d6b4eb0 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.636+0000 7f308175f640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d722870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3064ff9640 10 client.15597 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f308175f640 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d722870 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7b3ccb9f3bc74143 server_cookie=88d022eb0e0ab0cf in_seq=0 out_seq=0 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3064ff9640 1 -- 172.21.15.46:0/775915315 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55702d60d860 con 0x55702d6b4eb0 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3064ff9640 10 client.15597 handle_command_reply: tid=0 2024-09-19T09:19:09.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 client.15597 shutdown 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 msgr2=0x55702d6a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 0x55702d6a9b40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x55702d6a18e0 tx=0x7f306c004410 comp rx=0 tx=0).stop 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 shutdown_connections 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55702d6b4eb0 0x55702d722870 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55702d69bb40 0x55702d6a9b40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55702d6a5370 0x55702d71eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 --2- 172.21.15.46:0/775915315 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55702d69a5d0 0x55702d6a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3064ff9640 0 client.15597 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 >> 172.21.15.46:0/775915315 conn(0x55702d663310 msgr2=0x55702d6a0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 shutdown_connections 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.637+0000 7f3085d9c740 1 -- 172.21.15.46:0/775915315 wait complete. 2024-09-19T09:19:09.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f3085d9c740 20 client.15597 trim_cache size 0 max 16384 2024-09-19T09:19:09.645 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30680a32c0 msgr2=0x7f30680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30680a32c0 0x7f30680a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3074045000 tx=0x7f3074047000 comp rx=0 tx=0).stop 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 msgr2=0x7f307c1a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 0x7f307c1a03e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f307800d770 tx=0x7f307800dc30 comp rx=0 tx=0).stop 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 shutdown_connections 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f30680a32c0 0x7f30680a5780 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f307c1082a0 0x7f307c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f307c1036e0 0x7f307c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 --2- 172.21.15.46:0/247776490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f307c102d30 0x7f307c1a03e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 >> 172.21.15.46:0/247776490 conn(0x7f307c0fc7d0 msgr2=0x7f307c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 shutdown_connections 2024-09-19T09:19:09.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:09.638+0000 7f30839c3640 1 -- 172.21.15.46:0/247776490 wait complete. 2024-09-19T09:19:10.424 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:19:10.689 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:11.075 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:10 smithi046 ceph-mon[31203]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 -- 172.21.15.46:0/3488194586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 msgr2=0x7feac810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 --2- 172.21.15.46:0/3488194586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac810ec30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7feac0009cd0 tx=0x7feac002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 -- 172.21.15.46:0/3488194586 shutdown_connections 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 --2- 172.21.15.46:0/3488194586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac810ec30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 --2- 172.21.15.46:0/3488194586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac8103740 0x7feac8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 --2- 172.21.15.46:0/3488194586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 -- 172.21.15.46:0/3488194586 >> 172.21.15.46:0/3488194586 conn(0x7feac80fc7d0 msgr2=0x7feac80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 -- 172.21.15.46:0/3488194586 shutdown_connections 2024-09-19T09:19:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.187+0000 7feacdb85640 1 -- 172.21.15.46:0/3488194586 wait complete. 2024-09-19T09:19:11.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.188+0000 7feacdb85640 1 Processor -- start 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.188+0000 7feacdb85640 1 -- start start 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feacdb85640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feacdb85640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac8103740 0x7feac8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feacdb85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feac77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feacdb85640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feac8112090 con 0x7feac8108290 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feacdb85640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feac8111f10 con 0x7feac8102d90 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feac77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45798/0 (socket says 172.21.15.46:45798) 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feac77fe640 1 -- 172.21.15.46:0/2074977464 learned_addr learned my addr 172.21.15.46:0/2074977464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feac6ffd640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac8103740 0x7feac8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7feac8112210 con 0x7feac8103740 2024-09-19T09:19:11.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.189+0000 7feac7fff640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac7fff640 1 -- 172.21.15.46:0/2074977464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac8103740 msgr2=0x7feac8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac7fff640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac8103740 0x7feac8198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac7fff640 1 -- 172.21.15.46:0/2074977464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 msgr2=0x7feac81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac7fff640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac7fff640 1 -- 172.21.15.46:0/2074977464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac819d490 con 0x7feac8108290 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac77fe640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac7fff640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac819cdb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feac002ae00 tx=0x7feac0031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac4ff9640 1 -- 172.21.15.46:0/2074977464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac003d790 con 0x7feac8108290 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac819d720 con 0x7feac8108290 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac8100920 con 0x7feac8108290 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac4ff9640 1 -- 172.21.15.46:0/2074977464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feac003de10 con 0x7feac8108290 2024-09-19T09:19:11.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.190+0000 7feac4ff9640 1 -- 172.21.15.46:0/2074977464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac00305a0 con 0x7feac8108290 2024-09-19T09:19:11.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.193+0000 7feac4ff9640 1 -- 172.21.15.46:0/2074977464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7feac0004040 con 0x7feac8108290 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac4ff9640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feab00a3340 0x7feab00a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 Processor -- start 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 -- start start 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac77fe640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feab00a3340 0x7feab00a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac4ff9640 1 -- 172.21.15.46:0/2074977464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feac002e030 con 0x7feac8108290 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a0612090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0612a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0625b80 0x55f4a0627f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f4a05782f0 con 0x55f4a0613b40 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f4a051fcf0 con 0x55f4a06125d0 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feacff5e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f4a05742b0 con 0x55f4a0625b80 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a0612090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a0612090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50264/0 (socket says 172.21.15.46:50264) 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac77fe640 1 -- 172.21.15.46:0/1894407563 learned_addr learned my addr 172.21.15.46:0/1894407563 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.194+0000 7feac6ffd640 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0612a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac7fff640 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0625b80 0x55f4a0627f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac6ffd640 1 -- 172.21.15.46:0/1894407563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0625b80 msgr2=0x55f4a0627f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac77fe640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feab00a3340 0x7feab00a5800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feab80139e0 tx=0x7feab8013de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac6ffd640 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0625b80 0x55f4a0627f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac6ffd640 1 -- 172.21.15.46:0/1894407563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 msgr2=0x55f4a0612090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac6ffd640 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a0612090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac6ffd640 1 -- 172.21.15.46:0/1894407563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4a05043a0 con 0x55f4a06125d0 2024-09-19T09:19:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac7fff640 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0625b80 0x55f4a0627f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feac6ffd640 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0612a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feac80697d0 tx=0x7feabc00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c016e2d1bcb21a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feaadffb640 1 -- 172.21.15.46:0/1894407563 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc005020 con 0x55f4a06125d0 2024-09-19T09:19:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feaadffb640 1 -- 172.21.15.46:0/1894407563 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feabc0056a0 con 0x55f4a06125d0 2024-09-19T09:19:11.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.195+0000 7feaadffb640 1 -- 172.21.15.46:0/1894407563 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0187c0 con 0x55f4a06125d0 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 -- 172.21.15.46:0/1894407563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 msgr2=0x55f4a0612a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0612a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feac80697d0 tx=0x7feabc00f3c0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 -- 172.21.15.46:0/1894407563 shutdown_connections 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0625b80 0x55f4a0627f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0612a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 --2- 172.21.15.46:0/1894407563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a0612090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 -- 172.21.15.46:0/1894407563 >> 172.21.15.46:0/1894407563 conn(0x55f4a05db310 msgr2=0x55f4a060ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.196+0000 7feacff5e740 1 -- 172.21.15.46:0/1894407563 shutdown_connections 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.197+0000 7feacff5e740 1 -- 172.21.15.46:0/1894407563 wait complete. 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.197+0000 7feacff5e740 1 -- start start 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.197+0000 7feacff5e740 1 Processor -- start 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.197+0000 7feacff5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a0625410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.197+0000 7feacff5e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0613b40 0x55f4a06226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.197+0000 7feacff5e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0622c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feacff5e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f4a0628880 con 0x55f4a0625b80 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0622c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0622c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50268/0 (socket says 172.21.15.46:50268) 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac7fff640 1 -- 172.21.15.46:0/3645706030 learned_addr learned my addr 172.21.15.46:0/3645706030 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac77fe640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a0625410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f4a0533060 con 0x55f4a0613b40 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f4a0628a00 con 0x55f4a06125d0 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac6ffd640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0613b40 0x55f4a06226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feacff5e740 10 client.0 _ll_register_callbacks cb 0x55f4a02868c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac6ffd640 1 -- 172.21.15.46:0/3645706030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 msgr2=0x55f4a0625410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac6ffd640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a0625410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac6ffd640 1 -- 172.21.15.46:0/3645706030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 msgr2=0x55f4a0622c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac6ffd640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0622c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.198+0000 7feac6ffd640 1 -- 172.21.15.46:0/3645706030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4a02e93c0 con 0x55f4a0613b40 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feac6ffd640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0613b40 0x55f4a06226c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feabc01a040 tx=0x7feabc00ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0222b92862fe56b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feaa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feaa6ffd640 1 -- 172.21.15.46:0/3645706030 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc027070 con 0x55f4a0613b40 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feabc0056a0 con 0x55f4a0613b40 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feaa6ffd640 1 -- 172.21.15.46:0/3645706030 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feabc005230 con 0x55f4a0613b40 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feaa6ffd640 1 -- 172.21.15.46:0/3645706030 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feabc033050 con 0x55f4a0613b40 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feacff5e740 10 client.25211 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.199+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f4a06341b0 con 0x55f4a0613b40 2024-09-19T09:19:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feaa6ffd640 1 -- 172.21.15.46:0/3645706030 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feabc0056a0 con 0x55f4a0613b40 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feaa6ffd640 1 -- 172.21.15.46:0/3645706030 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feabc023430 con 0x55f4a0613b40 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feacff5e740 10 client.25211 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feacff5e740 10 client.25211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feacff5e740 20 client.25211 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feacff5e740 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a0637950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feacff5e740 4 client.25211 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4a0585860 con 0x55f4a0635560 2024-09-19T09:19:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.200+0000 7feac77fe640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a0637950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.201+0000 7feaa6ffd640 10 client.25211 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.201+0000 7feac77fe640 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a0637950 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20cddb36d2aee633 server_cookie=4dd0ea3d664284b2 in_seq=0 out_seq=0 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feaa6ffd640 1 -- 172.21.15.46:0/3645706030 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4a0585860 con 0x55f4a0635560 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feaa6ffd640 10 client.25211 handle_command_reply: tid=0 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 client.25211 shutdown 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0613b40 msgr2=0x55f4a06226c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0613b40 0x55f4a06226c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7feabc01a040 tx=0x7feabc00ff90 comp rx=0 tx=0).stop 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 shutdown_connections 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a0637950 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0622c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0613b40 0x55f4a06226c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 --2- 172.21.15.46:0/3645706030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a0625410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feaa6ffd640 0 client.25211 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:11.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 >> 172.21.15.46:0/3645706030 conn(0x55f4a05db310 msgr2=0x55f4a0614930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 shutdown_connections 2024-09-19T09:19:11.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 1 -- 172.21.15.46:0/3645706030 wait complete. 2024-09-19T09:19:11.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.202+0000 7feacff5e740 20 client.25211 trim_cache size 0 max 16384 2024-09-19T09:19:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:10 smithi115 ceph-mon[35055]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:19:11.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.215+0000 7feacff5e740 1 Processor -- start 2024-09-19T09:19:11.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.215+0000 7feacff5e740 1 -- start start 2024-09-19T09:19:11.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feacff5e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0631bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feacff5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0613b40 0x55f4a061db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feacff5e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0626f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feacff5e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feab400e380 con 0x55f4a0625b80 2024-09-19T09:19:11.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feacff5e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feab400fec0 con 0x55f4a06125d0 2024-09-19T09:19:11.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feacff5e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7feab400ea50 con 0x55f4a0613b40 2024-09-19T09:19:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0626f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac6ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0613b40 0x55f4a061db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0631bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0631bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45822/0 (socket says 172.21.15.46:45822) 2024-09-19T09:19:11.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac77fe640 1 -- 172.21.15.46:0/342973565 learned_addr learned my addr 172.21.15.46:0/342973565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac6ffd640 1 -- 172.21.15.46:0/342973565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 msgr2=0x55f4a0631bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac6ffd640 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0631bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac6ffd640 1 -- 172.21.15.46:0/342973565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 msgr2=0x55f4a0626f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac6ffd640 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0626f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac6ffd640 1 -- 172.21.15.46:0/342973565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4a060f960 con 0x55f4a0613b40 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.216+0000 7feac7fff640 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0626f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.217+0000 7feac6ffd640 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0613b40 0x55f4a061db20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feabc00f400 tx=0x7feabc004f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b63d53bc0fa1790 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.217+0000 7feaad7fa640 1 -- 172.21.15.46:0/342973565 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc027070 con 0x55f4a0613b40 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.217+0000 7feaad7fa640 1 -- 172.21.15.46:0/342973565 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feabc00a6f0 con 0x55f4a0613b40 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.217+0000 7feaad7fa640 1 -- 172.21.15.46:0/342973565 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc02c440 con 0x55f4a0613b40 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 -- 172.21.15.46:0/342973565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0613b40 msgr2=0x55f4a061db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0613b40 0x55f4a061db20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feabc00f400 tx=0x7feabc004f30 comp rx=0 tx=0).stop 2024-09-19T09:19:11.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 -- 172.21.15.46:0/342973565 shutdown_connections 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0625b80 0x55f4a0626f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a0613b40 0x55f4a061db20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 --2- 172.21.15.46:0/342973565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a06125d0 0x55f4a0631bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 -- 172.21.15.46:0/342973565 >> 172.21.15.46:0/342973565 conn(0x55f4a05db310 msgr2=0x55f4a0620f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 -- 172.21.15.46:0/342973565 shutdown_connections 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 -- 172.21.15.46:0/342973565 wait complete. 2024-09-19T09:19:11.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 -- start start 2024-09-19T09:19:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.218+0000 7feacff5e740 1 Processor -- start 2024-09-19T09:19:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a062e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a063ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0625b80 0x55f4a063d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feab400f7f0 con 0x55f4a0613b40 2024-09-19T09:19:11.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a062e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a062e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57226/0 (socket says 172.21.15.46:57226) 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 -- 172.21.15.46:0/565507578 learned_addr learned my addr 172.21.15.46:0/565507578 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7feab400f120 con 0x55f4a0625b80 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7feab400c360 con 0x55f4a06125d0 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac6ffd640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a063ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac7fff640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0625b80 0x55f4a063d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 10 client.0 _ll_register_callbacks cb 0x7feabc004c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 -- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0625b80 msgr2=0x55f4a063d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0625b80 0x55f4a063d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 -- 172.21.15.46:0/565507578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 msgr2=0x55f4a063ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a063ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feac77fe640 1 -- 172.21.15.46:0/565507578 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4a062c0c0 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.219+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feabc00a6f0 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feac77fe640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a062e5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feab8009fd0 tx=0x7feab8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b216b23597c3a7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feaa6ffd640 10 client.25207 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feaa6ffd640 1 -- 172.21.15.46:0/565507578 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8004ba0 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feaa6ffd640 1 -- 172.21.15.46:0/565507578 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7feab8009050 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feaa6ffd640 1 -- 172.21.15.46:0/565507578 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feab8004d40 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feacff5e740 10 client.25207 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.220+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f4a06a0070 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feaa6ffd640 1 -- 172.21.15.46:0/565507578 <== mon.1 v2:172.21.15.115:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7feab801f070 con 0x55f4a06125d0 2024-09-19T09:19:11.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feacff5e740 10 client.25207 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feacff5e740 10 client.25207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feacff5e740 20 client.25207 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feacff5e740 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a06a2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feacff5e740 4 client.25207 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4a057fd70 con 0x55f4a0635560 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.221+0000 7feac6ffd640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a06a2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feaa6ffd640 10 client.25207 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:11.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feac6ffd640 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a06a2720 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a65fd58ba1fcd4ac server_cookie=d1aa1340a306f9b2 in_seq=0 out_seq=0 2024-09-19T09:19:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feaa6ffd640 1 -- 172.21.15.46:0/565507578 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4a057fd70 con 0x55f4a0635560 2024-09-19T09:19:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feaa6ffd640 10 client.25207 handle_command_reply: tid=0 2024-09-19T09:19:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 client.25207 shutdown 2024-09-19T09:19:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 msgr2=0x55f4a062e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a062e5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feab8009fd0 tx=0x7feab8004730 comp rx=0 tx=0).stop 2024-09-19T09:19:11.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 shutdown_connections 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f4a0635560 0x55f4a06a2720 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f4a0613b40 0x55f4a063ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f4a0625b80 0x55f4a063d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 --2- 172.21.15.46:0/565507578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f4a06125d0 0x55f4a062e5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 >> 172.21.15.46:0/565507578 conn(0x55f4a05db310 msgr2=0x55f4a060d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feaa6ffd640 0 client.25207 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 shutdown_connections 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 1 -- 172.21.15.46:0/565507578 wait complete. 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.222+0000 7feacff5e740 20 client.25207 trim_cache size 0 max 16384 2024-09-19T09:19:11.228 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feab00a3340 msgr2=0x7feab00a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feab00a3340 0x7feab00a5800 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feab80139e0 tx=0x7feab8013de0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 msgr2=0x7feac819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac819cdb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7feac002ae00 tx=0x7feac0031e60 comp rx=0 tx=0).stop 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 shutdown_connections 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7feab00a3340 0x7feab00a5800 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feac8108290 0x7feac819cdb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feac8103740 0x7feac8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 --2- 172.21.15.46:0/2074977464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feac8102d90 0x7feac81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 >> 172.21.15.46:0/2074977464 conn(0x7feac80fc7d0 msgr2=0x7feac8106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.223+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 shutdown_connections 2024-09-19T09:19:11.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:11.224+0000 7feacdb85640 1 -- 172.21.15.46:0/2074977464 wait complete. 2024-09-19T09:19:11.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:10 smithi099 ceph-mon[35256]: pgmap v364: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T09:19:11.548 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:12.093 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 -- 172.21.15.46:0/2627108080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 msgr2=0x7f04b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 --2- 172.21.15.46:0/2627108080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b410da40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009ca0 tx=0x7f04ac02a950 comp rx=0 tx=0).stop 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 -- 172.21.15.46:0/2627108080 shutdown_connections 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 --2- 172.21.15.46:0/2627108080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b410da40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 --2- 172.21.15.46:0/2627108080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b4102570 0x7f04b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 --2- 172.21.15.46:0/2627108080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 0x7f04b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.635+0000 7f04bc091640 1 -- 172.21.15.46:0/2627108080 >> 172.21.15.46:0/2627108080 conn(0x7f04b40fc7d0 msgr2=0x7f04b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.636+0000 7f04bc091640 1 -- 172.21.15.46:0/2627108080 shutdown_connections 2024-09-19T09:19:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.636+0000 7f04bc091640 1 -- 172.21.15.46:0/2627108080 wait complete. 2024-09-19T09:19:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 Processor -- start 2024-09-19T09:19:12.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 -- start start 2024-09-19T09:19:12.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 0x7f04b4197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b4102570 0x7f04b4197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4110f80 con 0x7f04b4102ef0 2024-09-19T09:19:12.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4110e00 con 0x7f04b4100e20 2024-09-19T09:19:12.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.637+0000 7f04bc091640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4111100 con 0x7f04b4102570 2024-09-19T09:19:12.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04ba62e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04ba62e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b419bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50296/0 (socket says 172.21.15.46:50296) 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04ba62e640 1 -- 172.21.15.46:0/1847017920 learned_addr learned my addr 172.21.15.46:0/1847017920 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b962c640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b4102570 0x7f04b4197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 0x7f04b4197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 -- 172.21.15.46:0/1847017920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b4102570 msgr2=0x7f04b4197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b4102570 0x7f04b4197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 -- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 msgr2=0x7f04b419bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b419bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 -- 172.21.15.46:0/1847017920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b419c2b0 con 0x7f04b4100e20 2024-09-19T09:19:12.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04ba62e640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:12.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.638+0000 7f04b9e2d640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 0x7f04b4197300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e9f0 tx=0x7f04b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.639+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b000ccc0 con 0x7f04b4100e20 2024-09-19T09:19:12.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.639+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b419c5a0 con 0x7f04b4100e20 2024-09-19T09:19:12.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.639+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b4069f70 con 0x7f04b4100e20 2024-09-19T09:19:12.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.639+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04b0010910 con 0x7f04b4100e20 2024-09-19T09:19:12.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.639+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0018960 con 0x7f04b4100e20 2024-09-19T09:19:12.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.640+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0498005290 con 0x7f04b4100e20 2024-09-19T09:19:12.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.643+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f04b0010ac0 con 0x7f04b4100e20 2024-09-19T09:19:12.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.644+0000 7f04aaffd640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04a00a32c0 0x7f04a00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.644+0000 7f04b962c640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04a00a32c0 0x7f04a00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.644+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f04b00d0260 con 0x7f04b4100e20 2024-09-19T09:19:12.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.645+0000 7f04b962c640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04a00a32c0 0x7f04a00a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f04a4005e10 tx=0x7f04a4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.646+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04b009cf50 con 0x7f04b4100e20 2024-09-19T09:19:12.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.952+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0498005580 con 0x7f04b4100e20 2024-09-19T09:19:12.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.953+0000 7f04aaffd640 1 -- 172.21.15.46:0/1847017920 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f04b009c850 con 0x7f04b4100e20 2024-09-19T09:19:12.955 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:19:12.955 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:19:12.956 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:19:12.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04a00a32c0 msgr2=0x7f04a00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04a00a32c0 0x7f04a00a5780 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f04a4005e10 tx=0x7f04a4005da0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 msgr2=0x7f04b4197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 0x7f04b4197300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e9f0 tx=0x7f04b000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 shutdown_connections 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04a00a32c0 0x7f04a00a5780 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f04b4102ef0 0x7f04b419bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04b4102570 0x7f04b4197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 --2- 172.21.15.46:0/1847017920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04b4100e20 0x7f04b4197300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 >> 172.21.15.46:0/1847017920 conn(0x7f04b40fc7d0 msgr2=0x7f04b41067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 shutdown_connections 2024-09-19T09:19:12.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:12.956+0000 7f04bc091640 1 -- 172.21.15.46:0/1847017920 wait complete. 2024-09-19T09:19:13.044 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:19:13.045 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:19:13.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:12 smithi115 ceph-mon[35055]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:19:13.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:12 smithi046 ceph-mon[31203]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:19:13.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:12 smithi099 ceph-mon[35256]: pgmap v365: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:19:13.755 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 77a5d8 --release --await' 2024-09-19T09:19:13.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 77a5d8 --release --await 2024-09-19T09:19:13.880 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:13.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:13 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1847017920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:14.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:13 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1847017920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:14.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:13 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1847017920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:14.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 -- 172.21.15.46:0/90883341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880103650 msgr2=0x7fd88010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 --2- 172.21.15.46:0/90883341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880103650 0x7fd88010bb40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd870009900 tx=0x7fd87002a480 comp rx=0 tx=0).stop 2024-09-19T09:19:14.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 -- 172.21.15.46:0/90883341 shutdown_connections 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 --2- 172.21.15.46:0/90883341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd880103650 0x7fd88010bb40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 --2- 172.21.15.46:0/90883341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd88010c160 0x7fd88010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 --2- 172.21.15.46:0/90883341 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880102d30 0x7fd880103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 -- 172.21.15.46:0/90883341 >> 172.21.15.46:0/90883341 conn(0x7fd8800fc7d0 msgr2=0x7fd8800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 -- 172.21.15.46:0/90883341 shutdown_connections 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.423+0000 7fd88859f640 1 -- 172.21.15.46:0/90883341 wait complete. 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 Processor -- start 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 -- start start 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd880102d30 0x7fd880198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880103650 0x7fd880198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 0x7fd88019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd880111f60 con 0x7fd88010c160 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd880111de0 con 0x7fd880102d30 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.424+0000 7fd88859f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801120e0 con 0x7fd880103650 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 0x7fd88019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 0x7fd88019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50312/0 (socket says 172.21.15.46:50312) 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 -- 172.21.15.46:0/2868172484 learned_addr learned my addr 172.21.15.46:0/2868172484 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd885b3a640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880103650 0x7fd880198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd88633b640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd880102d30 0x7fd880198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 -- 172.21.15.46:0/2868172484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880103650 msgr2=0x7fd880198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880103650 0x7fd880198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 -- 172.21.15.46:0/2868172484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd880102d30 msgr2=0x7fd880198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd880102d30 0x7fd880198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 -- 172.21.15.46:0/2868172484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88019d3d0 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd88633b640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd880102d30 0x7fd880198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd885b3a640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880103650 0x7fd880198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd886b3c640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 0x7fd88019ccf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd87800eaa0 tx=0x7fd87800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd8777fe640 1 -- 172.21.15.46:0/2868172484 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87800cdb0 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd8777fe640 1 -- 172.21.15.46:0/2868172484 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd878005020 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.425+0000 7fd8777fe640 1 -- 172.21.15.46:0/2868172484 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8780116b0 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.426+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88019d6c0 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.426+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8801008c0 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.428+0000 7fd8777fe640 1 -- 172.21.15.46:0/2868172484 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd878005560 con 0x7fd88010c160 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.429+0000 7fd88a978740 1 Processor -- start 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.429+0000 7fd88a978740 1 -- start start 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88a978740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513664f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd8777fe640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd86c0a32c0 0x7fd86c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88a978740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c51366f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88a978740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 0x55c513672130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88a978740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c5135ca280 con 0x55c513664b60 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88a978740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c513571b10 con 0x55c513665480 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88a978740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c5135c6240 con 0x55c51366fd40 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd8777fe640 1 -- 172.21.15.46:0/2868172484 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd8780cfad0 con 0x7fd88010c160 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd885b3a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513664f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd885b3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c51366f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd88633b640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd86c0a32c0 0x7fd86c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 0x55c513672130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 0x55c513672130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57278/0 (socket says 172.21.15.46:57278) 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 -- 172.21.15.46:0/748290840 learned_addr learned my addr 172.21.15.46:0/748290840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 -- 172.21.15.46:0/748290840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 msgr2=0x55c51366f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c51366f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 -- 172.21.15.46:0/748290840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 msgr2=0x55c513664f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513664f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.430+0000 7fd886b3c640 1 -- 172.21.15.46:0/748290840 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51357e1f0 con 0x55c51366fd40 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.431+0000 7fd886b3c640 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 0x55c513672130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd87809c0b0 tx=0x7fd87809bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce110d744aeed22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.431+0000 7fd874ff9640 1 -- 172.21.15.46:0/748290840 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87801f040 con 0x55c51366fd40 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.431+0000 7fd88633b640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd86c0a32c0 0x7fd86c0a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00abe0 tx=0x7fd87c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.432+0000 7fd874ff9640 1 -- 172.21.15.46:0/748290840 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87809c820 con 0x55c51366fd40 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.432+0000 7fd874ff9640 1 -- 172.21.15.46:0/748290840 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87809a420 con 0x55c51366fd40 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 -- 172.21.15.46:0/748290840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 msgr2=0x55c513672130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 0x55c513672130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd87809c0b0 tx=0x7fd87809bd90 comp rx=0 tx=0).stop 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 -- 172.21.15.46:0/748290840 shutdown_connections 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c51366fd40 0x55c513672130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c51366f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 --2- 172.21.15.46:0/748290840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513664f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 -- 172.21.15.46:0/748290840 >> 172.21.15.46:0/748290840 conn(0x55c5136610f0 msgr2=0x55c5136614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 -- 172.21.15.46:0/748290840 shutdown_connections 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 -- 172.21.15.46:0/748290840 wait complete. 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.433+0000 7fd88a978740 1 -- start start 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 Processor -- start 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513664b60 0x55c51366cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c51366d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c51366d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c513672910 con 0x55c51366fd40 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c513584f10 con 0x55c513664b60 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c51366d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c51366d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50332/0 (socket says 172.21.15.46:50332) 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 -- 172.21.15.46:0/3217331521 learned_addr learned my addr 172.21.15.46:0/3217331521 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c513672a90 con 0x55c513665480 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd885b3a640 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c51366d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88a978740 10 client.0 _ll_register_callbacks cb 0x55c51354da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd88633b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513664b60 0x55c51366cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 -- 172.21.15.46:0/3217331521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 msgr2=0x55c51366d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c51366d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 -- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513664b60 msgr2=0x55c51366cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.434+0000 7fd886b3c640 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513664b60 0x55c51366cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd886b3c640 1 -- 172.21.15.46:0/3217331521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c51333b6a0 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd886b3c640 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c51366d700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd87809c9d0 tx=0x7fd878005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a2b9f8943751d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd869ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd869ffb640 1 -- 172.21.15.46:0/3217331521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87801f070 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd87809c820 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd869ffb640 1 -- 172.21.15.46:0/3217331521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd8780bc0d0 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd869ffb640 1 -- 172.21.15.46:0/3217331521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd8780b5110 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd88a978740 10 client.15633 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.435+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c51367e550 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd869ffb640 1 -- 172.21.15.46:0/3217331521 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd87809c820 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd869ffb640 1 -- 172.21.15.46:0/3217331521 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd87800f040 con 0x55c51366fd40 2024-09-19T09:19:14.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88a978740 10 client.15633 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88a978740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88a978740 20 client.15633 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88a978740 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c513681c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88a978740 4 client.15633 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5135d77f0 con 0x55c51367f8a0 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.436+0000 7fd88633b640 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c513681c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.437+0000 7fd869ffb640 10 client.15633 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:14.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.437+0000 7fd88633b640 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c513681c90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98447acf0ea8a6c server_cookie=a225c1b5310c50d5 in_seq=0 out_seq=0 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.438+0000 7fd869ffb640 1 -- 172.21.15.46:0/3217331521 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5135d77f0 con 0x55c51367f8a0 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.438+0000 7fd869ffb640 10 client.15633 handle_command_reply: tid=0 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.438+0000 7fd88a978740 1 client.15633 shutdown 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 msgr2=0x55c51366d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c51366d700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd87809c9d0 tx=0x7fd878005850 comp rx=0 tx=0).stop 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 shutdown_connections 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c513681c90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd869ffb640 0 client.15633 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c51366d700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c51366d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 --2- 172.21.15.46:0/3217331521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513664b60 0x55c51366cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.439+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 >> 172.21.15.46:0/3217331521 conn(0x55c5136610f0 msgr2=0x55c513660270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.440+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 shutdown_connections 2024-09-19T09:19:14.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.440+0000 7fd88a978740 1 -- 172.21.15.46:0/3217331521 wait complete. 2024-09-19T09:19:14.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.440+0000 7fd88a978740 20 client.15633 trim_cache size 0 max 16384 2024-09-19T09:19:14.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.475+0000 7fd88a978740 1 Processor -- start 2024-09-19T09:19:14.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.475+0000 7fd88a978740 1 -- start start 2024-09-19T09:19:14.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd88a978740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513664b60 0x55c513684cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd88a978740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c5136851f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd88a978740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c513669ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd88a978740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801ab3d0 con 0x55c51366fd40 2024-09-19T09:19:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd885b3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c5136851f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd885b3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c5136851f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:45904/0 (socket says 172.21.15.46:45904) 2024-09-19T09:19:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.476+0000 7fd885b3a640 1 -- 172.21.15.46:0/2671907871 learned_addr learned my addr 172.21.15.46:0/2671907871 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd88633b640 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513664b60 0x55c513684cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd886b3c640 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c513669ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801acf10 con 0x55c513665480 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801abaa0 con 0x55c513664b60 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd885b3a640 1 -- 172.21.15.46:0/2671907871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513664b60 msgr2=0x55c513684cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd885b3a640 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513664b60 0x55c513684cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.477+0000 7fd885b3a640 1 -- 172.21.15.46:0/2671907871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 msgr2=0x55c513669ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.478+0000 7fd885b3a640 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c513669ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.478+0000 7fd885b3a640 1 -- 172.21.15.46:0/2671907871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c51365c830 con 0x55c513665480 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.478+0000 7fd886b3c640 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c513669ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.478+0000 7fd885b3a640 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c5136851f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd87002a9a0 tx=0x7fd870005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cb1cbb106a23c50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.479+0000 7fd86bfff640 1 -- 172.21.15.46:0/2671907871 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870035040 con 0x55c513665480 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.479+0000 7fd86bfff640 1 -- 172.21.15.46:0/2671907871 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd870031a20 con 0x55c513665480 2024-09-19T09:19:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.479+0000 7fd86bfff640 1 -- 172.21.15.46:0/2671907871 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870004a40 con 0x55c513665480 2024-09-19T09:19:14.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 msgr2=0x55c5136851f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c5136851f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd87002a9a0 tx=0x7fd870005e50 comp rx=0 tx=0).stop 2024-09-19T09:19:14.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 shutdown_connections 2024-09-19T09:19:14.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c51366fd40 0x55c513669ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c513665480 0x55c5136851f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 --2- 172.21.15.46:0/2671907871 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513664b60 0x55c513684cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.480+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 >> 172.21.15.46:0/2671907871 conn(0x55c5136610f0 msgr2=0x55c51366ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.481+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 shutdown_connections 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.481+0000 7fd88a978740 1 -- 172.21.15.46:0/2671907871 wait complete. 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.481+0000 7fd88a978740 1 -- start start 2024-09-19T09:19:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.481+0000 7fd88a978740 1 Processor -- start 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513683270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c5136837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c51366fd40 0x55c5136e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801ac840 con 0x55c513664b60 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801ac170 con 0x55c51366fd40 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88633b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513683270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801a93b0 con 0x55c513665480 2024-09-19T09:19:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88633b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513683270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50356/0 (socket says 172.21.15.46:50356) 2024-09-19T09:19:14.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88633b640 1 -- 172.21.15.46:0/3120643829 learned_addr learned my addr 172.21.15.46:0/3120643829 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.482+0000 7fd88a978740 10 client.0 _ll_register_callbacks cb 0x7fd870009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:14.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd88633b640 1 -- 172.21.15.46:0/3120643829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 msgr2=0x55c5136837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd88633b640 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c5136837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd88633b640 1 -- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c51366fd40 msgr2=0x55c5136e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd88633b640 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c51366fd40 0x55c5136e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd88633b640 1 -- 172.21.15.46:0/3120643829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5136652b0 con 0x55c513664b60 2024-09-19T09:19:14.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd88633b640 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513683270 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01e780 tx=0x7fd87c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1328e48876c43e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd869ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:14.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd869ffb640 1 -- 172.21.15.46:0/3120643829 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87c010aa0 con 0x55c513664b60 2024-09-19T09:19:14.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.483+0000 7fd869ffb640 1 -- 172.21.15.46:0/3120643829 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd87c010c40 con 0x55c513664b60 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.484+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd870031a20 con 0x55c513664b60 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.484+0000 7fd869ffb640 1 -- 172.21.15.46:0/3120643829 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd87c010e40 con 0x55c513664b60 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.484+0000 7fd88a978740 10 client.15639 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.484+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c5136ea9c0 con 0x55c513664b60 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd869ffb640 1 -- 172.21.15.46:0/3120643829 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd870031a20 con 0x55c513664b60 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd869ffb640 1 -- 172.21.15.46:0/3120643829 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd87c02c070 con 0x55c513664b60 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd88a978740 10 client.15639 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd88a978740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd88a978740 20 client.15639 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd88a978740 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c5136ed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd88a978740 4 client.15639 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c5135d1d00 con 0x55c51367f8a0 2024-09-19T09:19:14.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.485+0000 7fd885b3a640 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c5136ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.486+0000 7fd885b3a640 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c5136ed250 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a60b0177a10402f server_cookie=25ed800bff2dd1ac in_seq=0 out_seq=0 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.486+0000 7fd869ffb640 10 client.15639 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.487+0000 7fd869ffb640 1 -- 172.21.15.46:0/3120643829 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c5135d1d00 con 0x55c51367f8a0 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.487+0000 7fd869ffb640 10 client.15639 handle_command_reply: tid=0 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.487+0000 7fd88a978740 1 client.15639 shutdown 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 msgr2=0x55c513683270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513683270 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01e780 tx=0x7fd87c004730 comp rx=0 tx=0).stop 2024-09-19T09:19:14.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 shutdown_connections 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c51367f8a0 0x55c5136ed250 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c51366fd40 0x55c5136e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd869ffb640 0 client.15639 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c513665480 0x55c5136837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 --2- 172.21.15.46:0/3120643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c513664b60 0x55c513683270 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 >> 172.21.15.46:0/3120643829 conn(0x55c5136610f0 msgr2=0x55c5136665b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 shutdown_connections 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.488+0000 7fd88a978740 1 -- 172.21.15.46:0/3120643829 wait complete. 2024-09-19T09:19:14.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88a978740 20 client.15639 trim_cache size 0 max 16384 2024-09-19T09:19:14.492 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:19:14.492 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-19T09:19:14.492 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "6c436159-f987-4220-9998-00549f414d14", 2024-09-19T09:19:14.492 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-19T09:19:14.492 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:19:14.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd86c0a32c0 msgr2=0x7fd86c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd86c0a32c0 0x7fd86c0a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00abe0 tx=0x7fd87c00a5c0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 msgr2=0x7fd88019ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 0x7fd88019ccf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd87800eaa0 tx=0x7fd87800ef60 comp rx=0 tx=0).stop 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 shutdown_connections 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd86c0a32c0 0x7fd86c0a5780 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd88010c160 0x7fd88019ccf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880103650 0x7fd880198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 --2- 172.21.15.46:0/2868172484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd880102d30 0x7fd880198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.489+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 >> 172.21.15.46:0/2868172484 conn(0x7fd8800fc7d0 msgr2=0x7fd8800fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.490+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 shutdown_connections 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:14.490+0000 7fd88859f640 1 -- 172.21.15.46:0/2868172484 wait complete. 2024-09-19T09:19:14.493 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 -- 172.21.15.46:0/1424932313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c102e90 msgr2=0x7fcc6c103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 --2- 172.21.15.46:0/1424932313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c102e90 0x7fcc6c103310 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009900 tx=0x7fcc6002a410 comp rx=0 tx=0).stop 2024-09-19T09:19:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 -- 172.21.15.46:0/1424932313 shutdown_connections 2024-09-19T09:19:14.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 --2- 172.21.15.46:0/1424932313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c102e90 0x7fcc6c103310 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 --2- 172.21.15.46:0/1424932313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc6c103850 0x7fcc6c10a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 --2- 172.21.15.46:0/1424932313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.958+0000 7fcc70d76640 1 -- 172.21.15.46:0/1424932313 >> 172.21.15.46:0/1424932313 conn(0x7fcc6c0fb980 msgr2=0x7fcc6c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.959+0000 7fcc70d76640 1 -- 172.21.15.46:0/1424932313 shutdown_connections 2024-09-19T09:19:14.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.959+0000 7fcc70d76640 1 -- 172.21.15.46:0/1424932313 wait complete. 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 Processor -- start 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 -- start start 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c102800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc6c102e90 0x7fcc6c100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc6c103850 0x7fcc6c101380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10d7f0 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10d670 con 0x7fcc6c103850 2024-09-19T09:19:14.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc70d76640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10d970 con 0x7fcc6c102e90 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c102800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c102800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50384/0 (socket says 172.21.15.46:50384) 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6a59c640 1 -- 172.21.15.46:0/3538214994 learned_addr learned my addr 172.21.15.46:0/3538214994 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc6c102e90 0x7fcc6c100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6ad9d640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc6c103850 0x7fcc6c101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6a59c640 1 -- 172.21.15.46:0/3538214994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc6c102e90 msgr2=0x7fcc6c100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc6c102e90 0x7fcc6c100e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.960+0000 7fcc6a59c640 1 -- 172.21.15.46:0/3538214994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc6c103850 msgr2=0x7fcc6c101380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc6c103850 0x7fcc6c101380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc6a59c640 1 -- 172.21.15.46:0/3538214994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c1018c0 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c102800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00e9c0 tx=0x7fcc5c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc5b7fe640 1 -- 172.21.15.46:0/3538214994 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c00cd80 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c101bb0 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c1a6860 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc5b7fe640 1 -- 172.21.15.46:0/3538214994 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc5c0035f0 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.961+0000 7fcc5b7fe640 1 -- 172.21.15.46:0/3538214994 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c010690 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.964+0000 7fcc5b7fe640 1 -- 172.21.15.46:0/3538214994 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcc5c0037a0 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.964+0000 7fcc5b7fe640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcc540a33f0 0x7fcc540a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.964+0000 7fcc73bed740 1 Processor -- start 2024-09-19T09:19:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.964+0000 7fcc5b7fe640 1 -- 172.21.15.46:0/3538214994 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc5c0cfbc0 con 0x7fcc6c0ffe20 2024-09-19T09:19:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.964+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcc540a33f0 0x7fcc540a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 -- start start 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 0x559433259da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325a2e0 0x55943325eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55943325f370 0x559433261830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5594331bd2f0 con 0x5594332599a0 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559433165270 con 0x55943325f370 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc73bed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5594331b92b0 con 0x55943325a2e0 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 0x559433259da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcc540a33f0 0x7fcc540a58b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcc60006010 tx=0x7fcc60005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc69d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325a2e0 0x55943325eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 0x559433259da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50396/0 (socket says 172.21.15.46:50396) 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc6a59c640 1 -- 172.21.15.46:0/2825297237 learned_addr learned my addr 172.21.15.46:0/2825297237 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.965+0000 7fcc6ad9d640 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55943325f370 0x559433261830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc6a59c640 1 -- 172.21.15.46:0/2825297237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325a2e0 msgr2=0x55943325eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325a2e0 0x55943325eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc6a59c640 1 -- 172.21.15.46:0/2825297237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55943325f370 msgr2=0x559433261830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55943325f370 0x559433261830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc6a59c640 1 -- 172.21.15.46:0/2825297237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559433164340 con 0x5594332599a0 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 0x559433259da0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c09c140 tx=0x7fcc5c09c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d82b4158a282b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc58ff9640 1 -- 172.21.15.46:0/2825297237 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0b4020 con 0x5594332599a0 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc58ff9640 1 -- 172.21.15.46:0/2825297237 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc5c0a4e20 con 0x5594332599a0 2024-09-19T09:19:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.966+0000 7fcc58ff9640 1 -- 172.21.15.46:0/2825297237 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0989b0 con 0x5594332599a0 2024-09-19T09:19:14.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 -- 172.21.15.46:0/2825297237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 msgr2=0x559433259da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 0x559433259da0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c09c140 tx=0x7fcc5c09c8b0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 -- 172.21.15.46:0/2825297237 shutdown_connections 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55943325f370 0x559433261830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325a2e0 0x55943325eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 --2- 172.21.15.46:0/2825297237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5594332599a0 0x559433259da0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 -- 172.21.15.46:0/2825297237 >> 172.21.15.46:0/2825297237 conn(0x559433255010 msgr2=0x559433255410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 -- 172.21.15.46:0/2825297237 shutdown_connections 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.967+0000 7fcc73bed740 1 -- 172.21.15.46:0/2825297237 wait complete. 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 -- start start 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 Processor -- start 2024-09-19T09:19:14.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 0x559433263e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x5594332643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433269360 0x55943326b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559433262340 con 0x55943325a2e0 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559433146290 con 0x559433269360 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 0x559433263e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5594332624c0 con 0x55943325f370 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc6a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 0x559433263e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50400/0 (socket says 172.21.15.46:50400) 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc6a59c640 1 -- 172.21.15.46:0/1082479794 learned_addr learned my addr 172.21.15.46:0/1082479794 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc73bed740 10 client.0 _ll_register_callbacks cb 0x559433177140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x5594332643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.968+0000 7fcc6ad9d640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433269360 0x55943326b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc6a59c640 1 -- 172.21.15.46:0/1082479794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 msgr2=0x5594332643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x5594332643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc6a59c640 1 -- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433269360 msgr2=0x55943326b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433269360 0x55943326b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc6a59c640 1 -- 172.21.15.46:0/1082479794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559432ed0210 con 0x55943325a2e0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 0x559433263e60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c09beb0 tx=0x7fcc5c0a0620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b94980482c0a9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc51ffb640 1 -- 172.21.15.46:0/1082479794 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0ba030 con 0x55943325a2e0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc5c0a4e20 con 0x55943325a2e0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc51ffb640 1 -- 172.21.15.46:0/1082479794 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc5c0a4b90 con 0x55943325a2e0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc51ffb640 1 -- 172.21.15.46:0/1082479794 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc5c0b4070 con 0x55943325a2e0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc73bed740 10 client.15651 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.969+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559432f9c620 con 0x55943325a2e0 2024-09-19T09:19:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc51ffb640 1 -- 172.21.15.46:0/1082479794 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc5c0a4e20 con 0x55943325a2e0 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc51ffb640 1 -- 172.21.15.46:0/1082479794 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcc5c09b600 con 0x55943325a2e0 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc73bed740 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc73bed740 10 client.15651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc73bed740 20 client.15651 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc73bed740 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55943326fa50 0x559433271e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc73bed740 4 client.15651 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.970+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594331caa20 con 0x55943326fa50 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.971+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55943326fa50 0x559433271e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.971+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55943326fa50 0x559433271e40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b412e263b77756d server_cookie=be4dd3cdd5e473f1 in_seq=0 out_seq=0 2024-09-19T09:19:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.971+0000 7fcc51ffb640 10 client.15651 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.972+0000 7fcc51ffb640 1 -- 172.21.15.46:0/1082479794 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594331caa20 con 0x55943326fa50 2024-09-19T09:19:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.972+0000 7fcc51ffb640 10 client.15651 handle_command_reply: tid=0 2024-09-19T09:19:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.972+0000 7fcc73bed740 1 client.15651 shutdown 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.972+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 msgr2=0x559433263e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.972+0000 7fcc73bed740 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 0x559433263e60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c09beb0 tx=0x7fcc5c0a0620 comp rx=0 tx=0).stop 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 shutdown_connections 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55943326fa50 0x559433271e40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433269360 0x55943326b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x5594332643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 --2- 172.21.15.46:0/1082479794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55943325a2e0 0x559433263e60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 >> 172.21.15.46:0/1082479794 conn(0x559433255010 msgr2=0x559433256820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc51ffb640 0 client.15651 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 shutdown_connections 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 1 -- 172.21.15.46:0/1082479794 wait complete. 2024-09-19T09:19:14.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:14.973+0000 7fcc73bed740 20 client.15651 trim_cache size 0 max 16384 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 Processor -- start 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 -- start start 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x559433259d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433264320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 0x559433256370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c00e3b0 con 0x559433269360 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c00fef0 con 0x559433255ec0 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc73bed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c00ea80 con 0x55943325f370 2024-09-19T09:19:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc69d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433264320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc69d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433264320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50410/0 (socket says 172.21.15.46:50410) 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.002+0000 7fcc69d9b640 1 -- 172.21.15.46:0/163641825 learned_addr learned my addr 172.21.15.46:0/163641825 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc69d9b640 1 -- 172.21.15.46:0/163641825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 msgr2=0x559433259d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x559433259d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc69d9b640 1 -- 172.21.15.46:0/163641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 msgr2=0x559433256370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 0x559433256370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc69d9b640 1 -- 172.21.15.46:0/163641825 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559433262580 con 0x559433269360 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc69d9b640 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433264320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcc600096c0 tx=0x7fcc6003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1591441b92118b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc53fff640 1 -- 172.21.15.46:0/163641825 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60035020 con 0x559433269360 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc53fff640 1 -- 172.21.15.46:0/163641825 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc60031c40 con 0x559433269360 2024-09-19T09:19:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.003+0000 7fcc53fff640 1 -- 172.21.15.46:0/163641825 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60004ce0 con 0x559433269360 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 -- 172.21.15.46:0/163641825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 msgr2=0x559433264320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433264320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcc600096c0 tx=0x7fcc6003f000 comp rx=0 tx=0).stop 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 -- 172.21.15.46:0/163641825 shutdown_connections 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433264320 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 0x559433256370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 --2- 172.21.15.46:0/163641825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x559433259d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 -- 172.21.15.46:0/163641825 >> 172.21.15.46:0/163641825 conn(0x559433255010 msgr2=0x559433263c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 -- 172.21.15.46:0/163641825 shutdown_connections 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.004+0000 7fcc73bed740 1 -- 172.21.15.46:0/163641825 wait complete. 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 -- start start 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 Processor -- start 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 0x559433281450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x559433281990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433282950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc6ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433282950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc6ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433282950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50414/0 (socket says 172.21.15.46:50414) 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc6ad9d640 1 -- 172.21.15.46:0/224114753 learned_addr learned my addr 172.21.15.46:0/224114753 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c00f820 con 0x559433269360 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c00f150 con 0x559433255ec0 2024-09-19T09:19:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.005+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c00c390 con 0x55943325f370 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc6ad9d640 1 -- 172.21.15.46:0/224114753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 msgr2=0x559433281990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc6ad9d640 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x559433281990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc6ad9d640 1 -- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 msgr2=0x559433281450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc6ad9d640 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 0x559433281450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc6ad9d640 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559433282f60 con 0x559433269360 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc73bed740 10 client.0 _ll_register_callbacks cb 0x7fcc64009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc6ad9d640 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433282950 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc640042f0 tx=0x7fcc64003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be84f4191b5a6c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc60031c40 con 0x559433269360 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.006+0000 7fcc51ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc51ffb640 1 -- 172.21.15.46:0/224114753 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc64011db0 con 0x559433269360 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc51ffb640 1 -- 172.21.15.46:0/224114753 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcc6401c460 con 0x559433269360 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc51ffb640 1 -- 172.21.15.46:0/224114753 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcc6401c700 con 0x559433269360 2024-09-19T09:19:15.011 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 10 client.15657 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5594332da530 con 0x559433269360 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc51ffb640 1 -- 172.21.15.46:0/224114753 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcc6401c8a0 con 0x559433269360 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 10 client.15657 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 20 client.15657 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5594332dad40 0x5594332dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 4 client.15657 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.007+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594331c4d70 con 0x5594332dad40 2024-09-19T09:19:15.012 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.008+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5594332dad40 0x5594332dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.013 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.008+0000 7fcc51ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:15.013 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.008+0000 7fcc6a59c640 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5594332dad40 0x5594332dd1d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a60f156bb85a4dc server_cookie=5533181dc61db0aa in_seq=0 out_seq=0 2024-09-19T09:19:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.031+0000 7fcc51ffb640 1 -- 172.21.15.46:0/224114753 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594331c4d70 con 0x5594332dad40 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.031+0000 7fcc51ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.031+0000 7fcc73bed740 1 client.15657 shutdown 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 msgr2=0x559433282950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433282950 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcc640042f0 tx=0x7fcc64003f90 comp rx=0 tx=0).stop 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 shutdown_connections 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5594332dad40 0x5594332dd1d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559433269360 0x559433282950 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55943325f370 0x559433281990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc51ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 --2- 172.21.15.46:0/224114753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559433255ec0 0x559433281450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 >> 172.21.15.46:0/224114753 conn(0x559433255010 msgr2=0x559433263c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 shutdown_connections 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 1 -- 172.21.15.46:0/224114753 wait complete. 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.032+0000 7fcc73bed740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:19:15.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:19:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:19:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcc540a33f0 msgr2=0x7fcc540a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcc540a33f0 0x7fcc540a58b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcc60006010 tx=0x7fcc60005870 comp rx=0 tx=0).stop 2024-09-19T09:19:15.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 msgr2=0x7fcc6c102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c102800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c00e9c0 tx=0x7fcc5c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 shutdown_connections 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcc540a33f0 0x7fcc540a58b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcc6c103850 0x7fcc6c101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc6c102e90 0x7fcc6c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 --2- 172.21.15.46:0/3538214994 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc6c0ffe20 0x7fcc6c102800 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 >> 172.21.15.46:0/3538214994 conn(0x7fcc6c0fb980 msgr2=0x7fcc6c106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 shutdown_connections 2024-09-19T09:19:15.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:15.033+0000 7fcc70d76640 1 -- 172.21.15.46:0/3538214994 wait complete. 2024-09-19T09:19:15.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:14 smithi046 ceph-mon[31203]: pgmap v366: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:19:15.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:14 smithi115 ceph-mon[35055]: pgmap v366: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:19:15.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:14 smithi099 ceph-mon[35256]: pgmap v366: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T09:19:15.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:19:15.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 -- 172.21.15.46:0/986254546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8108290 msgr2=0x7fd1f810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 --2- 172.21.15.46:0/986254546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8108290 0x7fd1f810ec30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009cd0 tx=0x7fd1f002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 -- 172.21.15.46:0/986254546 shutdown_connections 2024-09-19T09:19:15.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 --2- 172.21.15.46:0/986254546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8108290 0x7fd1f810ec30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 --2- 172.21.15.46:0/986254546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f8103740 0x7fd1f8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 --2- 172.21.15.46:0/986254546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 0x7fd1f8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.287+0000 7fd1ff815640 1 -- 172.21.15.46:0/986254546 >> 172.21.15.46:0/986254546 conn(0x7fd1f80fc7d0 msgr2=0x7fd1f80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.288+0000 7fd1ff815640 1 -- 172.21.15.46:0/986254546 shutdown_connections 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.288+0000 7fd1ff815640 1 -- 172.21.15.46:0/986254546 wait complete. 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 Processor -- start 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 -- start start 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 0x7fd1f81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 0x7fd1f8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f8108290 0x7fd1f819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8112090 con 0x7fd1f8103740 2024-09-19T09:19:15.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8111f10 con 0x7fd1f8102d90 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.289+0000 7fd1ff815640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f8112210 con 0x7fd1f8108290 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 0x7fd1f8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 0x7fd1f81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 0x7fd1f8198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50422/0 (socket says 172.21.15.46:50422) 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/469482039 learned_addr learned my addr 172.21.15.46:0/469482039 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f8108290 0x7fd1f819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/469482039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f8108290 msgr2=0x7fd1f819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f8108290 0x7fd1f819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/469482039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 msgr2=0x7fd1f81984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 0x7fd1f81984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/469482039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f819d480 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 0x7fd1f81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.290+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 0x7fd1f8198a10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800c970 tx=0x7fd1e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.291+0000 7fd1ee7fc640 1 -- 172.21.15.46:0/469482039 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8014070 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.291+0000 7fd1ee7fc640 1 -- 172.21.15.46:0/469482039 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1e8004440 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.291+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f819d770 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.291+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f81a5050 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.291+0000 7fd1ee7fc640 1 -- 172.21.15.46:0/469482039 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800f450 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.295+0000 7fd201bee740 1 Processor -- start 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.295+0000 7fd1ee7fc640 1 -- 172.21.15.46:0/469482039 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd1e8017070 con 0x7fd1f8103740 2024-09-19T09:19:15.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.295+0000 7fd201bee740 1 -- start start 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.295+0000 7fd201bee740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f060 0x5566dc17f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd201bee740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 0x5566dc189d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd201bee740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc18c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd201bee740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5566dc0e4620 con 0x5566dc17f980 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 0x5566dc189d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 0x5566dc189d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50430/0 (socket says 172.21.15.46:50430) 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/3012833514 learned_addr learned my addr 172.21.15.46:0/3012833514 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc18c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f060 0x5566dc17f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd201bee740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5566dc08be50 con 0x5566dc18a240 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.296+0000 7fd201bee740 1 -- 172.21.15.46:0/3012833514 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5566dc0e05e0 con 0x5566dc17f060 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3012833514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f060 msgr2=0x5566dc17f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f060 0x5566dc17f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3012833514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 msgr2=0x5566dc189d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 0x5566dc189d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3012833514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566dc07cd40 con 0x5566dc18a240 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 0x5566dc189d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1ee7fc640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd1e40a32c0 0x7fd1e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc18c630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80ccd40 tx=0x7fd1e80d7910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4cb639416c2ef8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1e37fe640 1 -- 172.21.15.46:0/3012833514 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8097b60 con 0x5566dc18a240 2024-09-19T09:19:15.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1e37fe640 1 -- 172.21.15.46:0/3012833514 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1e809bfc0 con 0x5566dc18a240 2024-09-19T09:19:15.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1e37fe640 1 -- 172.21.15.46:0/3012833514 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80a8f40 con 0x5566dc18a240 2024-09-19T09:19:15.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.297+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd1e40a32c0 0x7fd1e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd1ee7fc640 1 -- 172.21.15.46:0/469482039 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd1e80cf2d0 con 0x7fd1f8103740 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 -- 172.21.15.46:0/3012833514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 msgr2=0x5566dc18c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc18c630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80ccd40 tx=0x7fd1e80d7910 comp rx=0 tx=0).stop 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd1e40a32c0 0x7fd1e40a5780 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009a60 tx=0x7fd1f0005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 -- 172.21.15.46:0/3012833514 shutdown_connections 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f980 0x5566dc189d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc18c630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 --2- 172.21.15.46:0/3012833514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f060 0x5566dc17f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.298+0000 7fd201bee740 1 -- 172.21.15.46:0/3012833514 >> 172.21.15.46:0/3012833514 conn(0x5566dc17b5f0 msgr2=0x5566dc17b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.299+0000 7fd201bee740 1 -- 172.21.15.46:0/3012833514 shutdown_connections 2024-09-19T09:19:15.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.299+0000 7fd201bee740 1 -- 172.21.15.46:0/3012833514 wait complete. 2024-09-19T09:19:15.714 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:19:15.714 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 28, 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 4, 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "77a5d8": { 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 4, 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:19:15.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 131.2, 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:19:15.716 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:19:15.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.299+0000 7fd201bee740 1 -- start start 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.299+0000 7fd201bee740 1 Processor -- start 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd201bee740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc187140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc187140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc187140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50434/0 (socket says 172.21.15.46:50434) 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/3767342618 learned_addr learned my addr 172.21.15.46:0/3767342618 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc187680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5566dc18ce10 con 0x5566dc17f060 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5566dc06cf10 con 0x5566dc18a240 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.300+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5566dc18cf90 con 0x5566dc17f980 2024-09-19T09:19:15.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/3767342618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 msgr2=0x5566dc187680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc187680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 msgr2=0x5566dc187bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd201bee740 10 client.0 _ll_register_callbacks cb 0x5566dc090db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566dbdf3580 con 0x5566dc17f060 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc187140 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4011a60 tx=0x7fd1f4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e6f2e0590c847e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1e809bfc0 con 0x5566dc17f060 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.301+0000 7fd1e0ff9640 10 client.15669 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.302+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3767342618 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f401f060 con 0x5566dc17f060 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.302+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3767342618 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd1f4010b10 con 0x5566dc17f060 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.302+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3767342618 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1f4010d70 con 0x5566dc17f060 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.302+0000 7fd201bee740 10 client.15669 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.302+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5566dbebd960 con 0x5566dc17f060 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.302+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3767342618 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd1f4022050 con 0x5566dc17f060 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd201bee740 10 client.15669 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd201bee740 10 client.15669 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:19:15.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd201bee740 20 client.15669 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc199c30 0x5566dc19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd201bee740 4 client.15669 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566dc0f1b90 con 0x5566dc199c30 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc199c30 0x5566dc19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc199c30 0x5566dc19c0c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a7b1d83e7b2da09 server_cookie=55b55cc394e63986 in_seq=0 out_seq=0 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.303+0000 7fd1e0ff9640 10 client.15669 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3767342618 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566dc0f1b90 con 0x5566dc199c30 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd1e0ff9640 10 client.15669 handle_command_reply: tid=0 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 client.15669 shutdown 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 msgr2=0x5566dc187140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc187140 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4011a60 tx=0x7fd1f4011f20 comp rx=0 tx=0).stop 2024-09-19T09:19:15.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 shutdown_connections 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc199c30 0x5566dc19c0c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc187680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 --2- 172.21.15.46:0/3767342618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc187140 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.304+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 >> 172.21.15.46:0/3767342618 conn(0x5566dc17b5f0 msgr2=0x5566dc181320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.305+0000 7fd1e0ff9640 0 client.15669 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:15.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.305+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 shutdown_connections 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.305+0000 7fd201bee740 1 -- 172.21.15.46:0/3767342618 wait complete. 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.305+0000 7fd201bee740 20 client.15669 trim_cache size 0 max 16384 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.339+0000 7fd201bee740 1 Processor -- start 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.339+0000 7fd201bee740 1 -- start start 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.339+0000 7fd201bee740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc181ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.339+0000 7fd201bee740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc17b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.339+0000 7fd201bee740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.339+0000 7fd201bee740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81ad510 con 0x5566dc17f060 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd201bee740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81af050 con 0x5566dc18a240 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd201bee740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81adbe0 con 0x5566dc17f980 2024-09-19T09:19:15.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc181ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc181ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50446/0 (socket says 172.21.15.46:50446) 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/4263787082 learned_addr learned my addr 172.21.15.46:0/4263787082 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc17b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/4263787082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 msgr2=0x5566dc17b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc17b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/4263787082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 msgr2=0x5566dc187810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 -- 172.21.15.46:0/4263787082 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566dc17a610 con 0x5566dc17f060 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.340+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc181ac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400be70 tx=0x7fd1f4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca98e596cde54cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.341+0000 7fd1e2ffd640 1 -- 172.21.15.46:0/4263787082 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f401a7c0 con 0x5566dc17f060 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.341+0000 7fd1e2ffd640 1 -- 172.21.15.46:0/4263787082 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1e809bfc0 con 0x5566dc17f060 2024-09-19T09:19:15.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.341+0000 7fd1e2ffd640 1 -- 172.21.15.46:0/4263787082 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4024b00 con 0x5566dc17f060 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 -- 172.21.15.46:0/4263787082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 msgr2=0x5566dc181ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc181ac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400be70 tx=0x7fd1f4011f90 comp rx=0 tx=0).stop 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 -- 172.21.15.46:0/4263787082 shutdown_connections 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc18a240 0x5566dc187810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc17f980 0x5566dc17b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 --2- 172.21.15.46:0/4263787082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc181ac0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 -- 172.21.15.46:0/4263787082 >> 172.21.15.46:0/4263787082 conn(0x5566dc17b5f0 msgr2=0x5566dc187100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 -- 172.21.15.46:0/4263787082 shutdown_connections 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 -- 172.21.15.46:0/4263787082 wait complete. 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 -- start start 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.342+0000 7fd201bee740 1 Processor -- start 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc18e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 0x5566dc18ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc18a240 0x5566dc1fd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81ae980 con 0x5566dc17f060 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81ae2b0 con 0x5566dc17f980 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f81ab4f0 con 0x5566dc18a240 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd201bee740 10 client.0 _ll_register_callbacks cb 0x7fd1f4011670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fd5b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc18e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 0x5566dc18ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 0x5566dc18ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:46000/0 (socket says 172.21.15.46:46000) 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3288980152 learned_addr learned my addr 172.21.15.46:0/3288980152 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fddb2640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc18a240 0x5566dc1fd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3288980152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc18a240 msgr2=0x5566dc1fd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc18a240 0x5566dc1fd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3288980152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 msgr2=0x5566dc18e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc18e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fcdb0640 1 -- 172.21.15.46:0/3288980152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566dc204ab0 con 0x5566dc17f980 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.343+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc18e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1fcdb0640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 0x5566dc18ed20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1e809b5c0 tx=0x7fd1e8003920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3183567c85396b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3288980152 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80a9160 con 0x5566dc17f980 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1e809bfc0 con 0x5566dc17f980 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3288980152 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fd1e80cceb0 con 0x5566dc17f980 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3288980152 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd1e80a9360 con 0x5566dc17f980 2024-09-19T09:19:15.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 10 client.25265 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:15.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5566dc204d50 con 0x5566dc17f980 2024-09-19T09:19:15.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3288980152 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1e809bfc0 con 0x5566dc17f980 2024-09-19T09:19:15.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3288980152 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd1e80d2a00 con 0x5566dc17f980 2024-09-19T09:19:15.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 10 client.25265 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:15.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 10 client.25265 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:19:15.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 20 client.25265 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:15.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc205030 0x5566dc207420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 4 client.25265 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "77a5d8", "release": true, "await": true}] 2024-09-19T09:19:15.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.344+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "set_id": "77a5d8", "release": true, "await": true}) -- 0x5566dc0ec0a0 con 0x5566dc205030 2024-09-19T09:19:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.345+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc205030 0x5566dc207420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.345+0000 7fd1e0ff9640 10 client.25265 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.345+0000 7fd1fd5b1640 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc205030 0x5566dc207420 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0babfb50618c1f9 server_cookie=50e16e5f3ca61fab in_seq=0 out_seq=0 2024-09-19T09:19:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd1e0ff9640 1 -- 172.21.15.46:0/3288980152 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x5566dc0ec0a0 con 0x5566dc205030 2024-09-19T09:19:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd1e0ff9640 10 client.25265 handle_command_reply: tid=0 2024-09-19T09:19:15.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 client.25265 shutdown 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 msgr2=0x5566dc18ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 0x5566dc18ed20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd1e809b5c0 tx=0x7fd1e8003920 comp rx=0 tx=0).stop 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 shutdown_connections 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5566dc205030 0x5566dc207420 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5566dc18a240 0x5566dc1fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd1e0ff9640 0 client.25265 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:15.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566dc17f980 0x5566dc18ed20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 --2- 172.21.15.46:0/3288980152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5566dc17f060 0x5566dc18e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 >> 172.21.15.46:0/3288980152 conn(0x5566dc17b5f0 msgr2=0x5566dc187920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 shutdown_connections 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 1 -- 172.21.15.46:0/3288980152 wait complete. 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.347+0000 7fd201bee740 20 client.25265 trim_cache size 0 max 16384 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd1e40a32c0 msgr2=0x7fd1e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd1e40a32c0 0x7fd1e40a5780 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0009a60 tx=0x7fd1f0005fa0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 msgr2=0x7fd1f8198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 0x7fd1f8198a10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800c970 tx=0x7fd1e800ce30 comp rx=0 tx=0).stop 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 shutdown_connections 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd1e40a32c0 0x7fd1e40a5780 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f8103740 0x7fd1f8198a10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1f8108290 0x7fd1f819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 --2- 172.21.15.46:0/469482039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f8102d90 0x7fd1f81984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 >> 172.21.15.46:0/469482039 conn(0x7fd1f80fc7d0 msgr2=0x7fd1f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 shutdown_connections 2024-09-19T09:19:15.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:15.348+0000 7fd1ff815640 1 -- 172.21.15.46:0/469482039 wait complete. 2024-09-19T09:19:15.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:15 smithi046 ceph-mon[31203]: scrub queued for path: / 2024-09-19T09:19:15.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:15 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:19:15.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:15 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:19:15.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:15 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:19:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:15 smithi115 ceph-mon[35055]: scrub queued for path: / 2024-09-19T09:19:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:15 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:19:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:15 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:19:16.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:15 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:19:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:15 smithi099 ceph-mon[35256]: scrub queued for path: / 2024-09-19T09:19:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:15 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:19:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:15 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:19:16.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:15 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:19:16.378 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '77a5d8', total seconds elapsed: 16.0 2024-09-19T09:19:16.450 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 -- 172.21.15.46:0/4153310879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 msgr2=0x7fa9e41021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/4153310879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e41021d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009900 tx=0x7fa9d402a410 comp rx=0 tx=0).stop 2024-09-19T09:19:16.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 -- 172.21.15.46:0/4153310879 shutdown_connections 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/4153310879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e4106f20 0x7fa9e410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/4153310879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e41027a0 0x7fa9e41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/4153310879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e41021d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 -- 172.21.15.46:0/4153310879 >> 172.21.15.46:0/4153310879 conn(0x7fa9e40fd8f0 msgr2=0x7fa9e40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 -- 172.21.15.46:0/4153310879 shutdown_connections 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.960+0000 7fa9e97c1640 1 -- 172.21.15.46:0/4153310879 wait complete. 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.961+0000 7fa9e97c1640 1 Processor -- start 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 -- start start 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e41027a0 0x7fa9e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e4106f20 0x7fa9e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4111f80 con 0x7fa9e4101df0 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4111e00 con 0x7fa9e4106f20 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e97c1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4112100 con 0x7fa9e41027a0 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e27fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e41027a0 0x7fa9e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50472/0 (socket says 172.21.15.46:50472) 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/3513531713 learned_addr learned my addr 172.21.15.46:0/3513531713 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e37fe640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e4106f20 0x7fa9e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/3513531713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e41027a0 msgr2=0x7fa9e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e41027a0 0x7fa9e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/3513531713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e4106f20 msgr2=0x7fa9e4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e4106f20 0x7fa9e4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/3513531713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e41a6960 con 0x7fa9e4101df0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.962+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e41027a0 0x7fa9e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.963+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e40744f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4006010 tx=0x7fa9d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.963+0000 7fa9cbfff640 1 -- 172.21.15.46:0/3513531713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d403f030 con 0x7fa9e4101df0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.963+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e41a6bf0 con 0x7fa9e4101df0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.963+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e41a7120 con 0x7fa9e4101df0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.963+0000 7fa9cbfff640 1 -- 172.21.15.46:0/3513531713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d4003ce0 con 0x7fa9e4101df0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.963+0000 7fa9cbfff640 1 -- 172.21.15.46:0/3513531713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4035070 con 0x7fa9e4101df0 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 Processor -- start 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 -- start start 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d0b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d21280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55de56c712e0 con 0x55de56d1ee90 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55de56c18ce0 con 0x55de56d0bce0 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55de56c6d2a0 con 0x55de56d0b3c0 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9e27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d21280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9e27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d21280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50474/0 (socket says 172.21.15.46:50474) 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.966+0000 7fa9e27fc640 1 -- 172.21.15.46:0/3742262595 learned_addr learned my addr 172.21.15.46:0/3742262595 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e37fe640 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d0b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e27fc640 1 -- 172.21.15.46:0/3742262595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 msgr2=0x55de56d0b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d0b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e27fc640 1 -- 172.21.15.46:0/3742262595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 msgr2=0x55de56d1e950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1e950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e27fc640 1 -- 172.21.15.46:0/3742262595 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de56bfd440 con 0x55de56d1ee90 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9cbfff640 1 -- 172.21.15.46:0/3513531713 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa9d4042030 con 0x7fa9e4101df0 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d21280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80114f0 tx=0x7fa9d80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6788b22ee253f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.967+0000 7fa9c97fa640 1 -- 172.21.15.46:0/3742262595 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d801e070 con 0x55de56d1ee90 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.968+0000 7fa9c97fa640 1 -- 172.21.15.46:0/3742262595 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d80035f0 con 0x55de56d1ee90 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.968+0000 7fa9c97fa640 1 -- 172.21.15.46:0/3742262595 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d800f820 con 0x55de56d1ee90 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.968+0000 7fa9cbfff640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9cc0a3240 0x7fa9cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.968+0000 7fa9cbfff640 1 -- 172.21.15.46:0/3513531713 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa9d40effb0 con 0x7fa9e4101df0 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.968+0000 7fa9e37fe640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9cc0a3240 0x7fa9cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/3742262595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 msgr2=0x55de56d21280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d21280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80114f0 tx=0x7fa9d80119b0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/3742262595 shutdown_connections 2024-09-19T09:19:16.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d21280 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/3742262595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d0b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/3742262595 >> 172.21.15.46:0/3742262595 conn(0x55de56d07a30 msgr2=0x55de56d07e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/3742262595 shutdown_connections 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/3742262595 wait complete. 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9e37fe640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9cc0a3240 0x7fa9cc0a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc005fd0 tx=0x7fa9dc0096e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 -- start start 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.969+0000 7fa9ebb9a740 1 Processor -- start 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d1e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d1c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55de56d21a00 con 0x55de56d1ee90 2024-09-19T09:19:16.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55de56c2c050 con 0x55de56d0bce0 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55de56d21b80 con 0x55de56d0b3c0 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9ebb9a740 10 client.0 _ll_register_callbacks cb 0x55de56c6c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d1c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d1c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50482/0 (socket says 172.21.15.46:50482) 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e37fe640 1 -- 172.21.15.46:0/4188246269 learned_addr learned my addr 172.21.15.46:0/4188246269 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d1e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 msgr2=0x55de56d1bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/4188246269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 msgr2=0x55de56d1c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d1c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/4188246269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de569e23c0 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.970+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d1e820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40edbd0 tx=0x7fa9d40b8a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5764334b8937d690 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/4188246269 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40bc0c0 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/4188246269 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa9d4003800 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d80035f0 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/4188246269 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9d40044e0 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9ebb9a740 10 client.25258 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.971+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de56d21a00 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/4188246269 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d40bce60 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/4188246269 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa9d40bc9c0 con 0x55de56d0b3c0 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9ebb9a740 10 client.25258 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:16.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9ebb9a740 10 client.25258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9ebb9a740 20 client.25258 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d2e8e0 0x55de56d30d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9ebb9a740 4 client.25258 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa9d80035f0 con 0x55de56d2e8e0 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.972+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d2e8e0 0x55de56d30d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.973+0000 7fa9c6ff5640 10 client.25258 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:16.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.973+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d2e8e0 0x55de56d30d00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdec1f28ba36d373 server_cookie=ba0fb4ed5222a132 in_seq=0 out_seq=0 2024-09-19T09:19:16.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.973+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/4188246269 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa9d80035f0 con 0x55de56d2e8e0 2024-09-19T09:19:16.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.973+0000 7fa9c6ff5640 10 client.25258 handle_command_reply: tid=0 2024-09-19T09:19:16.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.973+0000 7fa9ebb9a740 1 client.25258 shutdown 2024-09-19T09:19:16.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 msgr2=0x55de56d1e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d1e820 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40edbd0 tx=0x7fa9d40b8a00 comp rx=0 tx=0).stop 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 shutdown_connections 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d2e8e0 0x55de56d30d00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d1ee90 0x55de56d1c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d0bce0 0x55de56d1bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/4188246269 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d1e820 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 >> 172.21.15.46:0/4188246269 conn(0x55de56d07a30 msgr2=0x55de56d0d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9c6ff5640 0 client.25258 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:16.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 shutdown_connections 2024-09-19T09:19:16.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/4188246269 wait complete. 2024-09-19T09:19:16.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:16.974+0000 7fa9ebb9a740 20 client.25258 trim_cache size 0 max 16384 2024-09-19T09:19:17.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.008+0000 7fa9ebb9a740 1 Processor -- start 2024-09-19T09:19:17.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.008+0000 7fa9ebb9a740 1 -- start start 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 0x55de56d2ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0bce0 0x55de56d36610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d36b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 0x55de56d2ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 0x55de56d2ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50492/0 (socket says 172.21.15.46:50492) 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d000e230 con 0x55de56d0b3c0 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/319287776 learned_addr learned my addr 172.21.15.46:0/319287776 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d000fd70 con 0x55de56d1ee90 2024-09-19T09:19:17.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d000e900 con 0x55de56d0bce0 2024-09-19T09:19:17.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0bce0 0x55de56d36610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.009+0000 7fa9e37fe640 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d36b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/319287776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0bce0 msgr2=0x55de56d36610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:17.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0bce0 0x55de56d36610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/319287776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 msgr2=0x55de56d36b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d36b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/319287776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de56d1a020 con 0x55de56d0b3c0 2024-09-19T09:19:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 0x55de56d2ad30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9d403b4d0 tx=0x7fa9d40bac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dfd2ece7a5b9bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9c8ff9640 1 -- 172.21.15.46:0/319287776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40bc0c0 con 0x55de56d0b3c0 2024-09-19T09:19:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9c8ff9640 1 -- 172.21.15.46:0/319287776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d40bce60 con 0x55de56d0b3c0 2024-09-19T09:19:17.013 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.010+0000 7fa9c8ff9640 1 -- 172.21.15.46:0/319287776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40b8f60 con 0x55de56d0b3c0 2024-09-19T09:19:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 msgr2=0x55de56d2ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 0x55de56d2ad30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9d403b4d0 tx=0x7fa9d40bac70 comp rx=0 tx=0).stop 2024-09-19T09:19:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 shutdown_connections 2024-09-19T09:19:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d36b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0bce0 0x55de56d36610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/319287776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0b3c0 0x55de56d2ad30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 >> 172.21.15.46:0/319287776 conn(0x55de56d07a30 msgr2=0x55de56d17110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.011+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 shutdown_connections 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.012+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/319287776 wait complete. 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.012+0000 7fa9ebb9a740 1 -- start start 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.012+0000 7fa9ebb9a740 1 Processor -- start 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0bce0 0x55de56d226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d22c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d000f6a0 con 0x55de56d0bce0 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d000efd0 con 0x55de56d1ee90 2024-09-19T09:19:17.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d000c1f0 con 0x55de56d0b3c0 2024-09-19T09:19:17.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9ebb9a740 10 client.0 _ll_register_callbacks cb 0x7fa9d4005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:17.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0bce0 0x55de56d226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0bce0 0x55de56d226e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50508/0 (socket says 172.21.15.46:50508) 2024-09-19T09:19:17.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e27fc640 1 -- 172.21.15.46:0/2890953125 learned_addr learned my addr 172.21.15.46:0/2890953125 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:17.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.017 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e37fe640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d22c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 msgr2=0x55de56d22c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d22c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/2890953125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0bce0 msgr2=0x55de56d226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0bce0 0x55de56d226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.013+0000 7fa9e2ffd640 1 -- 172.21.15.46:0/2890953125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de56d231e0 con 0x55de56d0b3c0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9e2ffd640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d273b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000c00 tx=0x7fa9d40b9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c100b2c925d0983 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9c6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/2890953125 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40bc0c0 con 0x55de56d0b3c0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/2890953125 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa9d40bbbb0 con 0x55de56d0b3c0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d40bce60 con 0x55de56d0b3c0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/2890953125 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa9d40b8a00 con 0x55de56d0b3c0 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9ebb9a740 10 client.25261 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:17.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55de56d231e0 con 0x55de56d0b3c0 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.014+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/2890953125 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9d40c0b10 con 0x55de56d0b3c0 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/2890953125 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa9d40a5ab0 con 0x55de56d0b3c0 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9ebb9a740 10 client.25261 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9ebb9a740 10 client.25261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9ebb9a740 20 client.25261 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d99710 0x55de56d9bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9ebb9a740 4 client.25261 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa9d40bce60 con 0x55de56d99710 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.015+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d99710 0x55de56d9bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9e27fc640 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d99710 0x55de56d9bb00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb635377fe88faf server_cookie=fa1be81993d9f68e in_seq=0 out_seq=0 2024-09-19T09:19:17.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9c6ff5640 10 client.25261 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9c6ff5640 1 -- 172.21.15.46:0/2890953125 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fa9d40bce60 con 0x55de56d99710 2024-09-19T09:19:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9c6ff5640 10 client.25261 handle_command_reply: tid=0 2024-09-19T09:19:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 client.25261 shutdown 2024-09-19T09:19:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 msgr2=0x55de56d273b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d273b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000c00 tx=0x7fa9d40b9000 comp rx=0 tx=0).stop 2024-09-19T09:19:17.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 shutdown_connections 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55de56d99710 0x55de56d9bb00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55de56d0bce0 0x55de56d226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55de56d1ee90 0x55de56d22c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 --2- 172.21.15.46:0/2890953125 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55de56d0b3c0 0x55de56d273b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 >> 172.21.15.46:0/2890953125 conn(0x55de56d07a30 msgr2=0x55de56d1a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9c6ff5640 0 client.25261 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 shutdown_connections 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.016+0000 7fa9ebb9a740 1 -- 172.21.15.46:0/2890953125 wait complete. 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.017+0000 7fa9ebb9a740 20 client.25261 trim_cache size 0 max 16384 2024-09-19T09:19:17.021 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: "6c436159-f987-4220-9998-00549f414d14": { 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "6c436159-f987-4220-9998-00549f414d14", 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:17.022 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.017+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9cc0a3240 msgr2=0x7fa9cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.017+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9cc0a3240 0x7fa9cc0a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc005fd0 tx=0x7fa9dc0096e0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.017+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 msgr2=0x7fa9e40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.017+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e40744f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4006010 tx=0x7fa9d40042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 shutdown_connections 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa9cc0a3240 0x7fa9cc0a5700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9e4106f20 0x7fa9e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa9e41027a0 0x7fa9e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 --2- 172.21.15.46:0/3513531713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9e4101df0 0x7fa9e40744f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 >> 172.21.15.46:0/3513531713 conn(0x7fa9e40fd8f0 msgr2=0x7fa9e40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 shutdown_connections 2024-09-19T09:19:17.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:17.018+0000 7fa9e97c1640 1 -- 172.21.15.46:0/3513531713 wait complete. 2024-09-19T09:19:17.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:16 smithi115 ceph-mon[35055]: pgmap v367: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 766 B/s wr, 10 op/s 2024-09-19T09:19:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:16 smithi046 ceph-mon[31203]: pgmap v367: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 766 B/s wr, 10 op/s 2024-09-19T09:19:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:16 smithi099 ceph-mon[35256]: pgmap v367: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 766 B/s wr, 10 op/s 2024-09-19T09:19:17.717 INFO:tasks.cephfs.filesystem:scrub status for tag:6c436159-f987-4220-9998-00549f414d14 - {'path': '/', 'tag': '6c436159-f987-4220-9998-00549f414d14', 'options': 'recursive,force'} 2024-09-19T09:19:18.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:17 smithi115 ceph-mon[35055]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-09-19T09:19:18.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:17 smithi046 ceph-mon[31203]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-09-19T09:19:18.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:17 smithi099 ceph-mon[35256]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-09-19T09:19:20.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:20 smithi115 ceph-mon[35055]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 681 B/s wr, 10 op/s 2024-09-19T09:19:20.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:20 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:19:20.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:20 smithi046 ceph-mon[31203]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 681 B/s wr, 10 op/s 2024-09-19T09:19:20.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:20 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:19:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:20 smithi099 ceph-mon[35256]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 681 B/s wr, 10 op/s 2024-09-19T09:19:20.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:20 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:19:22.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:22 smithi115 ceph-mon[35055]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 13 op/s 2024-09-19T09:19:22.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:22 smithi046 ceph-mon[31203]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 13 op/s 2024-09-19T09:19:22.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:22 smithi099 ceph-mon[35256]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 852 B/s wr, 13 op/s 2024-09-19T09:19:24.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:24 smithi115 ceph-mon[35055]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 852 B/s wr, 13 op/s 2024-09-19T09:19:24.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:24 smithi046 ceph-mon[31203]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 852 B/s wr, 13 op/s 2024-09-19T09:19:24.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:24 smithi099 ceph-mon[35256]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 852 B/s wr, 13 op/s 2024-09-19T09:19:26.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:26 smithi115 ceph-mon[35055]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 851 B/s wr, 12 op/s 2024-09-19T09:19:26.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:26 smithi046 ceph-mon[31203]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 851 B/s wr, 12 op/s 2024-09-19T09:19:26.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:26 smithi099 ceph-mon[35256]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 851 B/s wr, 12 op/s 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.127+0000 7ff96516d640 1 -- 172.21.15.46:0/1681336039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960102620 msgr2=0x7ff960104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 --2- 172.21.15.46:0/1681336039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960102620 0x7ff960104a10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff950009900 tx=0x7ff95002a410 comp rx=0 tx=0).stop 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 -- 172.21.15.46:0/1681336039 shutdown_connections 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 --2- 172.21.15.46:0/1681336039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff960107880 0x7ff960109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 --2- 172.21.15.46:0/1681336039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960104f50 0x7ff960107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 --2- 172.21.15.46:0/1681336039 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960102620 0x7ff960104a10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 -- 172.21.15.46:0/1681336039 >> 172.21.15.46:0/1681336039 conn(0x7ff9600fc1e0 msgr2=0x7ff9600fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 -- 172.21.15.46:0/1681336039 shutdown_connections 2024-09-19T09:19:28.130 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.128+0000 7ff96516d640 1 -- 172.21.15.46:0/1681336039 wait complete. 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 Processor -- start 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 -- start start 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 0x7ff960195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960107880 0x7ff9601963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9601a3be0 0x7ff9601a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff96010d830 con 0x7ff960104f50 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff96010d6b0 con 0x7ff9601a3be0 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff96516d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff96010d9b0 con 0x7ff960107880 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff95ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 0x7ff960195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff95e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960107880 0x7ff9601963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.133 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff95ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 0x7ff960195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57588/0 (socket says 172.21.15.46:57588) 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.129+0000 7ff95ed9d640 1 -- 172.21.15.46:0/2480466909 learned_addr learned my addr 172.21.15.46:0/2480466909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95f59e640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9601a3be0 0x7ff9601a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95ed9d640 1 -- 172.21.15.46:0/2480466909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960107880 msgr2=0x7ff9601963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95ed9d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960107880 0x7ff9601963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95ed9d640 1 -- 172.21.15.46:0/2480466909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9601a3be0 msgr2=0x7ff9601a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95ed9d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9601a3be0 0x7ff9601a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95ed9d640 1 -- 172.21.15.46:0/2480466909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9601a6670 con 0x7ff960104f50 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95e59c640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960107880 0x7ff9601963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95f59e640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9601a3be0 0x7ff9601a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff95ed9d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 0x7ff960195e60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff950009230 tx=0x7ff950031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.130+0000 7ff947fff640 1 -- 172.21.15.46:0/2480466909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95003f030 con 0x7ff960104f50 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.131+0000 7ff947fff640 1 -- 172.21.15.46:0/2480466909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff950003ad0 con 0x7ff960104f50 2024-09-19T09:19:28.134 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.131+0000 7ff947fff640 1 -- 172.21.15.46:0/2480466909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff950035070 con 0x7ff960104f50 2024-09-19T09:19:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.131+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9601a6900 con 0x7ff960104f50 2024-09-19T09:19:28.135 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.131+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9601a6da0 con 0x7ff960104f50 2024-09-19T09:19:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff967fe7740 1 Processor -- start 2024-09-19T09:19:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff967fe7740 1 -- start start 2024-09-19T09:19:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff947fff640 1 -- 172.21.15.46:0/2480466909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff950042030 con 0x7ff960104f50 2024-09-19T09:19:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x55738998ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x55738998fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.137 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x557389992830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff967fe7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5573898ee2f0 con 0x557389990370 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff95f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x55738998ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.134+0000 7ff95f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x55738998ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:46838/0 (socket says 172.21.15.46:46838) 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557389896270 con 0x55738998a9a0 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 -- 172.21.15.46:0/504347974 learned_addr learned my addr 172.21.15.46:0/504347974 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5573898ea2b0 con 0x55738998b2e0 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95e59c640 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x557389992830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95ed9d640 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x55738998fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 -- 172.21.15.46:0/504347974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 msgr2=0x55738998fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x55738998fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 -- 172.21.15.46:0/504347974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 msgr2=0x557389992830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x557389992830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.138 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 -- 172.21.15.46:0/504347974 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557389895340 con 0x55738998a9a0 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95f59e640 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x55738998ada0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff958010480 tx=0x7ff958009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1a35e1e9278dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff947fff640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff9480a3370 0x7ff9480a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff95ed9d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff9480a3370 0x7ff9480a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.135+0000 7ff9457fa640 1 -- 172.21.15.46:0/504347974 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958011700 con 0x55738998a9a0 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff9457fa640 1 -- 172.21.15.46:0/504347974 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff958011d80 con 0x55738998a9a0 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff9457fa640 1 -- 172.21.15.46:0/504347974 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95801a380 con 0x55738998a9a0 2024-09-19T09:19:28.139 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff947fff640 1 -- 172.21.15.46:0/2480466909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff9500efa00 con 0x7ff960104f50 2024-09-19T09:19:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 msgr2=0x55738998ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.144 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff95ed9d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff9480a3370 0x7ff9480a5830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff9500ed8a0 tx=0x7ff950009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x55738998ada0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff958010480 tx=0x7ff958009f90 comp rx=0 tx=0).stop 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 shutdown_connections 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x557389992830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x55738998fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 --2- 172.21.15.46:0/504347974 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x55738998ada0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.136+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 >> 172.21.15.46:0/504347974 conn(0x557389986010 msgr2=0x557389986410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 shutdown_connections 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 -- 172.21.15.46:0/504347974 wait complete. 2024-09-19T09:19:28.145 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 -- start start 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 Processor -- start 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x557389994c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389995160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x55738999c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557389993340 con 0x557389990370 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557389877290 con 0x55738998a9a0 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.137+0000 7ff967fe7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5573899934c0 con 0x55738998b2e0 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff967fe7740 10 client.0 _ll_register_callbacks cb 0x5573898a8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x557389994c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x557389994c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:46842/0 (socket says 172.21.15.46:46842) 2024-09-19T09:19:28.146 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 -- 172.21.15.46:0/1796647143 learned_addr learned my addr 172.21.15.46:0/1796647143 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x55738999c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95e59c640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389995160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.147 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 -- 172.21.15.46:0/1796647143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 msgr2=0x557389995160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389995160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 -- 172.21.15.46:0/1796647143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 msgr2=0x55738999c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x55738999c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 -- 172.21.15.46:0/1796647143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557389601210 con 0x55738998a9a0 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff95f59e640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x557389994c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff958010d10 tx=0x7ff958013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eddf28b5f45aacbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff942ff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff942ff5640 1 -- 172.21.15.46:0/1796647143 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958011940 con 0x55738998a9a0 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff958011d80 con 0x55738998a9a0 2024-09-19T09:19:28.148 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.138+0000 7ff942ff5640 1 -- 172.21.15.46:0/1796647143 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff958011ae0 con 0x55738998a9a0 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff942ff5640 1 -- 172.21.15.46:0/1796647143 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff958033070 con 0x55738998a9a0 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff967fe7740 10 client.25292 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5573896cd620 con 0x55738998a9a0 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff942ff5640 1 -- 172.21.15.46:0/1796647143 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff958011d80 con 0x55738998a9a0 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff942ff5640 1 -- 172.21.15.46:0/1796647143 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff95802a020 con 0x55738998a9a0 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff967fe7740 10 client.25292 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff967fe7740 10 client.25292 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff967fe7740 20 client.25292 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.139+0000 7ff967fe7740 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x5573899a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.149 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.140+0000 7ff967fe7740 4 client.25292 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.140+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573898fba20 con 0x5573899a06b0 2024-09-19T09:19:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.140+0000 7ff95e59c640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x5573899a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.140+0000 7ff942ff5640 10 client.25292 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:28.150 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.140+0000 7ff95e59c640 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x5573899a2aa0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b528778412dddf2b server_cookie=8cc169fea9283afd in_seq=0 out_seq=0 2024-09-19T09:19:28.151 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff942ff5640 1 -- 172.21.15.46:0/1796647143 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573898fba20 con 0x5573899a06b0 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff942ff5640 10 client.25292 handle_command_reply: tid=0 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 client.25292 shutdown 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 msgr2=0x557389994c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x557389994c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff958010d10 tx=0x7ff958013040 comp rx=0 tx=0).stop 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 shutdown_connections 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x5573899a2aa0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557389990370 0x55738999c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff942ff5640 0 client.25292 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:28.153 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389995160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 --2- 172.21.15.46:0/1796647143 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55738998a9a0 0x557389994c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 >> 172.21.15.46:0/1796647143 conn(0x557389986010 msgr2=0x557389987820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 shutdown_connections 2024-09-19T09:19:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.141+0000 7ff967fe7740 1 -- 172.21.15.46:0/1796647143 wait complete. 2024-09-19T09:19:28.154 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.142+0000 7ff967fe7740 20 client.25292 trim_cache size 0 max 16384 2024-09-19T09:19:28.171 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.169+0000 7ff967fe7740 1 Processor -- start 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.169+0000 7ff967fe7740 1 -- start start 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.169+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998a9a0 0x5573899859b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.169+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 0x55738999c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x5573899875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff967fe7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601afb30 con 0x55738998b2e0 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff967fe7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601b1670 con 0x557389990370 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff967fe7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601b0200 con 0x55738998a9a0 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 0x55738999c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 0x55738999c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57618/0 (socket says 172.21.15.46:57618) 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95e59c640 1 -- 172.21.15.46:0/3916299374 learned_addr learned my addr 172.21.15.46:0/3916299374 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998a9a0 0x5573899859b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.172 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 -- 172.21.15.46:0/3916299374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 msgr2=0x5573899875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x5573899875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 -- 172.21.15.46:0/3916299374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 msgr2=0x55738999c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 0x55738999c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 -- 172.21.15.46:0/3916299374 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557389986ca0 con 0x55738998a9a0 2024-09-19T09:19:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95e59c640 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 0x55738999c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:28.173 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff95f59e640 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998a9a0 0x5573899859b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557389994150 tx=0x7ff958009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9820b68cb7124e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.170+0000 7ff944ff9640 1 -- 172.21.15.46:0/3916299374 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95801e480 con 0x55738998a9a0 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff944ff9640 1 -- 172.21.15.46:0/3916299374 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff958009a30 con 0x55738998a9a0 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff944ff9640 1 -- 172.21.15.46:0/3916299374 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958011ba0 con 0x55738998a9a0 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff967fe7740 1 -- 172.21.15.46:0/3916299374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998a9a0 msgr2=0x5573899859b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff967fe7740 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998a9a0 0x5573899859b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x557389994150 tx=0x7ff958009610 comp rx=0 tx=0).stop 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff967fe7740 1 -- 172.21.15.46:0/3916299374 shutdown_connections 2024-09-19T09:19:28.177 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff967fe7740 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998b2e0 0x55738999c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff967fe7740 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x5573899875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.171+0000 7ff967fe7740 1 --2- 172.21.15.46:0/3916299374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998a9a0 0x5573899859b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.172+0000 7ff967fe7740 1 -- 172.21.15.46:0/3916299374 >> 172.21.15.46:0/3916299374 conn(0x557389986010 msgr2=0x557389986ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.172+0000 7ff967fe7740 1 -- 172.21.15.46:0/3916299374 shutdown_connections 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.172+0000 7ff967fe7740 1 -- 172.21.15.46:0/3916299374 wait complete. 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.172+0000 7ff967fe7740 1 -- start start 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.172+0000 7ff967fe7740 1 Processor -- start 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 0x5573899994d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389999a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x55738999aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601b0fa0 con 0x55738998a9a0 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601b08d0 con 0x557389990370 2024-09-19T09:19:28.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff9601adb10 con 0x55738998b2e0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff967fe7740 10 client.0 _ll_register_callbacks cb 0x7ff958009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 0x5573899994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 0x5573899994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57628/0 (socket says 172.21.15.46:57628) 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 -- 172.21.15.46:0/507263712 learned_addr learned my addr 172.21.15.46:0/507263712 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95e59c640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389999a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x55738999aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 -- 172.21.15.46:0/507263712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 msgr2=0x557389999a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389999a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 -- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 msgr2=0x55738999aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x55738999aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 -- 172.21.15.46:0/507263712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55738999b030 con 0x55738998a9a0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff95f59e640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 0x5573899994d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff9580092f0 tx=0x7ff95801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194a41f3cf374820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff942ff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.173+0000 7ff942ff5640 1 -- 172.21.15.46:0/507263712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff958048060 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.174+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff958009a30 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.174+0000 7ff942ff5640 1 -- 172.21.15.46:0/507263712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff958011e00 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.174+0000 7ff942ff5640 1 -- 172.21.15.46:0/507263712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff95801e280 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.174+0000 7ff967fe7740 10 client.15711 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.174+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55738999c340 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.174+0000 7ff942ff5640 1 -- 172.21.15.46:0/507263712 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff958009a30 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff942ff5640 1 -- 172.21.15.46:0/507263712 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff95802a040 con 0x55738998a9a0 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff967fe7740 10 client.15711 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff967fe7740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff967fe7740 20 client.15711 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:28.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff967fe7740 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x557389a0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff967fe7740 4 client.15711 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:19:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573898f5d70 con 0x5573899a06b0 2024-09-19T09:19:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff95e59c640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x557389a0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff95e59c640 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x557389a0d8d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81fdb9c6696a561d server_cookie=b4f53dc6cd837755 in_seq=0 out_seq=0 2024-09-19T09:19:28.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.175+0000 7ff942ff5640 10 client.15711 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff942ff5640 1 -- 172.21.15.46:0/507263712 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5573898f5d70 con 0x5573899a06b0 2024-09-19T09:19:28.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff942ff5640 10 client.15711 handle_command_reply: tid=0 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 client.15711 shutdown 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 msgr2=0x5573899994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 0x5573899994d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff9580092f0 tx=0x7ff95801cc30 comp rx=0 tx=0).stop 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 shutdown_connections 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5573899a06b0 0x557389a0d8d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff942ff5640 0 client.15711 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557389990370 0x55738999aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55738998b2e0 0x557389999a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 --2- 172.21.15.46:0/507263712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55738998a9a0 0x5573899994d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 >> 172.21.15.46:0/507263712 conn(0x557389986010 msgr2=0x557389987690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 shutdown_connections 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 1 -- 172.21.15.46:0/507263712 wait complete. 2024-09-19T09:19:28.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.179+0000 7ff967fe7740 20 client.15711 trim_cache size 0 max 16384 2024-09-19T09:19:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:19:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:19:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:19:28.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff9480a3370 msgr2=0x7ff9480a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff9480a3370 0x7ff9480a5830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff9500ed8a0 tx=0x7ff950009260 comp rx=0 tx=0).stop 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 msgr2=0x7ff960195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 0x7ff960195e60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff950009230 tx=0x7ff950031b60 comp rx=0 tx=0).stop 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 shutdown_connections 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff9480a3370 0x7ff9480a5830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9601a3be0 0x7ff9601a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff960107880 0x7ff9601963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 --2- 172.21.15.46:0/2480466909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff960104f50 0x7ff960195e60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 >> 172.21.15.46:0/2480466909 conn(0x7ff9600fc1e0 msgr2=0x7ff960101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 shutdown_connections 2024-09-19T09:19:28.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:28.180+0000 7ff96516d640 1 -- 172.21.15.46:0/2480466909 wait complete. 2024-09-19T09:19:28.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:28 smithi115 ceph-mon[35055]: pgmap v373: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:19:28.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:28 smithi046 ceph-mon[31203]: pgmap v373: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:19:28.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:28 smithi099 ceph-mon[35256]: pgmap v373: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T09:19:30.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:30 smithi115 ceph-mon[35055]: pgmap v374: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:19:30.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:30 smithi046 ceph-mon[31203]: pgmap v374: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:19:30.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:30 smithi099 ceph-mon[35256]: pgmap v374: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T09:19:32.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:32 smithi115 ceph-mon[35055]: pgmap v375: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:19:32.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:32 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:32.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:32 smithi046 ceph-mon[31203]: pgmap v375: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:19:32.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:32 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:32.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:32 smithi099 ceph-mon[35256]: pgmap v375: 97 pgs: 97 active+clean; 668 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T09:19:32.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:32 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:19:33.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:33.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:33.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:33.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:33.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:33.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:19:33.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:19:33.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:19:35.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:34 smithi115 ceph-mon[35055]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:19:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:34 smithi046 ceph-mon[31203]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:19:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:34 smithi099 ceph-mon[35256]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:19:35.925 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 94% (12158/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:19:36.885 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:19:36.885 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.886 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-09-19T09:19:36.887 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.887 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-09-19T09:19:36.887 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.887 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:19:36.887 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:19:36.887 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:19:36.891 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:19:36.956 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:19:36.958 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:19:36.958 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:19:37.178 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:19:37.179 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:19:37.179 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:37.202 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:36 smithi046 ceph-mon[31203]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:19:37.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:36 smithi115 ceph-mon[35055]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:19:37.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:36 smithi099 ceph-mon[35256]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:38.148 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:19:38.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 -- 172.21.15.46:0/1312683340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 msgr2=0x7f3efc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 --2- 172.21.15.46:0/1312683340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc103110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009930 tx=0x7f3eec02a420 comp rx=0 tx=0).stop 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 -- 172.21.15.46:0/1312683340 shutdown_connections 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 --2- 172.21.15.46:0/1312683340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3efc1082a0 0x7f3efc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 --2- 172.21.15.46:0/1312683340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc1036e0 0x7f3efc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 --2- 172.21.15.46:0/1312683340 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc103110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 -- 172.21.15.46:0/1312683340 >> 172.21.15.46:0/1312683340 conn(0x7f3efc0fc7d0 msgr2=0x7f3efc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 -- 172.21.15.46:0/1312683340 shutdown_connections 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 -- 172.21.15.46:0/1312683340 wait complete. 2024-09-19T09:19:38.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.161+0000 7f3f02409640 1 Processor -- start 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 -- start start 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3efc1036e0 0x7f3efc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc1082a0 0x7f3efc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc1120a0 con 0x7f3efc102d30 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc111f20 con 0x7f3efc1036e0 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3f02409640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc112220 con 0x7f3efc1082a0 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3efbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3efbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46064/0 (socket says 172.21.15.46:46064) 2024-09-19T09:19:38.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3efbfff640 1 -- 172.21.15.46:0/1704965402 learned_addr learned my addr 172.21.15.46:0/1704965402 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.162+0000 7f3efb7fe640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3efc1036e0 0x7f3efc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3f009a6640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc1082a0 0x7f3efc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3efbfff640 1 -- 172.21.15.46:0/1704965402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc1082a0 msgr2=0x7f3efc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3efbfff640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc1082a0 0x7f3efc101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3efbfff640 1 -- 172.21.15.46:0/1704965402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3efc1036e0 msgr2=0x7f3efc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3efbfff640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3efc1036e0 0x7f3efc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3efbfff640 1 -- 172.21.15.46:0/1704965402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc1a6a30 con 0x7f3efc102d30 2024-09-19T09:19:38.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3efbfff640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc100990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009230 tx=0x7f3eec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec03f030 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3eec003ad0 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc1a6cc0 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec035070 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.163+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc1a71a0 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.165+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc103110 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.166+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3eec042030 con 0x7f3efc102d30 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.167+0000 7f3ef97fa640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ee40a32c0 0x7f3ee40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.167+0000 7f3efb7fe640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ee40a32c0 0x7f3ee40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.167+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3eec0efd30 con 0x7f3efc102d30 2024-09-19T09:19:38.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.167+0000 7f3efb7fe640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ee40a32c0 0x7f3ee40a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3efc102420 tx=0x7f3ef000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.172+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3eec0bca80 con 0x7f3efc102d30 2024-09-19T09:19:38.239 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:19:38.280 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:19:38.282 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:19:38.282 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:19:38.323 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:19:38.327 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:19:38.327 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:19:38.384 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-09-19T09:19:38.385 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-09-19T09:19:38.385 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-09-19T09:19:38.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.384+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3efc10a2b0 con 0x7f3efc102d30 2024-09-19T09:19:38.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.385+0000 7f3ef97fa640 1 -- 172.21.15.46:0/1704965402 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f3eec0bc380 con 0x7f3efc102d30 2024-09-19T09:19:38.387 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:19:38.387 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-19T09:18:14:805968+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:18:14.470841+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:19:38.387 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ee40a32c0 msgr2=0x7f3ee40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ee40a32c0 0x7f3ee40a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3efc102420 tx=0x7f3ef000b390 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 msgr2=0x7f3efc100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc100990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009230 tx=0x7f3eec004270 comp rx=0 tx=0).stop 2024-09-19T09:19:38.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 shutdown_connections 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ee40a32c0 0x7f3ee40a5780 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3efc1082a0 0x7f3efc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3efc1036e0 0x7f3efc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 --2- 172.21.15.46:0/1704965402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3efc102d30 0x7f3efc100990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 >> 172.21.15.46:0/1704965402 conn(0x7f3efc0fc7d0 msgr2=0x7f3efc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 shutdown_connections 2024-09-19T09:19:38.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:38.387+0000 7f3f02409640 1 -- 172.21.15.46:0/1704965402 wait complete. 2024-09-19T09:19:38.411 INFO:tasks.workunit.client.0.smithi046.stderr:+ set -e 2024-09-19T09:19:38.411 INFO:tasks.workunit.client.0.smithi046.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-09-19T09:19:38.413 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into 'xfstests-dev'... 2024-09-19T09:19:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:38 smithi046 ceph-mon[31203]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:19:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:38 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1704965402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:39.153 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:19:39.154 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:19:39.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:38 smithi115 ceph-mon[35055]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:19:39.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:38 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1704965402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:38 smithi099 ceph-mon[35256]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T09:19:39.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:38 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1704965402' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:39.450 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 -- 172.21.15.46:0/3949920609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 msgr2=0x7f5e7010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/3949920609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e7010ec40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009cd0 tx=0x7f5e6802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 -- 172.21.15.46:0/3949920609 shutdown_connections 2024-09-19T09:19:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/3949920609 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e7010ec40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/3949920609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e701036e0 0x7f5e70107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/3949920609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e70102d30 0x7f5e70103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.934+0000 7f5e77a9c640 1 -- 172.21.15.46:0/3949920609 >> 172.21.15.46:0/3949920609 conn(0x7f5e700fc7d0 msgr2=0x7f5e700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.935+0000 7f5e77a9c640 1 -- 172.21.15.46:0/3949920609 shutdown_connections 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.935+0000 7f5e77a9c640 1 -- 172.21.15.46:0/3949920609 wait complete. 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.935+0000 7f5e77a9c640 1 Processor -- start 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.935+0000 7f5e77a9c640 1 -- start start 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.935+0000 7f5e77a9c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e70102d30 0x7f5e70100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e77a9c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e701036e0 0x7f5e70100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e77a9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e70101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e77a9c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701120a0 con 0x7f5e701082a0 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e77a9c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5e70111f20 con 0x7f5e701036e0 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e77a9c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5e70112220 con 0x7f5e70102d30 2024-09-19T09:19:39.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e70101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e70101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53326/0 (socket says 172.21.15.46:53326) 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 -- 172.21.15.46:0/2831589712 learned_addr learned my addr 172.21.15.46:0/2831589712 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e75838640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e70102d30 0x7f5e70100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e75037640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e701036e0 0x7f5e70100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 -- 172.21.15.46:0/2831589712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e70102d30 msgr2=0x7f5e70100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e70102d30 0x7f5e70100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 -- 172.21.15.46:0/2831589712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e701036e0 msgr2=0x7f5e70100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e701036e0 0x7f5e70100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 -- 172.21.15.46:0/2831589712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e701a69f0 con 0x7f5e701082a0 2024-09-19T09:19:39.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.936+0000 7f5e76039640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e70101410 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e68005cc0 tx=0x7f5e680093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.937+0000 7f5e66ffd640 1 -- 172.21.15.46:0/2831589712 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68003e00 con 0x7f5e701082a0 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.937+0000 7f5e66ffd640 1 -- 172.21.15.46:0/2831589712 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e68004520 con 0x7f5e701082a0 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.937+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e701a6c80 con 0x7f5e701082a0 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.937+0000 7f5e66ffd640 1 -- 172.21.15.46:0/2831589712 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68030db0 con 0x7f5e701082a0 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.937+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e701a7210 con 0x7f5e701082a0 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.939+0000 7f5e66ffd640 1 -- 172.21.15.46:0/2831589712 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5e680046d0 con 0x7f5e701082a0 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 Processor -- start 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 -- start start 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfae850 0x5565bbfaec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfb94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 0x5565bbfbbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5565bbf13160 con 0x5565bbfb9a30 2024-09-19T09:19:39.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5565bbeba720 con 0x5565bbfaf170 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.940+0000 7f5e79e75740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5565bbf0f120 con 0x5565bbfae850 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 0x5565bbfbbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 0x5565bbfbbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53332/0 (socket says 172.21.15.46:53332) 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 -- 172.21.15.46:0/2505299511 learned_addr learned my addr 172.21.15.46:0/2505299511 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e66ffd640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5e5c0a32c0 0x7f5e5c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75838640 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfb94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfae850 0x5565bbfaec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e76039640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5e5c0a32c0 0x7f5e5c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 -- 172.21.15.46:0/2505299511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfae850 msgr2=0x5565bbfaec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfae850 0x5565bbfaec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 -- 172.21.15.46:0/2505299511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 msgr2=0x5565bbfb94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfb94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 -- 172.21.15.46:0/2505299511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bbc84ba0 con 0x5565bbfb9a30 2024-09-19T09:19:39.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e66ffd640 1 -- 172.21.15.46:0/2831589712 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5e6802e030 con 0x7f5e701082a0 2024-09-19T09:19:39.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.941+0000 7f5e75037640 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 0x5565bbfbbe20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009f00 tx=0x7f5e600096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471d2b7cfbb0d8ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e5bfff640 1 -- 172.21.15.46:0/2505299511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6001a030 con 0x5565bbfb9a30 2024-09-19T09:19:39.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e76039640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5e5c0a32c0 0x7f5e5c0a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009ca0 tx=0x7f5e680e8400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e5bfff640 1 -- 172.21.15.46:0/2505299511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e60012e60 con 0x5565bbfb9a30 2024-09-19T09:19:39.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e5bfff640 1 -- 172.21.15.46:0/2505299511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60003be0 con 0x5565bbfb9a30 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e79e75740 1 -- 172.21.15.46:0/2505299511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 msgr2=0x5565bbfbbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e79e75740 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 0x5565bbfbbe20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009f00 tx=0x7f5e600096c0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.942+0000 7f5e79e75740 1 -- 172.21.15.46:0/2505299511 shutdown_connections 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfb9a30 0x5565bbfbbe20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfb94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 --2- 172.21.15.46:0/2505299511 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfae850 0x5565bbfaec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 -- 172.21.15.46:0/2505299511 >> 172.21.15.46:0/2505299511 conn(0x5565bbfaade0 msgr2=0x5565bbfab1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 -- 172.21.15.46:0/2505299511 shutdown_connections 2024-09-19T09:19:39.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 -- 172.21.15.46:0/2505299511 wait complete. 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 -- start start 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.943+0000 7f5e79e75740 1 Processor -- start 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfb6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfb6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfb73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5565bbfbc600 con 0x5565bbfae850 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5565bbe9b900 con 0x5565bbfb9a30 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5565bbfbc780 con 0x5565bbfaf170 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e79e75740 10 client.0 _ll_register_callbacks cb 0x5565bbe99780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfb6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfb6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53346/0 (socket says 172.21.15.46:53346) 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 -- 172.21.15.46:0/4094794187 learned_addr learned my addr 172.21.15.46:0/4094794187 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:39.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75838640 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfb6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 -- 172.21.15.46:0/4094794187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 msgr2=0x5565bbfb6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfb6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 -- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 msgr2=0x5565bbfb73b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.944+0000 7f5e75037640 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfb73b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e75037640 1 -- 172.21.15.46:0/4094794187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bbedbc50 con 0x5565bbfae850 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e75037640 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfb6930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5e60001eb0 tx=0x7f5e60003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de60519f919fecd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e597fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e597fa640 1 -- 172.21.15.46:0/4094794187 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004490 con 0x5565bbfae850 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e597fa640 1 -- 172.21.15.46:0/4094794187 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5e60003d80 con 0x5565bbfae850 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e60012e60 con 0x5565bbfae850 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e597fa640 1 -- 172.21.15.46:0/4094794187 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e60012070 con 0x5565bbfae850 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e79e75740 10 client.15729 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:39.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.945+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5565bbfc8320 con 0x5565bbfae850 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e597fa640 1 -- 172.21.15.46:0/4094794187 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e60012e60 con 0x5565bbfae850 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e597fa640 1 -- 172.21.15.46:0/4094794187 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e6000f040 con 0x5565bbfae850 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e79e75740 10 client.15729 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e79e75740 10 client.15729 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e79e75740 20 client.15729 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e79e75740 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bbfc96d0 0x5565bbfcbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e79e75740 4 client.15729 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565bbf20890 con 0x5565bbfc96d0 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.946+0000 7f5e75838640 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bbfc96d0 0x5565bbfcbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.947+0000 7f5e597fa640 10 client.15729 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.947+0000 7f5e75838640 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bbfc96d0 0x5565bbfcbac0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38435862b9b4ffe server_cookie=be3e5e616855fd04 in_seq=0 out_seq=0 2024-09-19T09:19:39.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.947+0000 7f5e597fa640 1 -- 172.21.15.46:0/4094794187 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565bbf20890 con 0x5565bbfc96d0 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.947+0000 7f5e597fa640 10 client.15729 handle_command_reply: tid=0 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.947+0000 7f5e79e75740 1 client.15729 shutdown 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 msgr2=0x5565bbfb6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfb6930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5e60001eb0 tx=0x7f5e60003b90 comp rx=0 tx=0).stop 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 shutdown_connections 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bbfc96d0 0x5565bbfcbac0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfb73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfb6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 --2- 172.21.15.46:0/4094794187 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfb6930 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e597fa640 0 client.15729 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 >> 172.21.15.46:0/4094794187 conn(0x5565bbfaade0 msgr2=0x5565bbfb0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 shutdown_connections 2024-09-19T09:19:39.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 1 -- 172.21.15.46:0/4094794187 wait complete. 2024-09-19T09:19:39.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.948+0000 7f5e79e75740 20 client.15729 trim_cache size 0 max 16384 2024-09-19T09:19:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 Processor -- start 2024-09-19T09:19:39.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 -- start start 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfd1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfd15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfb9a30 0x5565bbfb3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701af620 con 0x5565bbfae850 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701b1160 con 0x5565bbfaf170 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.965+0000 7f5e79e75740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701afcf0 con 0x5565bbfb9a30 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfd1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75838640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfd15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75838640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfd15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35120/0 (socket says 172.21.15.46:35120) 2024-09-19T09:19:39.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75838640 1 -- 172.21.15.46:0/1505916222 learned_addr learned my addr 172.21.15.46:0/1505916222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfb9a30 0x5565bbfb3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 -- 172.21.15.46:0/1505916222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfb9a30 msgr2=0x5565bbfb3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfb9a30 0x5565bbfb3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 -- 172.21.15.46:0/1505916222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 msgr2=0x5565bbfd15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfd15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 -- 172.21.15.46:0/1505916222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565bbfb58e0 con 0x5565bbfae850 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75838640 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfd15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e75037640 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfd1060 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e600048d0 tx=0x7f5e60004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e755455881261482 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e5b7fe640 1 -- 172.21.15.46:0/1505916222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6001a040 con 0x5565bbfae850 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e5b7fe640 1 -- 172.21.15.46:0/1505916222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e60024020 con 0x5565bbfae850 2024-09-19T09:19:39.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.966+0000 7f5e5b7fe640 1 -- 172.21.15.46:0/1505916222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60003e60 con 0x5565bbfae850 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 -- 172.21.15.46:0/1505916222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 msgr2=0x5565bbfd1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfd1060 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5e600048d0 tx=0x7f5e60004ac0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 -- 172.21.15.46:0/1505916222 shutdown_connections 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfb9a30 0x5565bbfb3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfaf170 0x5565bbfd15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1505916222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfd1060 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 -- 172.21.15.46:0/1505916222 >> 172.21.15.46:0/1505916222 conn(0x5565bbfaade0 msgr2=0x5565bbfb0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 -- 172.21.15.46:0/1505916222 shutdown_connections 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.967+0000 7f5e79e75740 1 -- 172.21.15.46:0/1505916222 wait complete. 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 -- start start 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 Processor -- start 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfbd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfbdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfbe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701b0a90 con 0x5565bbfae850 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701b03c0 con 0x5565bbfb9a30 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5e701ad620 con 0x5565bbfaf170 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e79e75740 10 client.0 _ll_register_callbacks cb 0x7f5e6c009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfbd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e75037640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfbd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53366/0 (socket says 172.21.15.46:53366) 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e75037640 1 -- 172.21.15.46:0/1790571727 learned_addr learned my addr 172.21.15.46:0/1790571727 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e75838640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfbdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.968+0000 7f5e75037640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfbe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e75037640 1 -- 172.21.15.46:0/1790571727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 msgr2=0x5565bbfbdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e75037640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfbdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e75037640 1 -- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 msgr2=0x5565bbfbe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e75037640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfbe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e75037640 1 -- 172.21.15.46:0/1790571727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565bbfaefa0 con 0x5565bbfae850 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e75037640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfbd9c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5e60004e50 tx=0x7f5e60004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28b47fb621c4c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e597fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e597fa640 1 -- 172.21.15.46:0/1790571727 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60009530 con 0x5565bbfae850 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e597fa640 1 -- 172.21.15.46:0/1790571727 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f5e60003b70 con 0x5565bbfae850 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e60024020 con 0x5565bbfae850 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e597fa640 1 -- 172.21.15.46:0/1790571727 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e60003d70 con 0x5565bbfae850 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e79e75740 10 client.15735 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.969+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5565bc034300 con 0x5565bbfae850 2024-09-19T09:19:39.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e597fa640 1 -- 172.21.15.46:0/1790571727 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e60024020 con 0x5565bbfae850 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e597fa640 1 -- 172.21.15.46:0/1790571727 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e60020570 con 0x5565bbfae850 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e79e75740 10 client.15735 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e79e75740 10 client.15735 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e79e75740 20 client.15735 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bc034830 0x5565bc036c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e79e75740 4 client.15735 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5565bbf1abe0 con 0x5565bc034830 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e75838640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bc034830 0x5565bc036c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e75838640 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bc034830 0x5565bc036c20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efafdf3c481644fc server_cookie=44987ae5daf843cc in_seq=0 out_seq=0 2024-09-19T09:19:39.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:39.970+0000 7f5e597fa640 10 client.15735 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e597fa640 1 -- 172.21.15.46:0/1790571727 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5565bbf1abe0 con 0x5565bc034830 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e597fa640 10 client.15735 handle_command_reply: tid=0 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 client.15735 shutdown 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 msgr2=0x5565bbfbd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfbd9c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5e60004e50 tx=0x7f5e60004b50 comp rx=0 tx=0).stop 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 shutdown_connections 2024-09-19T09:19:40.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5565bc034830 0x5565bc036c20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5565bbfb9a30 0x5565bbfbe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5565bbfaf170 0x5565bbfbdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 --2- 172.21.15.46:0/1790571727 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5565bbfae850 0x5565bbfbd9c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 >> 172.21.15.46:0/1790571727 conn(0x5565bbfaade0 msgr2=0x5565bbfb68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e597fa640 0 client.15735 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 shutdown_connections 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.018+0000 7f5e79e75740 1 -- 172.21.15.46:0/1790571727 wait complete. 2024-09-19T09:19:40.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.019+0000 7f5e79e75740 20 client.15735 trim_cache size 0 max 16384 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 28, 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 6, 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "a7577c2a": { 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 6, 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:19:40.022 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 140.3, 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:40.023 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:19:40.024 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:19:40.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.019+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5e5c0a32c0 msgr2=0x7f5e5c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.019+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5e5c0a32c0 0x7f5e5c0a5780 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009ca0 tx=0x7f5e680e8400 comp rx=0 tx=0).stop 2024-09-19T09:19:40.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.019+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 msgr2=0x7f5e70101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.019+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e70101410 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5e68005cc0 tx=0x7f5e680093d0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 shutdown_connections 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f5e5c0a32c0 0x7f5e5c0a5780 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e701082a0 0x7f5e70101410 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e701036e0 0x7f5e70100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 --2- 172.21.15.46:0/2831589712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e70102d30 0x7f5e70100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 >> 172.21.15.46:0/2831589712 conn(0x7f5e700fc7d0 msgr2=0x7f5e70105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 shutdown_connections 2024-09-19T09:19:40.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:40.020+0000 7f5e77a9c640 1 -- 172.21.15.46:0/2831589712 wait complete. 2024-09-19T09:19:40.778 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a7577c2a', quiesce took 3.6 seconds. Will release after: 16.75 2024-09-19T09:19:41.065 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:40 smithi099 ceph-mon[35256]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:19:41.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:40 smithi115 ceph-mon[35055]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:19:41.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:40 smithi046 ceph-mon[31203]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T09:19:41.285 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.271+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/3300078827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18100a60 msgr2=0x7f7a18100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.271+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/3300078827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18100a60 0x7f7a18100e60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009900 tx=0x7f7a0802a410 comp rx=0 tx=0).stop 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/3300078827 shutdown_connections 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/3300078827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a18102610 0x7f7a18108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/3300078827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a18101c50 0x7f7a181020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/3300078827 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18100a60 0x7f7a18100e60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/3300078827 >> 172.21.15.46:0/3300078827 conn(0x7f7a180fc1e0 msgr2=0x7f7a180fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.286 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/3300078827 shutdown_connections 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/3300078827 wait complete. 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 Processor -- start 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- start start 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a18100a60 0x7f7a18197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 0x7f7a181983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a18102610 0x7f7a1819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1810d830 con 0x7f7a18101c50 2024-09-19T09:19:41.287 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1810d6b0 con 0x7f7a18102610 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.272+0000 7f7a1ee8d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1810d9b0 con 0x7f7a18100a60 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 0x7f7a181983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 0x7f7a181983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53386/0 (socket says 172.21.15.46:53386) 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 -- 172.21.15.46:0/2265820881 learned_addr learned my addr 172.21.15.46:0/2265820881 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 -- 172.21.15.46:0/2265820881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a18100a60 msgr2=0x7f7a18197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a18100a60 0x7f7a18197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 -- 172.21.15.46:0/2265820881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a18102610 msgr2=0x7f7a1819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.288 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a18102610 0x7f7a1819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 -- 172.21.15.46:0/2265820881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1819fa90 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a17fff640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 0x7f7a181983b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00c970 tx=0x7f7a0c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a15ffb640 1 -- 172.21.15.46:0/2265820881 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c007bb0 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a15ffb640 1 -- 172.21.15.46:0/2265820881 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a0c007d50 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1819fd80 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a15ffb640 1 -- 172.21.15.46:0/2265820881 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c00f450 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.273+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a181a0270 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a15ffb640 1 -- 172.21.15.46:0/2265820881 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7a0c005020 con 0x7f7a18101c50 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 Processor -- start 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 -- start start 2024-09-19T09:19:41.289 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x55845975a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x55845975f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459761c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5584596b92f0 con 0x558459759db0 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558459661270 con 0x55845975a6f0 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a21c27740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5584596b52b0 con 0x55845975f780 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a1d42a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x55845975a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a1d42a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x55845975a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53390/0 (socket says 172.21.15.46:53390) 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.276+0000 7f7a1d42a640 1 -- 172.21.15.46:0/1827838717 learned_addr learned my addr 172.21.15.46:0/1827838717 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:41.290 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a15ffb640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7a000a3370 0x7f7a000a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x55845975f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a17fff640 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459761c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 -- 172.21.15.46:0/1827838717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 msgr2=0x558459761c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459761c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 -- 172.21.15.46:0/1827838717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 msgr2=0x55845975f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.291 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x55845975f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 -- 172.21.15.46:0/1827838717 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558459660340 con 0x558459759db0 2024-09-19T09:19:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a15ffb640 1 -- 172.21.15.46:0/2265820881 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7a0c0cf700 con 0x7f7a18101c50 2024-09-19T09:19:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7a000a3370 0x7f7a000a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x55845975a1b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009f80 tx=0x7f7a1000d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7e8348e5c1b186 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.292 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f79feffd640 1 -- 172.21.15.46:0/1827838717 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10018070 con 0x558459759db0 2024-09-19T09:19:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f79feffd640 1 -- 172.21.15.46:0/1827838717 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a1001edf0 con 0x558459759db0 2024-09-19T09:19:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.277+0000 7f79feffd640 1 -- 172.21.15.46:0/1827838717 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a100054f0 con 0x558459759db0 2024-09-19T09:19:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 -- 172.21.15.46:0/1827838717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 msgr2=0x55845975a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7a000a3370 0x7f7a000a5830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a1001e000 tx=0x7f7a1001f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x55845975a1b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009f80 tx=0x7f7a1000d770 comp rx=0 tx=0).stop 2024-09-19T09:19:41.293 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 -- 172.21.15.46:0/1827838717 shutdown_connections 2024-09-19T09:19:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459761c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x55845975f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1827838717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x55845975a1b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 -- 172.21.15.46:0/1827838717 >> 172.21.15.46:0/1827838717 conn(0x558459751010 msgr2=0x558459751410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 -- 172.21.15.46:0/1827838717 shutdown_connections 2024-09-19T09:19:41.294 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 -- 172.21.15.46:0/1827838717 wait complete. 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 -- start start 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.278+0000 7f7a21c27740 1 Processor -- start 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558459759db0 0x558459764000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 0x558459764540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x55845976b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558459762750 con 0x55845975a6f0 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558459642290 con 0x55845975f780 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5584597628d0 con 0x558459759db0 2024-09-19T09:19:41.295 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a21c27740 10 client.0 _ll_register_callbacks cb 0x558459673140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 0x558459764540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 0x558459764540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53392/0 (socket says 172.21.15.46:53392) 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 -- 172.21.15.46:0/1935558257 learned_addr learned my addr 172.21.15.46:0/1935558257 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x55845976b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558459759db0 0x558459764000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 -- 172.21.15.46:0/1935558257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558459759db0 msgr2=0x558459764000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558459759db0 0x558459764000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 -- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 msgr2=0x55845976b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x55845976b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a17fff640 1 -- 172.21.15.46:0/1935558257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584593cc210 con 0x55845975a6f0 2024-09-19T09:19:41.296 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.279+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558459759db0 0x558459764000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a17fff640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 0x558459764540 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0cd230 tx=0x7f7a0c09b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442de79032c4ec28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f79f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f79f7fff640 1 -- 172.21.15.46:0/1935558257 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c01d070 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f79f7fff640 1 -- 172.21.15.46:0/1935558257 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7a0c005310 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a1001edf0 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f79f7fff640 1 -- 172.21.15.46:0/1935558257 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a0c09bd50 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 10 client.15747 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558459498620 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f79f7fff640 1 -- 172.21.15.46:0/1935558257 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a1001edf0 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f79f7fff640 1 -- 172.21.15.46:0/1935558257 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a0c0cfbb0 con 0x55845975a6f0 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:41.297 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 20 client.15747 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55845976fd20 0x558459772130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 4 client.15747 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.280+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584596c6a20 con 0x55845976fd20 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.281+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55845976fd20 0x558459772130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.281+0000 7f79f7fff640 10 client.15747 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.281+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55845976fd20 0x558459772130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=909f118433f3fc0b server_cookie=b7250304e141377f in_seq=0 out_seq=0 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f79f7fff640 1 -- 172.21.15.46:0/1935558257 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584596c6a20 con 0x55845976fd20 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f79f7fff640 10 client.15747 handle_command_reply: tid=0 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 client.15747 shutdown 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 msgr2=0x558459764540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 0x558459764540 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0cd230 tx=0x7f7a0c09b7b0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.298 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 shutdown_connections 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55845976fd20 0x558459772130 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55845975a6f0 0x558459764540 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x55845976b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 --2- 172.21.15.46:0/1935558257 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558459759db0 0x558459764000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f79f7fff640 0 client.15747 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 >> 172.21.15.46:0/1935558257 conn(0x558459751010 msgr2=0x558459752820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 shutdown_connections 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 1 -- 172.21.15.46:0/1935558257 wait complete. 2024-09-19T09:19:41.299 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.282+0000 7f7a21c27740 20 client.15747 trim_cache size 0 max 16384 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.296+0000 7f7a21c27740 1 Processor -- start 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.296+0000 7f7a21c27740 1 -- start start 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459751f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975a6f0 0x55845976b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x558459752460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a21c27740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181a6db0 con 0x558459759db0 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a21c27740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181a88f0 con 0x55845975f780 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a21c27740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181a7480 con 0x55845975a6f0 2024-09-19T09:19:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459751f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459751f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53404/0 (socket says 172.21.15.46:53404) 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2401970502 learned_addr learned my addr 172.21.15.46:0/2401970502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2401970502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975a6f0 msgr2=0x55845976b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975a6f0 0x55845976b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2401970502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 msgr2=0x558459752460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x558459752460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2401970502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55845976e640 con 0x558459759db0 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459751f20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7a18101ab0 tx=0x7f7a08031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a9f56ea9be227 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f79fe7fc640 1 -- 172.21.15.46:0/2401970502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08035040 con 0x558459759db0 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f79fe7fc640 1 -- 172.21.15.46:0/2401970502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a08048070 con 0x558459759db0 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.297+0000 7f79fe7fc640 1 -- 172.21.15.46:0/2401970502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08004ca0 con 0x558459759db0 2024-09-19T09:19:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 -- 172.21.15.46:0/2401970502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 msgr2=0x558459751f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459751f20 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7a18101ab0 tx=0x7f7a08031400 comp rx=0 tx=0).stop 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 -- 172.21.15.46:0/2401970502 shutdown_connections 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975f780 0x558459752460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975a6f0 0x55845976b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2401970502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459751f20 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 -- 172.21.15.46:0/2401970502 >> 172.21.15.46:0/2401970502 conn(0x558459751010 msgr2=0x558459764000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 -- 172.21.15.46:0/2401970502 shutdown_connections 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 -- 172.21.15.46:0/2401970502 wait complete. 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 -- start start 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.298+0000 7f7a21c27740 1 Processor -- start 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459768860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x558459768da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459769db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181a8220 con 0x558459759db0 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181a7b50 con 0x55845975a6f0 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7a181a4d90 con 0x55845975f780 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a21c27740 10 client.0 _ll_register_callbacks cb 0x7f7a0c096770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459768860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459768860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53408/0 (socket says 172.21.15.46:53408) 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2938592809 learned_addr learned my addr 172.21.15.46:0/2938592809 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a17fff640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x558459768da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1d42a640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459769db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2938592809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 msgr2=0x558459769db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459769db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 msgr2=0x558459768da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x558459768da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.299+0000 7f7a1cc29640 1 -- 172.21.15.46:0/2938592809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55845976a3c0 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a1cc29640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459768860 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7a080314e0 tx=0x7f7a08032a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157e9977ff211c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f79f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f79f7fff640 1 -- 172.21.15.46:0/2938592809 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08035070 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f79f7fff640 1 -- 172.21.15.46:0/2938592809 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7a0803c710 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a08048070 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f79f7fff640 1 -- 172.21.15.46:0/2938592809 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a0803c910 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 10 client.15753 fetch_fsmap learned FSMap version 28 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55845976b6d0 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f79f7fff640 1 -- 172.21.15.46:0/2938592809 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a08048070 con 0x558459759db0 2024-09-19T09:19:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f79f7fff640 1 -- 172.21.15.46:0/2938592809 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a0804c450 con 0x558459759db0 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 10 client.15753 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 20 client.15753 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5584597db000 0x5584597dd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 4 client.15753 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.300+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584596c0d70 con 0x5584597db000 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.301+0000 7f7a17fff640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5584597db000 0x5584597dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.301+0000 7f7a17fff640 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5584597db000 0x5584597dd420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf68ef6126d73a47 server_cookie=1042c5eade94c943 in_seq=0 out_seq=0 2024-09-19T09:19:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.301+0000 7f79f7fff640 10 client.15753 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:41.329 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.327+0000 7f79f7fff640 1 -- 172.21.15.46:0/2938592809 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584596c0d70 con 0x5584597db000 2024-09-19T09:19:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.327+0000 7f79f7fff640 10 client.15753 handle_command_reply: tid=0 2024-09-19T09:19:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.327+0000 7f7a21c27740 1 client.15753 shutdown 2024-09-19T09:19:41.333 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 msgr2=0x558459768860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459768860 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7a080314e0 tx=0x7f7a08032a30 comp rx=0 tx=0).stop 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 shutdown_connections 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5584597db000 0x5584597dd420 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55845975f780 0x558459769db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55845975a6f0 0x558459768da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f79f7fff640 0 client.15753 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 --2- 172.21.15.46:0/2938592809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558459759db0 0x558459768860 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 >> 172.21.15.46:0/2938592809 conn(0x558459751010 msgr2=0x55845974f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 shutdown_connections 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 1 -- 172.21.15.46:0/2938592809 wait complete. 2024-09-19T09:19:41.334 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.328+0000 7f7a21c27740 20 client.15753 trim_cache size 0 max 16384 2024-09-19T09:19:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:19:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:19:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:19:41.335 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7a000a3370 msgr2=0x7f7a000a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7a000a3370 0x7f7a000a5830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a1001e000 tx=0x7f7a1001f000 comp rx=0 tx=0).stop 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 msgr2=0x7f7a181983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 0x7f7a181983b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00c970 tx=0x7f7a0c00ce30 comp rx=0 tx=0).stop 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 shutdown_connections 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7a000a3370 0x7f7a000a5830 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a18101c50 0x7f7a181983b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a18102610 0x7f7a1819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 --2- 172.21.15.46:0/2265820881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7a18100a60 0x7f7a18197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.336 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 >> 172.21.15.46:0/2265820881 conn(0x7f7a180fc1e0 msgr2=0x7f7a18105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 shutdown_connections 2024-09-19T09:19:41.337 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:41.329+0000 7f7a1ee8d640 1 -- 172.21.15.46:0/2265820881 wait complete. 2024-09-19T09:19:43.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:42 smithi115 ceph-mon[35055]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:19:43.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:42 smithi046 ceph-mon[31203]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:19:43.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:42 smithi099 ceph-mon[35256]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T09:19:45.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:44 smithi115 ceph-mon[35055]: pgmap v381: 97 pgs: 97 active+clean; 901 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-19T09:19:45.232 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:44 smithi046 ceph-mon[31203]: pgmap v381: 97 pgs: 97 active+clean; 901 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-19T09:19:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:44 smithi099 ceph-mon[35256]: pgmap v381: 97 pgs: 97 active+clean; 901 KiB data, 340 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 21 op/s 2024-09-19T09:19:46.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:45 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:19:46.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:45 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:19:46.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:45 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:19:47.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:46 smithi115 ceph-mon[35055]: pgmap v382: 97 pgs: 97 active+clean; 902 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-09-19T09:19:47.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:46 smithi046 ceph-mon[31203]: pgmap v382: 97 pgs: 97 active+clean; 902 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-09-19T09:19:47.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:46 smithi099 ceph-mon[35256]: pgmap v382: 97 pgs: 97 active+clean; 902 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-09-19T09:19:47.718 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:19:47.990 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:48.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 -- 172.21.15.46:0/1949273376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50112b90 msgr2=0x7fef50114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 --2- 172.21.15.46:0/1949273376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50112b90 0x7fef50114f80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fef48009ca0 tx=0x7fef4802a950 comp rx=0 tx=0).stop 2024-09-19T09:19:48.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 -- 172.21.15.46:0/1949273376 shutdown_connections 2024-09-19T09:19:48.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 --2- 172.21.15.46:0/1949273376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50112b90 0x7fef50114f80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 --2- 172.21.15.46:0/1949273376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef50074eb0 0x7fef50112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 --2- 172.21.15.46:0/1949273376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074590 0x7fef50074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 -- 172.21.15.46:0/1949273376 >> 172.21.15.46:0/1949273376 conn(0x7fef500fd8c0 msgr2=0x7fef500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 -- 172.21.15.46:0/1949273376 shutdown_connections 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.432+0000 7fef58026640 1 -- 172.21.15.46:0/1949273376 wait complete. 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 Processor -- start 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 -- start start 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 0x7fef501a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074eb0 0x7fef501a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef50112b90 0x7fef5019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef50118550 con 0x7fef50074590 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fef501183d0 con 0x7fef50112b90 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef58026640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fef501186d0 con 0x7fef50074eb0 2024-09-19T09:19:48.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef55dc2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 0x7fef501a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef55dc2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 0x7fef501a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49862/0 (socket says 172.21.15.46:49862) 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef55dc2640 1 -- 172.21.15.46:0/3785212509 learned_addr learned my addr 172.21.15.46:0/3785212509 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.433+0000 7fef565c3640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef50112b90 0x7fef5019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef555c1640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074eb0 0x7fef501a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef55dc2640 1 -- 172.21.15.46:0/3785212509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074eb0 msgr2=0x7fef501a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef55dc2640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074eb0 0x7fef501a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef55dc2640 1 -- 172.21.15.46:0/3785212509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef50112b90 msgr2=0x7fef5019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef55dc2640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef50112b90 0x7fef5019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef55dc2640 1 -- 172.21.15.46:0/3785212509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5019efc0 con 0x7fef50074590 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef555c1640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074eb0 0x7fef501a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef55dc2640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 0x7fef501a46a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c890 tx=0x7fef4c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef46ffd640 1 -- 172.21.15.46:0/3785212509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c004220 con 0x7fef50074590 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef46ffd640 1 -- 172.21.15.46:0/3785212509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4c0043c0 con 0x7fef50074590 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5019f2b0 con 0x7fef50074590 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef46ffd640 1 -- 172.21.15.46:0/3785212509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c0049e0 con 0x7fef50074590 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.434+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef501ab500 con 0x7fef50074590 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef46ffd640 1 -- 172.21.15.46:0/3785212509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fef4c0079b0 con 0x7fef50074590 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 Processor -- start 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 -- start start 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 0x5653c8842880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c8842dc0 0x5653c884d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5653c87a82e0 con 0x5653c88424a0 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5653c874fce0 con 0x5653c8842dc0 2024-09-19T09:19:48.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5653c87a42a0 con 0x5653c884d680 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef565c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 0x5653c8842880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef565c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 0x5653c8842880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49866/0 (socket says 172.21.15.46:49866) 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.437+0000 7fef565c3640 1 -- 172.21.15.46:0/527203715 learned_addr learned my addr 172.21.15.46:0/527203715 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef46ffd640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fef3c0a32c0 0x7fef3c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef555c1640 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef55dc2640 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c8842dc0 0x5653c884d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fef3c0a32c0 0x7fef3c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef46ffd640 1 -- 172.21.15.46:0/3785212509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fef4c0cf9d0 con 0x7fef50074590 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 -- 172.21.15.46:0/527203715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 msgr2=0x5653c884fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 -- 172.21.15.46:0/527203715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c8842dc0 msgr2=0x5653c884d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c8842dc0 0x5653c884d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 -- 172.21.15.46:0/527203715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c8734440 con 0x5653c88424a0 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef565c3640 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 0x5653c8842880 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fef48035000 tx=0x7fef4802fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f038773256809b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef3bfff640 1 -- 172.21.15.46:0/527203715 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48034040 con 0x5653c88424a0 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef3bfff640 1 -- 172.21.15.46:0/527203715 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4804e070 con 0x5653c88424a0 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.438+0000 7fef3bfff640 1 -- 172.21.15.46:0/527203715 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48049750 con 0x5653c88424a0 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 -- 172.21.15.46:0/527203715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 msgr2=0x5653c8842880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef565c3640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fef3c0a32c0 0x7fef3c0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fef4804d000 tx=0x7fef4804b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 0x5653c8842880 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fef48035000 tx=0x7fef4802fd50 comp rx=0 tx=0).stop 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 -- 172.21.15.46:0/527203715 shutdown_connections 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c8842dc0 0x5653c884d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/527203715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c88424a0 0x5653c8842880 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 -- 172.21.15.46:0/527203715 >> 172.21.15.46:0/527203715 conn(0x5653c883ea30 msgr2=0x5653c883ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 -- 172.21.15.46:0/527203715 shutdown_connections 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.439+0000 7fef5a3ff740 1 -- 172.21.15.46:0/527203715 wait complete. 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 -- start start 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 Processor -- start 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c884cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c884a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c884a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5653c8850250 con 0x5653c884d680 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5653c8763050 con 0x5653c88424a0 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5653c88503d0 con 0x5653c8842dc0 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.440+0000 7fef5a3ff740 10 client.0 _ll_register_callbacks cb 0x5653c87a3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:48.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef55dc2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c884cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef55dc2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c884cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:59398/0 (socket says 172.21.15.46:59398) 2024-09-19T09:19:48.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef565c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c884a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef55dc2640 1 -- 172.21.15.46:0/2961251652 learned_addr learned my addr 172.21.15.46:0/2961251652 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:48.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c884a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 -- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 msgr2=0x5653c884cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c884cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 -- 172.21.15.46:0/2961251652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 msgr2=0x5653c884a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c884a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 -- 172.21.15.46:0/2961251652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c85193c0 con 0x5653c8842dc0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c884cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef565c3640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c884a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef555c1640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c884a280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef500ffec0 tx=0x7fef40010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10b42744842bba16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef397fa640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.441+0000 7fef397fa640 1 -- 172.21.15.46:0/2961251652 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4001d060 con 0x5653c8842dc0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef397fa640 1 -- 172.21.15.46:0/2961251652 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fef4000ecf0 con 0x5653c8842dc0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4804e070 con 0x5653c8842dc0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef397fa640 1 -- 172.21.15.46:0/2961251652 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef40018430 con 0x5653c8842dc0 2024-09-19T09:19:48.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 10 client.25315 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5653c885bcb0 con 0x5653c8842dc0 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef397fa640 1 -- 172.21.15.46:0/2961251652 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4804e070 con 0x5653c8842dc0 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef397fa640 1 -- 172.21.15.46:0/2961251652 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fef4000d530 con 0x5653c8842dc0 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 10 client.25315 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 10 client.25315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 20 client.25315 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c885d1c0 0x5653c885f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 4 client.25315 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.442+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653c87b5850 con 0x5653c885d1c0 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.443+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c885d1c0 0x5653c885f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.443+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c885d1c0 0x5653c885f5e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b01293de6a8676 server_cookie=bd35e876c78ce6ac in_seq=0 out_seq=0 2024-09-19T09:19:48.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.443+0000 7fef397fa640 10 client.25315 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef397fa640 1 -- 172.21.15.46:0/2961251652 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653c87b5850 con 0x5653c885d1c0 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef397fa640 10 client.25315 handle_command_reply: tid=0 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 client.25315 shutdown 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 msgr2=0x5653c884a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c884a280 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef500ffec0 tx=0x7fef40010c80 comp rx=0 tx=0).stop 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 shutdown_connections 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c885d1c0 0x5653c885f5e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c884a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c884a280 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2961251652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c884cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef397fa640 0 client.25315 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:48.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 >> 172.21.15.46:0/2961251652 conn(0x5653c883ea30 msgr2=0x5653c883db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 shutdown_connections 2024-09-19T09:19:48.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2961251652 wait complete. 2024-09-19T09:19:48.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.444+0000 7fef5a3ff740 20 client.25315 trim_cache size 0 max 16384 2024-09-19T09:19:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 Processor -- start 2024-09-19T09:19:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 -- start start 2024-09-19T09:19:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 0x5653c8848b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef501b3b90 con 0x5653c8842dc0 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fef501b5700 con 0x5653c88424a0 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fef501b4260 con 0x5653c884d680 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 0x5653c8848b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 0x5653c8848b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49886/0 (socket says 172.21.15.46:49886) 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 -- 172.21.15.46:0/2740091605 learned_addr learned my addr 172.21.15.46:0/2740091605 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef565c3640 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 -- 172.21.15.46:0/2740091605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 msgr2=0x5653c884c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 -- 172.21.15.46:0/2740091605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 msgr2=0x5653c88594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.462+0000 7fef555c1640 1 -- 172.21.15.46:0/2740091605 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c8849230 con 0x5653c8842dc0 2024-09-19T09:19:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.463+0000 7fef555c1640 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 0x5653c8848b50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d9d0 tx=0x7fef4000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b175bd788c00318d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.463+0000 7fef3b7fe640 1 -- 172.21.15.46:0/2740091605 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40028040 con 0x5653c8842dc0 2024-09-19T09:19:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.463+0000 7fef3b7fe640 1 -- 172.21.15.46:0/2740091605 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4000ddc0 con 0x5653c8842dc0 2024-09-19T09:19:48.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.463+0000 7fef3b7fe640 1 -- 172.21.15.46:0/2740091605 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef400054e0 con 0x5653c8842dc0 2024-09-19T09:19:48.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2740091605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 msgr2=0x5653c8848b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 0x5653c8848b50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fef4000d9d0 tx=0x7fef4000bc30 comp rx=0 tx=0).stop 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2740091605 shutdown_connections 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c8842dc0 0x5653c8848b50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c884d680 0x5653c884c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2740091605 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2740091605 >> 172.21.15.46:0/2740091605 conn(0x5653c883ea30 msgr2=0x5653c884bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2740091605 shutdown_connections 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2740091605 wait complete. 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 -- start start 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.464+0000 7fef5a3ff740 1 Processor -- start 2024-09-19T09:19:48.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c8851bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c8852170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef501b5000 con 0x5653c884d680 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fef501b4930 con 0x5653c88424a0 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fef501b1b70 con 0x5653c8842dc0 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef5a3ff740 10 client.0 _ll_register_callbacks cb 0x7fef4000b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c8852170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c8852170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49888/0 (socket says 172.21.15.46:49888) 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 -- 172.21.15.46:0/2040636811 learned_addr learned my addr 172.21.15.46:0/2040636811 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef555c1640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c8851bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 -- 172.21.15.46:0/2040636811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 msgr2=0x5653c8851bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c8851bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 -- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 msgr2=0x5653c88516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 -- 172.21.15.46:0/2040636811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c884ab50 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef565c3640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c8852170 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fef4802f420 tx=0x7fef4802fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50c82df1c98a7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef397fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.465+0000 7fef397fa640 1 -- 172.21.15.46:0/2040636811 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48062060 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef397fa640 1 -- 172.21.15.46:0/2040636811 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fef48004040 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4000ddc0 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef397fa640 1 -- 172.21.15.46:0/2040636811 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef48058040 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 10 client.15771 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5653c88c82b0 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef397fa640 1 -- 172.21.15.46:0/2040636811 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4000ddc0 con 0x5653c884d680 2024-09-19T09:19:48.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef397fa640 1 -- 172.21.15.46:0/2040636811 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fef48030440 con 0x5653c884d680 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 20 client.15771 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c88c85e0 0x5653c88ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 4 client.15771 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.466+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653c87afd60 con 0x5653c88c85e0 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c88c85e0 0x5653c88ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef397fa640 10 client.15771 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef55dc2640 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c88c85e0 0x5653c88ca9d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ee23cb1b2760961 server_cookie=aee91cd8d9282255 in_seq=0 out_seq=0 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef397fa640 1 -- 172.21.15.46:0/2040636811 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5653c87afd60 con 0x5653c88c85e0 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef397fa640 10 client.15771 handle_command_reply: tid=0 2024-09-19T09:19:48.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 client.15771 shutdown 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 msgr2=0x5653c8852170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c8852170 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fef4802f420 tx=0x7fef4802fcd0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 shutdown_connections 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5653c88c85e0 0x5653c88ca9d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5653c884d680 0x5653c8852170 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5653c8842dc0 0x5653c8851bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef397fa640 0 client.15771 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 --2- 172.21.15.46:0/2040636811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653c88424a0 0x5653c88516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.467+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 >> 172.21.15.46:0/2040636811 conn(0x5653c883ea30 msgr2=0x5653c8843f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 shutdown_connections 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef5a3ff740 1 -- 172.21.15.46:0/2040636811 wait complete. 2024-09-19T09:19:48.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef5a3ff740 20 client.15771 trim_cache size 0 max 16384 2024-09-19T09:19:48.474 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:19:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-19T09:19:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {} 2024-09-19T09:19:48.474 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:19:48.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fef3c0a32c0 msgr2=0x7fef3c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fef3c0a32c0 0x7fef3c0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fef4804d000 tx=0x7fef4804b000 comp rx=0 tx=0).stop 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 msgr2=0x7fef501a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 0x7fef501a46a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c890 tx=0x7fef4c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 shutdown_connections 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fef3c0a32c0 0x7fef3c0a5780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef50112b90 0x7fef5019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef50074eb0 0x7fef501a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 --2- 172.21.15.46:0/3785212509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef50074590 0x7fef501a46a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 >> 172.21.15.46:0/3785212509 conn(0x7fef500fd8c0 msgr2=0x7fef500fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 shutdown_connections 2024-09-19T09:19:48.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:48.468+0000 7fef58026640 1 -- 172.21.15.46:0/3785212509 wait complete. 2024-09-19T09:19:49.129 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:48 smithi046 ceph-mon[31203]: pgmap v383: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2024-09-19T09:19:49.163 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:19:49.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:49.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:48 smithi115 ceph-mon[35055]: pgmap v383: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2024-09-19T09:19:49.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:48 smithi099 ceph-mon[35256]: pgmap v383: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2024-09-19T09:19:49.426 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 -- 172.21.15.46:0/3428812808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c101420 msgr2=0x7fcd0c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 --2- 172.21.15.46:0/3428812808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c101420 0x7fcd0c10d950 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009cd0 tx=0x7fcd0402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 -- 172.21.15.46:0/3428812808 shutdown_connections 2024-09-19T09:19:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 --2- 172.21.15.46:0/3428812808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c101420 0x7fcd0c10d950 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 --2- 172.21.15.46:0/3428812808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd0c100a80 0x7fcd0c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 --2- 172.21.15.46:0/3428812808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd0c106a80 0x7fcd0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 -- 172.21.15.46:0/3428812808 >> 172.21.15.46:0/3428812808 conn(0x7fcd0c0fc7a0 msgr2=0x7fcd0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 -- 172.21.15.46:0/3428812808 shutdown_connections 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.914+0000 7fcd1447f640 1 -- 172.21.15.46:0/3428812808 wait complete. 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 Processor -- start 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 -- start start 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd0c100a80 0x7fcd0c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd0c101420 0x7fcd0c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 0x7fcd0c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c110ea0 con 0x7fcd0c106a80 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c110d20 con 0x7fcd0c100a80 2024-09-19T09:19:49.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1447f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c111020 con 0x7fcd0c101420 2024-09-19T09:19:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd12a1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 0x7fcd0c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd12a1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 0x7fcd0c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49906/0 (socket says 172.21.15.46:49906) 2024-09-19T09:19:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd12a1c640 1 -- 172.21.15.46:0/432109734 learned_addr learned my addr 172.21.15.46:0/432109734 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd1221b640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd0c100a80 0x7fcd0c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.915+0000 7fcd11a1a640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd0c101420 0x7fcd0c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd12a1c640 1 -- 172.21.15.46:0/432109734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd0c101420 msgr2=0x7fcd0c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd12a1c640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd0c101420 0x7fcd0c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd12a1c640 1 -- 172.21.15.46:0/432109734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd0c100a80 msgr2=0x7fcd0c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd12a1c640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd0c100a80 0x7fcd0c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd12a1c640 1 -- 172.21.15.46:0/432109734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c1a4870 con 0x7fcd0c106a80 2024-09-19T09:19:49.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd12a1c640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 0x7fcd0c1a4330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcd04005cc0 tx=0x7fcd04003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04004040 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd0c1a4a40 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd040046c0 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04030e70 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.916+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd0c1a4f20 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.917+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c100ee0 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.918+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcd040305a0 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.919+0000 7fcd037fe640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fccf80a3240 0x7fccf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.919+0000 7fcd1221b640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fccf80a3240 0x7fccf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.919+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd0402e030 con 0x7fcd0c106a80 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.920+0000 7fcd1221b640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fccf80a3240 0x7fccf80a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009990 tx=0x7fcd08009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:49.923+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd040bdc50 con 0x7fcd0c106a80 2024-09-19T09:19:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.136+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd0c1a5150 con 0x7fcd0c106a80 2024-09-19T09:19:50.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.137+0000 7fcd037fe640 1 -- 172.21.15.46:0/432109734 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11960 (secure 0 0 0) 0x7fcd040098b0 con 0x7fcd0c106a80 2024-09-19T09:19:50.138 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:19:50.138 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"btime":"2024-09-19T09:19:44:798798+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:19:44.198190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:19:50.138 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fccf80a3240 msgr2=0x7fccf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fccf80a3240 0x7fccf80a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009990 tx=0x7fcd08009110 comp rx=0 tx=0).stop 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 msgr2=0x7fcd0c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 0x7fcd0c1a4330 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcd04005cc0 tx=0x7fcd04003970 comp rx=0 tx=0).stop 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 shutdown_connections 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fccf80a3240 0x7fccf80a5700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd0c106a80 0x7fcd0c1a4330 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd0c101420 0x7fcd0c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 --2- 172.21.15.46:0/432109734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd0c100a80 0x7fcd0c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 >> 172.21.15.46:0/432109734 conn(0x7fcd0c0fc7a0 msgr2=0x7fcd0c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:50.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 shutdown_connections 2024-09-19T09:19:50.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:50.139+0000 7fcd1447f640 1 -- 172.21.15.46:0/432109734 wait complete. 2024-09-19T09:19:50.797 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:19:51.058 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:51.180 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:50 smithi046 ceph-mon[31203]: pgmap v384: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2024-09-19T09:19:51.180 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:50 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/432109734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:51.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:50 smithi115 ceph-mon[35055]: pgmap v384: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2024-09-19T09:19:51.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:50 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/432109734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:50 smithi099 ceph-mon[35256]: pgmap v384: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2024-09-19T09:19:51.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:50 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/432109734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.524+0000 7ff3506f1640 1 -- 172.21.15.46:0/2373129385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101480 msgr2=0x7ff348101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.524+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2373129385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101480 0x7ff348101860 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff344009900 tx=0x7ff34402a410 comp rx=0 tx=0).stop 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- 172.21.15.46:0/2373129385 shutdown_connections 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2373129385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348105e80 0x7ff34810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2373129385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348101e30 0x7ff348105750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2373129385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101480 0x7ff348101860 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- 172.21.15.46:0/2373129385 >> 172.21.15.46:0/2373129385 conn(0x7ff348077210 msgr2=0x7ff3480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- 172.21.15.46:0/2373129385 shutdown_connections 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- 172.21.15.46:0/2373129385 wait complete. 2024-09-19T09:19:51.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 Processor -- start 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- start start 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348101480 0x7ff348197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 0x7ff348197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348105e80 0x7ff34819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff348110f40 con 0x7ff348101e30 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff348110dc0 con 0x7ff348101480 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.525+0000 7ff3506f1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481110c0 con 0x7ff348105e80 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 0x7ff348197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 0x7ff348197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49922/0 (socket says 172.21.15.46:49922) 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 -- 172.21.15.46:0/2736299615 learned_addr learned my addr 172.21.15.46:0/2736299615 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348105e80 0x7ff34819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34e48d640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348101480 0x7ff348197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 -- 172.21.15.46:0/2736299615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348105e80 msgr2=0x7ff34819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348105e80 0x7ff34819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 -- 172.21.15.46:0/2736299615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348101480 msgr2=0x7ff348197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348101480 0x7ff348197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 -- 172.21.15.46:0/2736299615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34819c4f0 con 0x7ff348101e30 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34e48d640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348101480 0x7ff348197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348105e80 0x7ff34819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 0x7ff348197a80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff33800b4a0 tx=0x7ff33800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff33f7fe640 1 -- 172.21.15.46:0/2736299615 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338014070 con 0x7ff348101e30 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff33f7fe640 1 -- 172.21.15.46:0/2736299615 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff338010af0 con 0x7ff348101e30 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34819c7e0 con 0x7ff348101e30 2024-09-19T09:19:51.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff33f7fe640 1 -- 172.21.15.46:0/2736299615 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338017d10 con 0x7ff348101e30 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.526+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3481a40c0 con 0x7ff348101e30 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff33f7fe640 1 -- 172.21.15.46:0/2736299615 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff338017070 con 0x7ff348101e30 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 Processor -- start 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 -- start start 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 0x555c87494090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874945d0 0x555c87494a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874a1580 0x555c874a3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555c873fa2f0 con 0x555c87495b40 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555c873a1cf0 con 0x555c874a1580 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.529+0000 7ff352aca740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x555c873f62b0 con 0x555c874945d0 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 0x555c87494090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 0x555c87494090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49930/0 (socket says 172.21.15.46:49930) 2024-09-19T09:19:51.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff33f7fe640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff3340a3240 0x7ff3340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 -- 172.21.15.46:0/3610553347 learned_addr learned my addr 172.21.15.46:0/3610553347 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34e48d640 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874945d0 0x555c87494a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff33f7fe640 1 -- 172.21.15.46:0/2736299615 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff3380ced60 con 0x7ff348101e30 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874a1580 0x555c874a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff3340a3240 0x7ff3340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 -- 172.21.15.46:0/3610553347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874945d0 msgr2=0x555c87494a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874945d0 0x555c87494a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 -- 172.21.15.46:0/3610553347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874a1580 msgr2=0x555c874a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874a1580 0x555c874a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 -- 172.21.15.46:0/3610553347 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c873863a0 con 0x555c87495b40 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.530+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 0x555c87494090 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff3400129e0 tx=0x7ff340012ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12c2292ac76af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:51.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff33cff9640 1 -- 172.21.15.46:0/3610553347 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340022070 con 0x555c87495b40 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff33cff9640 1 -- 172.21.15.46:0/3610553347 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff340005500 con 0x555c87495b40 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff33cff9640 1 -- 172.21.15.46:0/3610553347 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34001e790 con 0x555c87495b40 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff3340a3240 0x7ff3340a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff340020000 tx=0x7ff34001f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 -- 172.21.15.46:0/3610553347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 msgr2=0x555c87494090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 0x555c87494090 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff3400129e0 tx=0x7ff340012ea0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 -- 172.21.15.46:0/3610553347 shutdown_connections 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874a1580 0x555c874a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874945d0 0x555c87494a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 --2- 172.21.15.46:0/3610553347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c87495b40 0x555c87494090 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.531+0000 7ff352aca740 1 -- 172.21.15.46:0/3610553347 >> 172.21.15.46:0/3610553347 conn(0x555c8745d310 msgr2=0x555c87490c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 -- 172.21.15.46:0/3610553347 shutdown_connections 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 -- 172.21.15.46:0/3610553347 wait complete. 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 -- start start 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 Processor -- start 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874945d0 0x555c874a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c87495b40 0x555c8749e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 0x555c8749e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555c874a4280 con 0x555c874a1580 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555c873b5060 con 0x555c874945d0 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x555c874a4400 con 0x555c87495b40 2024-09-19T09:19:51.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff352aca740 10 client.0 _ll_register_callbacks cb 0x555c871088c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff34ec8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 0x555c8749e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff34ec8e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 0x555c8749e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49934/0 (socket says 172.21.15.46:49934) 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.532+0000 7ff34ec8e640 1 -- 172.21.15.46:0/37469368 learned_addr learned my addr 172.21.15.46:0/37469368 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34e48d640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874945d0 0x555c874a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c87495b40 0x555c8749e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34ec8e640 1 -- 172.21.15.46:0/37469368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c87495b40 msgr2=0x555c8749e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c87495b40 0x555c8749e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34ec8e640 1 -- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874945d0 msgr2=0x555c874a0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874945d0 0x555c874a0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34ec8e640 1 -- 172.21.15.46:0/37469368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8716b3c0 con 0x555c874a1580 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 0x555c8749e810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff340012770 tx=0x7ff34000abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120ce2d34fcc1fce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:51.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff331ffb640 1 -- 172.21.15.46:0/37469368 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340022050 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff331ffb640 1 -- 172.21.15.46:0/37469368 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff3400058c0 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff340005500 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff331ffb640 1 -- 172.21.15.46:0/37469368 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff340005000 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff352aca740 10 client.15789 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.533+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c874afd20 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff331ffb640 1 -- 172.21.15.46:0/37469368 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff340005500 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff331ffb640 1 -- 172.21.15.46:0/37469368 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ff3400264a0 con 0x555c874a1580 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff352aca740 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff352aca740 10 client.15789 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff352aca740 20 client.15789 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff352aca740 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c874b1180 0x555c874b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff352aca740 4 client.15789 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c87407860 con 0x555c874b1180 2024-09-19T09:19:51.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.534+0000 7ff34e48d640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c874b1180 0x555c874b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff34e48d640 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c874b1180 0x555c874b3570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a8efa23b754c122d server_cookie=2eae56d434d44876 in_seq=0 out_seq=0 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff331ffb640 10 client.15789 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff331ffb640 1 -- 172.21.15.46:0/37469368 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c87407860 con 0x555c874b1180 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff331ffb640 10 client.15789 handle_command_reply: tid=0 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff352aca740 1 client.15789 shutdown 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 msgr2=0x555c8749e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.535+0000 7ff352aca740 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 0x555c8749e810 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff340012770 tx=0x7ff34000abb0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 shutdown_connections 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874a1580 0x555c8749e810 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c874b1180 0x555c874b3570 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c87495b40 0x555c8749e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 --2- 172.21.15.46:0/37469368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c874945d0 0x555c874a0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 >> 172.21.15.46:0/37469368 conn(0x555c8745d310 msgr2=0x555c87496960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff331ffb640 0 client.15789 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 shutdown_connections 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 1 -- 172.21.15.46:0/37469368 wait complete. 2024-09-19T09:19:51.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.536+0000 7ff352aca740 20 client.15789 trim_cache size 0 max 16384 2024-09-19T09:19:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 Processor -- start 2024-09-19T09:19:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 -- start start 2024-09-19T09:19:51.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c87490e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874ad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c874b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481ab380 con 0x555c874945d0 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481acef0 con 0x555c87495b40 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff352aca740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481aba50 con 0x555c874a1580 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff34e48d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c87490e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff34e48d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c87490e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49940/0 (socket says 172.21.15.46:49940) 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.549+0000 7ff34e48d640 1 -- 172.21.15.46:0/2616061614 learned_addr learned my addr 172.21.15.46:0/2616061614 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34e48d640 1 -- 172.21.15.46:0/2616061614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 msgr2=0x555c874b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34e48d640 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c874b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34e48d640 1 -- 172.21.15.46:0/2616061614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 msgr2=0x555c874ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34e48d640 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34e48d640 1 -- 172.21.15.46:0/2616061614 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8749f5a0 con 0x555c874945d0 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff34e48d640 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c87490e10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff344005940 tx=0x7ff344005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdb4c108d532fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff333fff640 1 -- 172.21.15.46:0/2616061614 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344035040 con 0x555c874945d0 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff333fff640 1 -- 172.21.15.46:0/2616061614 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff344031a70 con 0x555c874945d0 2024-09-19T09:19:51.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.550+0000 7ff333fff640 1 -- 172.21.15.46:0/2616061614 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344047610 con 0x555c874945d0 2024-09-19T09:19:51.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- 172.21.15.46:0/2616061614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 msgr2=0x555c87490e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c87490e10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff344005940 tx=0x7ff344005760 comp rx=0 tx=0).stop 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- 172.21.15.46:0/2616061614 shutdown_connections 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c874b8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- 172.21.15.46:0/2616061614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c87490e10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- 172.21.15.46:0/2616061614 >> 172.21.15.46:0/2616061614 conn(0x555c8745d310 msgr2=0x555c87490700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- 172.21.15.46:0/2616061614 shutdown_connections 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- 172.21.15.46:0/2616061614 wait complete. 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- start start 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 Processor -- start 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c874a9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c8749aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481ac7f0 con 0x555c874945d0 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481ac120 con 0x555c87495b40 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff3481a9380 con 0x555c874a1580 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.551+0000 7ff352aca740 10 client.0 _ll_register_callbacks cb 0x7ff338017eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34e48d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c874a9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34e48d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c874a9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49948/0 (socket says 172.21.15.46:49948) 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34e48d640 1 -- 172.21.15.46:0/847072388 learned_addr learned my addr 172.21.15.46:0/847072388 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c8749aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 -- 172.21.15.46:0/847072388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 msgr2=0x555c8749aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c8749aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 -- 172.21.15.46:0/847072388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 msgr2=0x555c874a9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c874a9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 -- 172.21.15.46:0/847072388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8749b180 con 0x555c87495b40 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34e48d640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c874a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34ec8e640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c8749aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff34dc8c640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874a9db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff33800be60 tx=0x7ff338009390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f1efb3ef9b4fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff331ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff331ffb640 1 -- 172.21.15.46:0/847072388 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33801e040 con 0x555c87495b40 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff331ffb640 1 -- 172.21.15.46:0/847072388 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7ff338010ca0 con 0x555c87495b40 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.552+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff344031a70 con 0x555c87495b40 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff331ffb640 1 -- 172.21.15.46:0/847072388 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3380a4020 con 0x555c87495b40 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 10 client.25355 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:51.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c8751b620 con 0x555c87495b40 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff331ffb640 1 -- 172.21.15.46:0/847072388 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff344031a70 con 0x555c87495b40 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff331ffb640 1 -- 172.21.15.46:0/847072388 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7ff33809a800 con 0x555c87495b40 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 10 client.25355 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 10 client.25355 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 20 client.25355 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c8751be20 0x555c8751e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 4 client.25355 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c87401d70 con 0x555c8751be20 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.553+0000 7ff34e48d640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c8751be20 0x555c8751e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff34e48d640 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c8751be20 0x555c8751e210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=19fab8054ea45e64 server_cookie=89a773f1fabeb2b2 in_seq=0 out_seq=0 2024-09-19T09:19:51.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff331ffb640 10 client.25355 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff331ffb640 1 -- 172.21.15.46:0/847072388 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c87401d70 con 0x555c8751be20 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff331ffb640 10 client.25355 handle_command_reply: tid=0 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 client.25355 shutdown 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 msgr2=0x555c874a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874a9db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff33800be60 tx=0x7ff338009390 comp rx=0 tx=0).stop 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 shutdown_connections 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x555c8751be20 0x555c8751e210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555c874a1580 0x555c8749aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555c87495b40 0x555c874a9db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 --2- 172.21.15.46:0/847072388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555c874945d0 0x555c874a9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff331ffb640 0 client.25355 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:19:51.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 >> 172.21.15.46:0/847072388 conn(0x555c8745d310 msgr2=0x555c8749cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 shutdown_connections 2024-09-19T09:19:51.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 1 -- 172.21.15.46:0/847072388 wait complete. 2024-09-19T09:19:51.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.554+0000 7ff352aca740 20 client.25355 trim_cache size 0 max 16384 2024-09-19T09:19:51.565 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff3340a3240 msgr2=0x7ff3340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff3340a3240 0x7ff3340a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff340020000 tx=0x7ff34001f000 comp rx=0 tx=0).stop 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 msgr2=0x7ff348197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 0x7ff348197a80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff33800b4a0 tx=0x7ff33800b960 comp rx=0 tx=0).stop 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 shutdown_connections 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff3340a3240 0x7ff3340a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff348101e30 0x7ff348197a80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff348105e80 0x7ff34819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 --2- 172.21.15.46:0/2736299615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff348101480 0x7ff348197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:51.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 >> 172.21.15.46:0/2736299615 conn(0x7ff348077210 msgr2=0x7ff3481041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:51.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 shutdown_connections 2024-09-19T09:19:51.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:51.555+0000 7ff3506f1640 1 -- 172.21.15.46:0/2736299615 wait complete. 2024-09-19T09:19:52.234 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:19:52.490 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:52.926 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:52 smithi046 ceph-mon[31203]: pgmap v385: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 -- 172.21.15.46:0/1057643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d10102fc0 msgr2=0x7f4d101005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 --2- 172.21.15.46:0/1057643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d10102fc0 0x7f4d101005d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009900 tx=0x7f4d0002a3e0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 -- 172.21.15.46:0/1057643829 shutdown_connections 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 --2- 172.21.15.46:0/1057643829 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d10102fc0 0x7f4d101005d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 --2- 172.21.15.46:0/1057643829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1010e810 0x7f4d10110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 --2- 172.21.15.46:0/1057643829 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d10102b50 0x7f4d10100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 -- 172.21.15.46:0/1057643829 >> 172.21.15.46:0/1057643829 conn(0x7f4d10077210 msgr2=0x7f4d100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 -- 172.21.15.46:0/1057643829 shutdown_connections 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.009+0000 7f4d176c5640 1 -- 172.21.15.46:0/1057643829 wait complete. 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 Processor -- start 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 -- start start 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d10102b50 0x7f4d1019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1010e810 0x7f4d1019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 0x7f4d1019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d10114180 con 0x7f4d1019eed0 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d10114000 con 0x7f4d1010e810 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d176c5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4d10114300 con 0x7f4d10102b50 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d15c62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 0x7f4d1019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d15c62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 0x7f4d1019f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49972/0 (socket says 172.21.15.46:49972) 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.010+0000 7f4d15c62640 1 -- 172.21.15.46:0/3533687990 learned_addr learned my addr 172.21.15.46:0/3533687990 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15461640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d10102b50 0x7f4d1019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d14c60640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1010e810 0x7f4d1019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15c62640 1 -- 172.21.15.46:0/3533687990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d10102b50 msgr2=0x7f4d1019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15c62640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d10102b50 0x7f4d1019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15c62640 1 -- 172.21.15.46:0/3533687990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1010e810 msgr2=0x7f4d1019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15c62640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1010e810 0x7f4d1019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15c62640 1 -- 172.21.15.46:0/3533687990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1019f990 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d15c62640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 0x7f4d1019f380 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800cce0 tx=0x7f4d0800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d067fc640 1 -- 172.21.15.46:0/3533687990 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800f450 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1019fc80 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d067fc640 1 -- 172.21.15.46:0/3533687990 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0800fad0 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d067fc640 1 -- 172.21.15.46:0/3533687990 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08018c10 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.011+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d101a7460 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.013+0000 7f4d067fc640 1 -- 172.21.15.46:0/3533687990 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4d0800f5f0 con 0x7f4d1019eed0 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 Processor -- start 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 -- start start 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cf4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693d01760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b693c5a2f0 con 0x55b693cf45d0 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b693c01cf0 con 0x55b693cff370 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.014+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b693c562b0 con 0x55b693cf5b40 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cf4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cf4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49982/0 (socket says 172.21.15.46:49982) 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 -- 172.21.15.46:0/32872320 learned_addr learned my addr 172.21.15.46:0/32872320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d067fc640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4cfc0a32c0 0x7f4cfc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d14c60640 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693d01760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d14c60640 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 -- 172.21.15.46:0/32872320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 msgr2=0x55b693cf4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 -- 172.21.15.46:0/32872320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 msgr2=0x55b693d01760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693d01760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 -- 172.21.15.46:0/32872320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b693be63a0 con 0x55b693cf45d0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d14c60640 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15c62640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4cfc0a32c0 0x7f4cfc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d067fc640 1 -- 172.21.15.46:0/3533687990 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4d080cff90 con 0x7f4d1019eed0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15461640 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cf4a10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bd10 tx=0x7f4d0c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c4537e017d6aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4cfb7fe640 1 -- 172.21.15.46:0/32872320 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c004030 con 0x55b693cf45d0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4cfb7fe640 1 -- 172.21.15.46:0/32872320 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0c0041d0 con 0x55b693cf45d0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4d15c62640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4cfc0a32c0 0x7f4cfc0a5780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d0801f000 tx=0x7f4d08091a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.015+0000 7f4cfb7fe640 1 -- 172.21.15.46:0/32872320 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c011820 con 0x55b693cf45d0 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 -- 172.21.15.46:0/32872320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 msgr2=0x55b693cf4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cf4a10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bd10 tx=0x7f4d0c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 -- 172.21.15.46:0/32872320 shutdown_connections 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cf4a10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693d01760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/32872320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 -- 172.21.15.46:0/32872320 >> 172.21.15.46:0/32872320 conn(0x55b693cbd310 msgr2=0x55b693cf0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 -- 172.21.15.46:0/32872320 shutdown_connections 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.016+0000 7f4d19a9e740 1 -- 172.21.15.46:0/32872320 wait complete. 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 -- start start 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 Processor -- start 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cfed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cfc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cfc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b693d02070 con 0x55b693cf45d0 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b693c15060 con 0x55b693cff370 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b693d021f0 con 0x55b693cf5b40 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d19a9e740 10 client.0 _ll_register_callbacks cb 0x55b6939688c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.017+0000 7f4d14c60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cfed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cfed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49996/0 (socket says 172.21.15.46:49996) 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 -- 172.21.15.46:0/3078820657 learned_addr learned my addr 172.21.15.46:0/3078820657 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d15461640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cfc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 -- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 msgr2=0x55b693cfc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cfc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 -- 172.21.15.46:0/3078820657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 msgr2=0x55b693cfc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cfc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 -- 172.21.15.46:0/3078820657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6939cb3c0 con 0x55b693cf45d0 2024-09-19T09:19:53.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d15461640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cfc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d14c60640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cfed50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4d00000c00 tx=0x7f4d00009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f57896ebadee0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4cf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/3078820657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00035040 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d0c0041d0 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/3078820657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4d000035f0 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/3078820657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d0004e070 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d19a9e740 10 client.15807 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.018+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b693d0da60 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/3078820657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0c0041d0 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/3078820657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4d0003a040 con 0x55b693cf45d0 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d19a9e740 10 client.15807 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d19a9e740 10 client.15807 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:19:53.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d19a9e740 20 client.15807 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:53.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d0ef20 0x55b693d11350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d19a9e740 4 client.15807 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:53.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b693c67860 con 0x55b693d0ef20 2024-09-19T09:19:53.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.019+0000 7f4d15461640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d0ef20 0x55b693d11350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.020+0000 7f4d15461640 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d0ef20 0x55b693d11350 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=383b8da9bab5ae1f server_cookie=f1034026d4c849a1 in_seq=0 out_seq=0 2024-09-19T09:19:53.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.020+0000 7f4cf8ff9640 10 client.15807 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:53.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.020+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/3078820657 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b693c67860 con 0x55b693d0ef20 2024-09-19T09:19:53.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.020+0000 7f4cf8ff9640 10 client.15807 handle_command_reply: tid=0 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 client.15807 shutdown 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 msgr2=0x55b693cfed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cfed50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4d00000c00 tx=0x7f4d00009520 comp rx=0 tx=0).stop 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 shutdown_connections 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d0ef20 0x55b693d11350 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cfc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cfc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/3078820657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cfed50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 >> 172.21.15.46:0/3078820657 conn(0x55b693cbd310 msgr2=0x55b693cf6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4cf8ff9640 0 client.15807 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 shutdown_connections 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 1 -- 172.21.15.46:0/3078820657 wait complete. 2024-09-19T09:19:53.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.021+0000 7f4d19a9e740 20 client.15807 trim_cache size 0 max 16384 2024-09-19T09:19:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 Processor -- start 2024-09-19T09:19:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 -- start start 2024-09-19T09:19:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d101af620 con 0x55b693cf45d0 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d101b1190 con 0x55b693cff370 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4d101afcf0 con 0x55b693cf5b40 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.034+0000 7f4d14c60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cefc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50008/0 (socket says 172.21.15.46:50008) 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 -- 172.21.15.46:0/1829388382 learned_addr learned my addr 172.21.15.46:0/1829388382 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d15461640 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 -- 172.21.15.46:0/1829388382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 msgr2=0x55b693cf7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 -- 172.21.15.46:0/1829388382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 msgr2=0x55b693cf7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 -- 172.21.15.46:0/1829388382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b693cef310 con 0x55b693cf45d0 2024-09-19T09:19:53.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4d14c60640 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cefc10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4d0002a900 tx=0x7f4d00031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca14eb141e5a8f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4cfaffd640 1 -- 172.21.15.46:0/1829388382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00058070 con 0x55b693cf45d0 2024-09-19T09:19:53.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4cfaffd640 1 -- 172.21.15.46:0/1829388382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d00042070 con 0x55b693cf45d0 2024-09-19T09:19:53.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.035+0000 7f4cfaffd640 1 -- 172.21.15.46:0/1829388382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d00035030 con 0x55b693cf45d0 2024-09-19T09:19:53.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 -- 172.21.15.46:0/1829388382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 msgr2=0x55b693cefc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cefc10 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4d0002a900 tx=0x7f4d00031a70 comp rx=0 tx=0).stop 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 -- 172.21.15.46:0/1829388382 shutdown_connections 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/1829388382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693cefc10 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 -- 172.21.15.46:0/1829388382 >> 172.21.15.46:0/1829388382 conn(0x55b693cbd310 msgr2=0x55b693cef500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 -- 172.21.15.46:0/1829388382 shutdown_connections 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 -- 172.21.15.46:0/1829388382 wait complete. 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 -- start start 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.036+0000 7f4d19a9e740 1 Processor -- start 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693d07a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d101b0a90 con 0x55b693cf45d0 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4d101b03c0 con 0x55b693cff370 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4d101ad600 con 0x55b693cf5b40 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d19a9e740 10 client.0 _ll_register_callbacks cb 0x7f4d00009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d14c60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693d07a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d14c60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693d07a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50016/0 (socket says 172.21.15.46:50016) 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d14c60640 1 -- 172.21.15.46:0/525934432 learned_addr learned my addr 172.21.15.46:0/525934432 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d15461640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d14c60640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d15461640 1 -- 172.21.15.46:0/525934432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 msgr2=0x55b693cf9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d15461640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d15461640 1 -- 172.21.15.46:0/525934432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 msgr2=0x55b693d07a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d15461640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693d07a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d15461640 1 -- 172.21.15.46:0/525934432 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b693cf9770 con 0x55b693cf5b40 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.037+0000 7f4d14c60640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693d07a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d15461640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf8bc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55b693cfb890 tx=0x7f4d0c00b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=377c557ba9afe60f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4cf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/525934432 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c005620 con 0x55b693cf5b40 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/525934432 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4d0c0035f0 con 0x55b693cf5b40 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d00042070 con 0x55b693cf5b40 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/525934432 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d0c00be80 con 0x55b693cf5b40 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 10 client.25348 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b693d79ac0 con 0x55b693cf5b40 2024-09-19T09:19:53.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/525934432 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d00042070 con 0x55b693cf5b40 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/525934432 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4d0c027950 con 0x55b693cf5b40 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 10 client.25348 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 10 client.25348 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 20 client.25348 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d79f60 0x55b693d7c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 4 client.25348 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.038+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b693c61d70 con 0x55b693d79f60 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d14c60640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d79f60 0x55b693d7c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d14c60640 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d79f60 0x55b693d7c380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=72a81d562b9d3ab6 server_cookie=c0cb13efa5eaa7fa in_seq=0 out_seq=0 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4cf8ff9640 10 client.25348 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4cf8ff9640 1 -- 172.21.15.46:0/525934432 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b693c61d70 con 0x55b693d79f60 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4cf8ff9640 10 client.25348 handle_command_reply: tid=0 2024-09-19T09:19:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 client.25348 shutdown 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 msgr2=0x55b693cf8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf8bc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55b693cfb890 tx=0x7f4d0c00b9f0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 shutdown_connections 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55b693d79f60 0x55b693d7c380 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b693cff370 0x55b693cf9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b693cf5b40 0x55b693cf8bc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4cf8ff9640 0 client.25348 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 --2- 172.21.15.46:0/525934432 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b693cf45d0 0x55b693d07a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.039+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 >> 172.21.15.46:0/525934432 conn(0x55b693cbd310 msgr2=0x55b693cefd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 shutdown_connections 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d19a9e740 1 -- 172.21.15.46:0/525934432 wait complete. 2024-09-19T09:19:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d19a9e740 20 client.25348 trim_cache size 0 max 16384 2024-09-19T09:19:53.046 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:53.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4cfc0a32c0 msgr2=0x7f4cfc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4cfc0a32c0 0x7f4cfc0a5780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4d0801f000 tx=0x7f4d08091a60 comp rx=0 tx=0).stop 2024-09-19T09:19:53.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 msgr2=0x7f4d1019f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 0x7f4d1019f380 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800cce0 tx=0x7f4d0800a620 comp rx=0 tx=0).stop 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 shutdown_connections 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4cfc0a32c0 0x7f4cfc0a5780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d1019eed0 0x7f4d1019f380 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d1010e810 0x7f4d1019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 --2- 172.21.15.46:0/3533687990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d10102b50 0x7f4d1019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 >> 172.21.15.46:0/3533687990 conn(0x7f4d10077210 msgr2=0x7f4d1010fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 shutdown_connections 2024-09-19T09:19:53.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:53.040+0000 7f4d176c5640 1 -- 172.21.15.46:0/3533687990 wait complete. 2024-09-19T09:19:53.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:52 smithi115 ceph-mon[35055]: pgmap v385: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2024-09-19T09:19:53.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:52 smithi099 ceph-mon[35256]: pgmap v385: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 1.0 MiB/s wr, 30 op/s 2024-09-19T09:19:53.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:19:53.986 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 -- 172.21.15.46:0/2038474113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 msgr2=0x7fedf41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 --2- 172.21.15.46:0/2038474113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf41020b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fede4009900 tx=0x7fede402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 -- 172.21.15.46:0/2038474113 shutdown_connections 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 --2- 172.21.15.46:0/2038474113 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf41020b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 --2- 172.21.15.46:0/2038474113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf41025f0 0x7fedf4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 --2- 172.21.15.46:0/2038474113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf4100a40 0x7fedf4100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 -- 172.21.15.46:0/2038474113 >> 172.21.15.46:0/2038474113 conn(0x7fedf40fc1e0 msgr2=0x7fedf40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 -- 172.21.15.46:0/2038474113 shutdown_connections 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.420+0000 7fedfc03c640 1 -- 172.21.15.46:0/2038474113 wait complete. 2024-09-19T09:19:54.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 Processor -- start 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 -- start start 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf4100a40 0x7fedf406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf41025f0 0x7fedf419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedf410c710 con 0x7fedf4101c30 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fedf410c590 con 0x7fedf4100a40 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedfc03c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fedf410c890 con 0x7fedf41025f0 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedf95d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedf95d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf419ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50036/0 (socket says 172.21.15.46:50036) 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedf95d7640 1 -- 172.21.15.46:0/1396642451 learned_addr learned my addr 172.21.15.46:0/1396642451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.421+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf4100a40 0x7fedf406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf41025f0 0x7fedf419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedf95d7640 1 -- 172.21.15.46:0/1396642451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf41025f0 msgr2=0x7fedf419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedf95d7640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf41025f0 0x7fedf419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedf95d7640 1 -- 172.21.15.46:0/1396642451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf4100a40 msgr2=0x7fedf406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedf95d7640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf4100a40 0x7fedf406a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedf95d7640 1 -- 172.21.15.46:0/1396642451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf419f9b0 con 0x7fedf4101c30 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedf95d7640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf419ca80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fede4031440 tx=0x7fede4032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedeaffd640 1 -- 172.21.15.46:0/1396642451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede403f030 con 0x7fedf4101c30 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedeaffd640 1 -- 172.21.15.46:0/1396642451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fede4003ce0 con 0x7fedf4101c30 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf419fbe0 con 0x7fedf4101c30 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedeaffd640 1 -- 172.21.15.46:0/1396642451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4035070 con 0x7fedf4101c30 2024-09-19T09:19:54.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.422+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf41a0120 con 0x7fedf4101c30 2024-09-19T09:19:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.425+0000 7fedfedd5740 1 Processor -- start 2024-09-19T09:19:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 -- start start 2024-09-19T09:19:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b69a0 0x5627282b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 0x5627282bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282bc370 0x5627282be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56272821a2f0 con 0x5627282bc370 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5627281c2270 con 0x5627282b72e0 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfedd5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5627282162b0 con 0x5627282b69a0 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedeaffd640 1 -- 172.21.15.46:0/1396642451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fede4042030 con 0x7fedf4101c30 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 0x5627282bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 0x5627282bbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:59562/0 (socket says 172.21.15.46:59562) 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 -- 172.21.15.46:0/294433865 learned_addr learned my addr 172.21.15.46:0/294433865 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.433 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf95d7640 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282bc370 0x5627282be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b69a0 0x5627282b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 -- 172.21.15.46:0/294433865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b69a0 msgr2=0x5627282b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b69a0 0x5627282b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 -- 172.21.15.46:0/294433865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282bc370 msgr2=0x5627282be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282bc370 0x5627282be830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.426+0000 7fedf9dd8640 1 -- 172.21.15.46:0/294433865 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627281c1340 con 0x5627282b72e0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 0x5627282bbda0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fedf000ac70 tx=0x7fedf000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f46e00c4f3a9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7fedeaffd640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fede00a3370 0x7fede00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7feddffff640 1 -- 172.21.15.46:0/294433865 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0005220 con 0x5627282b72e0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7feddffff640 1 -- 172.21.15.46:0/294433865 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf0004c80 con 0x5627282b72e0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7feddffff640 1 -- 172.21.15.46:0/294433865 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0018940 con 0x5627282b72e0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fede00a3370 0x7fede00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.427+0000 7fedeaffd640 1 -- 172.21.15.46:0/1396642451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fede40efa90 con 0x7fedf4101c30 2024-09-19T09:19:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 -- 172.21.15.46:0/294433865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 msgr2=0x5627282bbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 0x5627282bbda0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fedf000ac70 tx=0x7fedf000f790 comp rx=0 tx=0).stop 2024-09-19T09:19:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fede00a3370 0x7fede00a5830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedec005fd0 tx=0x7fedec009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 -- 172.21.15.46:0/294433865 shutdown_connections 2024-09-19T09:19:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282bc370 0x5627282be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282b72e0 0x5627282bbda0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 --2- 172.21.15.46:0/294433865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b69a0 0x5627282b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 -- 172.21.15.46:0/294433865 >> 172.21.15.46:0/294433865 conn(0x5627282b2010 msgr2=0x5627282b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 -- 172.21.15.46:0/294433865 shutdown_connections 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.428+0000 7fedfedd5740 1 -- 172.21.15.46:0/294433865 wait complete. 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 -- start start 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 Processor -- start 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5627282bf340 con 0x5627282b69a0 2024-09-19T09:19:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5627281a3290 con 0x5627282bc370 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5627282bf4c0 con 0x5627282b72e0 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedfedd5740 10 client.0 _ll_register_callbacks cb 0x5627281d4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50062/0 (socket says 172.21.15.46:50062) 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.429+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3447966964 learned_addr learned my addr 172.21.15.46:0/3447966964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf95d7640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3447966964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 msgr2=0x5627282c10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 msgr2=0x5627282c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3447966964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562727f2d210 con 0x5627282b69a0 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c0b60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fedf001a040 tx=0x7fedf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f6cf1d0d5787eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7feddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7feddd7fa640 1 -- 172.21.15.46:0/3447966964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0027020 con 0x5627282b69a0 2024-09-19T09:19:54.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7feddd7fa640 1 -- 172.21.15.46:0/3447966964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fedf0005210 con 0x5627282b69a0 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedf0004c80 con 0x5627282b69a0 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7feddd7fa640 1 -- 172.21.15.46:0/3447966964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedf00044e0 con 0x5627282b69a0 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.430+0000 7fedfedd5740 10 client.15825 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562727ff9620 con 0x5627282b69a0 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7feddd7fa640 1 -- 172.21.15.46:0/3447966964 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf0004c80 con 0x5627282b69a0 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7feddd7fa640 1 -- 172.21.15.46:0/3447966964 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fedf00035f0 con 0x5627282b69a0 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 20 client.15825 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5627282cc500 0x5627282ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 4 client.15825 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562728227a20 con 0x5627282cc500 2024-09-19T09:19:54.439 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.431+0000 7fedf95d7640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5627282cc500 0x5627282ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.432+0000 7fedf95d7640 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5627282cc500 0x5627282ce960 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd45ab7ddd31f9 server_cookie=2922c673af9b2561 in_seq=0 out_seq=0 2024-09-19T09:19:54.440 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.432+0000 7feddd7fa640 10 client.15825 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.432+0000 7feddd7fa640 1 -- 172.21.15.46:0/3447966964 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562728227a20 con 0x5627282cc500 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.432+0000 7feddd7fa640 10 client.15825 handle_command_reply: tid=0 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.432+0000 7fedfedd5740 1 client.15825 shutdown 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 msgr2=0x5627282c0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c0b60 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fedf001a040 tx=0x7fedf00042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 shutdown_connections 2024-09-19T09:19:54.441 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5627282cc500 0x5627282ce960 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7feddd7fa640 0 client.15825 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3447966964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c0b60 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 >> 172.21.15.46:0/3447966964 conn(0x5627282b2010 msgr2=0x5627282b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 shutdown_connections 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 1 -- 172.21.15.46:0/3447966964 wait complete. 2024-09-19T09:19:54.442 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.433+0000 7fedfedd5740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T09:19:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.447+0000 7fedfedd5740 1 Processor -- start 2024-09-19T09:19:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.447+0000 7fedfedd5740 1 -- start start 2024-09-19T09:19:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.447+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.447+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.449 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedfedd5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedf41a8e50 con 0x5627282b69a0 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedfedd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fedf41aa9c0 con 0x5627282bc370 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedfedd5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fedf41a9520 con 0x5627282b72e0 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50070/0 (socket says 172.21.15.46:50070) 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3381059518 learned_addr learned my addr 172.21.15.46:0/3381059518 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf95d7640 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3381059518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 msgr2=0x5627282c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3381059518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 msgr2=0x5627282bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282bf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 -- 172.21.15.46:0/3381059518 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627282b77c0 con 0x5627282b69a0 2024-09-19T09:19:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c1130 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fedf000ac70 tx=0x7fedf0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbf940e3827588e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.448+0000 7feddf7fe640 1 -- 172.21.15.46:0/3381059518 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0027070 con 0x5627282b69a0 2024-09-19T09:19:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7feddf7fe640 1 -- 172.21.15.46:0/3381059518 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf003b070 con 0x5627282b69a0 2024-09-19T09:19:54.451 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7feddf7fe640 1 -- 172.21.15.46:0/3381059518 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0003c50 con 0x5627282b69a0 2024-09-19T09:19:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 -- 172.21.15.46:0/3381059518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 msgr2=0x5627282c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c1130 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fedf000ac70 tx=0x7fedf0001e70 comp rx=0 tx=0).stop 2024-09-19T09:19:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 -- 172.21.15.46:0/3381059518 shutdown_connections 2024-09-19T09:19:54.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 --2- 172.21.15.46:0/3381059518 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c1130 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 -- 172.21.15.46:0/3381059518 >> 172.21.15.46:0/3381059518 conn(0x5627282b2010 msgr2=0x5627282b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 -- 172.21.15.46:0/3381059518 shutdown_connections 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.449+0000 7fedfedd5740 1 -- 172.21.15.46:0/3381059518 wait complete. 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 -- start start 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 Processor -- start 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedf41aa2c0 con 0x5627282b69a0 2024-09-19T09:19:54.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fedf41a9bf0 con 0x5627282bc370 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fedf41a6e30 con 0x5627282b72e0 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfedd5740 10 client.0 _ll_register_callbacks cb 0x7fede40f4040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedf9dd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50080/0 (socket says 172.21.15.46:50080) 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedf9dd8640 1 -- 172.21.15.46:0/301458929 learned_addr learned my addr 172.21.15.46:0/301458929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedfa5d9640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.450+0000 7fedf95d7640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedf9dd8640 1 -- 172.21.15.46:0/301458929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 msgr2=0x5627282c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedf9dd8640 1 -- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 msgr2=0x5627282c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.458 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedf9dd8640 1 -- 172.21.15.46:0/301458929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627282c6e70 con 0x5627282b69a0 2024-09-19T09:19:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedf9dd8640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c5310 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fedf000f7d0 tx=0x7fedf0004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8447ac0e69c53946 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7feddd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7feddd7fa640 1 -- 172.21.15.46:0/301458929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0043030 con 0x5627282b69a0 2024-09-19T09:19:54.459 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7feddd7fa640 1 -- 172.21.15.46:0/301458929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fedf0005210 con 0x5627282b69a0 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedf003b070 con 0x5627282b69a0 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7feddd7fa640 1 -- 172.21.15.46:0/301458929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedf0027040 con 0x5627282b69a0 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedfedd5740 10 client.15831 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5627282c8180 con 0x5627282b69a0 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.451+0000 7feddd7fa640 1 -- 172.21.15.46:0/301458929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf003b070 con 0x5627282b69a0 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7feddd7fa640 1 -- 172.21.15.46:0/301458929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fedf00189c0 con 0x5627282b69a0 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedfedd5740 10 client.15831 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedfedd5740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedfedd5740 20 client.15831 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedfedd5740 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562728337870 0x562728339c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedfedd5740 4 client.15831 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:19:54.460 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562728221d70 con 0x562728337870 2024-09-19T09:19:54.461 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedf95d7640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562728337870 0x562728339c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.461 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7feddd7fa640 10 client.15831 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:54.461 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.452+0000 7fedf95d7640 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562728337870 0x562728339c90 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6ad68860ada4ad server_cookie=682d1ad931c880d4 in_seq=0 out_seq=0 2024-09-19T09:19:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7feddd7fa640 1 -- 172.21.15.46:0/301458929 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562728221d70 con 0x562728337870 2024-09-19T09:19:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7feddd7fa640 10 client.15831 handle_command_reply: tid=0 2024-09-19T09:19:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 client.15831 shutdown 2024-09-19T09:19:54.469 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 msgr2=0x5627282c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c5310 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fedf000f7d0 tx=0x7fedf0004f10 comp rx=0 tx=0).stop 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 shutdown_connections 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562728337870 0x562728339c90 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5627282bc370 0x5627282c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5627282b72e0 0x5627282c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 --2- 172.21.15.46:0/301458929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5627282b69a0 0x5627282c5310 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7feddd7fa640 0 client.15831 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.468+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 >> 172.21.15.46:0/301458929 conn(0x5627282b2010 msgr2=0x5627282b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 shutdown_connections 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfedd5740 1 -- 172.21.15.46:0/301458929 wait complete. 2024-09-19T09:19:54.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfedd5740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T09:19:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:19:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:19:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:19:54.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fede00a3370 msgr2=0x7fede00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfc03c640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fede00a3370 0x7fede00a5830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedec005fd0 tx=0x7fedec009600 comp rx=0 tx=0).stop 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 msgr2=0x7fedf419ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.469+0000 7fedfc03c640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf419ca80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fede4031440 tx=0x7fede4032e20 comp rx=0 tx=0).stop 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 shutdown_connections 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fede00a3370 0x7fede00a5830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedf4101c30 0x7fedf419ca80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fedf41025f0 0x7fedf419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 --2- 172.21.15.46:0/1396642451 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf4100a40 0x7fedf406a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 >> 172.21.15.46:0/1396642451 conn(0x7fedf40fc1e0 msgr2=0x7fedf4104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 shutdown_connections 2024-09-19T09:19:54.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:19:54.470+0000 7fedfc03c640 1 -- 172.21.15.46:0/1396642451 wait complete. 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/2992889614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 msgr2=0x7f1a381021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/2992889614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a381021d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009900 tx=0x7f1a2802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/2992889614 shutdown_connections 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/2992889614 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a38106f20 0x7f1a3810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/2992889614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a381027a0 0x7f1a381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/2992889614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a381021d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/2992889614 >> 172.21.15.46:0/2992889614 conn(0x7f1a380fd8b0 msgr2=0x7f1a380ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/2992889614 shutdown_connections 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.462+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/2992889614 wait complete. 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 Processor -- start 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 -- start start 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a38198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a381027a0 0x7f1a38198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a38106f20 0x7f1a3819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a38111fd0 con 0x7f1a38101df0 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a38111e50 con 0x7f1a381027a0 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.463+0000 7f1a3e6e7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1a38112150 con 0x7f1a38106f20 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a38198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a38198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50104/0 (socket says 172.21.15.46:50104) 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 -- 172.21.15.46:0/3798855805 learned_addr learned my addr 172.21.15.46:0/3798855805 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a377fe640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a381027a0 0x7f1a38198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a38106f20 0x7f1a3819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 -- 172.21.15.46:0/3798855805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a38106f20 msgr2=0x7f1a3819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a38106f20 0x7f1a3819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 -- 172.21.15.46:0/3798855805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a381027a0 msgr2=0x7f1a38198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a381027a0 0x7f1a38198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 -- 172.21.15.46:0/3798855805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3819d4c0 con 0x7f1a38101df0 2024-09-19T09:19:54.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a38106f20 0x7f1a3819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a37fff640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a38198510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a28004770 tx=0x7f1a28003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a357fa640 1 -- 172.21.15.46:0/3798855805 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2803f070 con 0x7f1a38101df0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a357fa640 1 -- 172.21.15.46:0/3798855805 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a28031ca0 con 0x7f1a38101df0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a357fa640 1 -- 172.21.15.46:0/3798855805 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28035030 con 0x7f1a38101df0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a3819d750 con 0x7f1a38101df0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.464+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a381a5090 con 0x7f1a38101df0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.467+0000 7f1a40ac0740 1 Processor -- start 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.467+0000 7f1a40ac0740 1 -- start start 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a357fa640 1 -- 172.21.15.46:0/3798855805 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1a28042070 con 0x7f1a38101df0 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55788c6422f0 con 0x55788c6e7370 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55788c5e9cf0 con 0x55788c6ddb40 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55788c63e2b0 con 0x55788c6dc5d0 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a3cc84640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50118/0 (socket says 172.21.15.46:50118) 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 -- 172.21.15.46:0/665861911 learned_addr learned my addr 172.21.15.46:0/665861911 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 -- 172.21.15.46:0/665861911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 msgr2=0x55788c6dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 -- 172.21.15.46:0/665861911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 msgr2=0x55788c6dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.468+0000 7f1a377fe640 1 -- 172.21.15.46:0/665861911 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788c5ce3a0 con 0x55788c6e7370 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a377fe640 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e9760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009c90 tx=0x7f1a2c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04578aa00d7a7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a357fa640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1a200a32c0 0x7f1a200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1a200a32c0 0x7f1a200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a1e7fc640 1 -- 172.21.15.46:0/665861911 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c023070 con 0x55788c6e7370 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a357fa640 1 -- 172.21.15.46:0/3798855805 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1a280efed0 con 0x7f1a38101df0 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a1e7fc640 1 -- 172.21.15.46:0/665861911 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2c009e40 con 0x55788c6e7370 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.469+0000 7f1a1e7fc640 1 -- 172.21.15.46:0/665861911 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c01eaf0 con 0x55788c6e7370 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 -- 172.21.15.46:0/665861911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 msgr2=0x55788c6e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1a200a32c0 0x7f1a200a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1a30005fd0 tx=0x7f1a30009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e9760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009c90 tx=0x7f1a2c011810 comp rx=0 tx=0).stop 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 -- 172.21.15.46:0/665861911 shutdown_connections 2024-09-19T09:19:54.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e9760 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/665861911 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 -- 172.21.15.46:0/665861911 >> 172.21.15.46:0/665861911 conn(0x55788c6a5310 msgr2=0x55788c6d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 -- 172.21.15.46:0/665861911 shutdown_connections 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 -- 172.21.15.46:0/665861911 wait complete. 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.470+0000 7f1a40ac0740 1 -- start start 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 Processor -- start 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6e4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55788c6ea070 con 0x55788c6e7370 2024-09-19T09:19:54.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55788c5fd060 con 0x55788c6ddb40 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55788c6ea1f0 con 0x55788c6dc5d0 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a40ac0740 10 client.0 _ll_register_callbacks cb 0x55788c3508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a3cc84640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a3cc84640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50130/0 (socket says 172.21.15.46:50130) 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a3cc84640 1 -- 172.21.15.46:0/2668253419 learned_addr learned my addr 172.21.15.46:0/2668253419 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a377fe640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6e4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a3cc84640 1 -- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 msgr2=0x55788c6e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.471+0000 7f1a3cc84640 1 -- 172.21.15.46:0/2668253419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 msgr2=0x55788c6e4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6e4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a3cc84640 1 -- 172.21.15.46:0/2668253419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788c3b33c0 con 0x55788c6e7370 2024-09-19T09:19:54.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e4650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1a30010cc0 tx=0x7f1a30004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ece36866da96ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a177fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a177fe640 1 -- 172.21.15.46:0/2668253419 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3002c060 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a177fe640 1 -- 172.21.15.46:0/2668253419 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1a30017030 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55788c64f860 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a177fe640 1 -- 172.21.15.46:0/2668253419 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1a30010cf0 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a40ac0740 10 client.15843 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55788c6f5ba0 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.472+0000 7f1a177fe640 1 -- 172.21.15.46:0/2668253419 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55788c64f860 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a177fe640 1 -- 172.21.15.46:0/2668253419 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1a3001c3f0 con 0x55788c6e7370 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a40ac0740 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a40ac0740 10 client.15843 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:19:54.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a40ac0740 20 client.15843 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c6f7060 0x55788c6f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a40ac0740 4 client.15843 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55788c649d70 con 0x55788c6f7060 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c6f7060 0x55788c6f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a177fe640 10 client.15843 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.473+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c6f7060 0x55788c6f94b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a7a5d21dd0768e2e server_cookie=4569913215d1dc40 in_seq=0 out_seq=0 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a177fe640 1 -- 172.21.15.46:0/2668253419 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55788c649d70 con 0x55788c6f7060 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a177fe640 10 client.15843 handle_command_reply: tid=0 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 client.15843 shutdown 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 msgr2=0x55788c6e4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e4650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1a30010cc0 tx=0x7f1a30004ab0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 shutdown_connections 2024-09-19T09:19:54.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c6f7060 0x55788c6f94b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6e7370 0x55788c6e4650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6ddb40 0x55788c6e4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2668253419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 >> 172.21.15.46:0/2668253419 conn(0x55788c6a5310 msgr2=0x55788c6de960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a177fe640 0 client.15843 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 shutdown_connections 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.474+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2668253419 wait complete. 2024-09-19T09:19:54.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.475+0000 7f1a40ac0740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 Processor -- start 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 -- start start 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6dc5d0 0x55788c6d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6e7370 0x55788c6df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a381ab2c0 con 0x55788c6ddb40 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a381ace30 con 0x55788c6dc5d0 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1a381ab990 con 0x55788c6e7370 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50144/0 (socket says 172.21.15.46:50144) 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 -- 172.21.15.46:0/107020822 learned_addr learned my addr 172.21.15.46:0/107020822 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a37fff640 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6dc5d0 0x55788c6d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6e7370 0x55788c6df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 -- 172.21.15.46:0/107020822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6e7370 msgr2=0x55788c6df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6e7370 0x55788c6df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 -- 172.21.15.46:0/107020822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6dc5d0 msgr2=0x55788c6d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6dc5d0 0x55788c6d8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a377fe640 1 -- 172.21.15.46:0/107020822 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788c6dbe80 con 0x55788c6ddb40 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.488+0000 7f1a37fff640 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6dc5d0 0x55788c6d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.489+0000 7f1a377fe640 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6f3310 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009c90 tx=0x7f1a2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a24781b980323b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.489+0000 7f1a1dffb640 1 -- 172.21.15.46:0/107020822 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c02a980 con 0x55788c6ddb40 2024-09-19T09:19:54.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.489+0000 7f1a1dffb640 1 -- 172.21.15.46:0/107020822 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2c0050d0 con 0x55788c6ddb40 2024-09-19T09:19:54.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.489+0000 7f1a1dffb640 1 -- 172.21.15.46:0/107020822 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c01ebb0 con 0x55788c6ddb40 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 -- 172.21.15.46:0/107020822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 msgr2=0x55788c6f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6f3310 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009c90 tx=0x7f1a2c009c20 comp rx=0 tx=0).stop 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 -- 172.21.15.46:0/107020822 shutdown_connections 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6f3310 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6e7370 0x55788c6df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/107020822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6dc5d0 0x55788c6d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 -- 172.21.15.46:0/107020822 >> 172.21.15.46:0/107020822 conn(0x55788c6a5310 msgr2=0x55788c6d8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 -- 172.21.15.46:0/107020822 shutdown_connections 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 -- 172.21.15.46:0/107020822 wait complete. 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 -- start start 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.490+0000 7f1a40ac0740 1 Processor -- start 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6ef660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6efba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6e7370 0x55788c6e0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a381ac730 con 0x55788c6ddb40 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a381ac060 con 0x55788c6e7370 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1a381a92a0 con 0x55788c6dc5d0 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a40ac0740 10 client.0 _ll_register_callbacks cb 0x7f1a30005bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50156/0 (socket says 172.21.15.46:50156) 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 -- 172.21.15.46:0/2432742665 learned_addr learned my addr 172.21.15.46:0/2432742665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a3cc84640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6e7370 0x55788c6e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 -- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 msgr2=0x55788c6ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 -- 172.21.15.46:0/2432742665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6e7370 msgr2=0x55788c6e0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6e7370 0x55788c6e0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 -- 172.21.15.46:0/2432742665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788c6e0fb0 con 0x55788c6ddb40 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a377fe640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6efba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c031000 tx=0x7f1a2c01e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eaf67a7e0e522e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a177fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:54.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.491+0000 7f1a177fe640 1 -- 172.21.15.46:0/2432742665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c03a030 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a177fe640 1 -- 172.21.15.46:0/2432742665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1a2c005490 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a2c0050d0 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a177fe640 1 -- 172.21.15.46:0/2432742665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1a2c02a980 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 10 client.15849 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55788c761750 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a177fe640 1 -- 172.21.15.46:0/2432742665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2c0050d0 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a177fe640 1 -- 172.21.15.46:0/2432742665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1a2c0035f0 con 0x55788c6ddb40 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 10 client.15849 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 10 client.15849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 20 client.15849 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c761c30 0x55788c764050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 4 client.15849 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:54.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.492+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55788c5c6170 con 0x55788c761c30 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c761c30 0x55788c764050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a177fe640 10 client.15849 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a37fff640 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c761c30 0x55788c764050 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d13ec8879cd8e9e server_cookie=c4a9cc9e3ccd59e3 in_seq=0 out_seq=0 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a177fe640 1 -- 172.21.15.46:0/2432742665 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55788c5c6170 con 0x55788c761c30 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a177fe640 10 client.15849 handle_command_reply: tid=0 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 client.15849 shutdown 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 msgr2=0x55788c6efba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6efba0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c031000 tx=0x7f1a2c01e500 comp rx=0 tx=0).stop 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 shutdown_connections 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55788c761c30 0x55788c764050 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55788c6ddb40 0x55788c6efba0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55788c6e7370 0x55788c6e0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 --2- 172.21.15.46:0/2432742665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55788c6dc5d0 0x55788c6ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 >> 172.21.15.46:0/2432742665 conn(0x55788c6a5310 msgr2=0x55788c6d74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a177fe640 0 client.15849 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:19:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.493+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 shutdown_connections 2024-09-19T09:19:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a40ac0740 1 -- 172.21.15.46:0/2432742665 wait complete. 2024-09-19T09:19:54.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a40ac0740 20 client.15849 trim_cache size 0 max 16384 2024-09-19T09:19:54.500 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1a200a32c0 msgr2=0x7f1a200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1a200a32c0 0x7f1a200a5780 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1a30005fd0 tx=0x7f1a30009500 comp rx=0 tx=0).stop 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 msgr2=0x7f1a38198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a38198510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1a28004770 tx=0x7f1a28003c10 comp rx=0 tx=0).stop 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 shutdown_connections 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1a200a32c0 0x7f1a200a5780 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a38106f20 0x7f1a3819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a381027a0 0x7f1a38198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 --2- 172.21.15.46:0/3798855805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a38101df0 0x7f1a38198510 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:54.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 >> 172.21.15.46:0/3798855805 conn(0x7f1a380fd8b0 msgr2=0x7f1a380fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 shutdown_connections 2024-09-19T09:19:54.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:54.494+0000 7f1a3e6e7640 1 -- 172.21.15.46:0/3798855805 wait complete. 2024-09-19T09:19:55.192 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:54 smithi046 ceph-mon[31203]: pgmap v386: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.0 MiB/s wr, 31 op/s 2024-09-19T09:19:55.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:54 smithi115 ceph-mon[35055]: pgmap v386: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.0 MiB/s wr, 31 op/s 2024-09-19T09:19:55.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:19:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:54 smithi099 ceph-mon[35256]: pgmap v386: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.0 MiB/s wr, 31 op/s 2024-09-19T09:19:55.481 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:55.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 -- 172.21.15.46:0/3015682398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54103660 msgr2=0x7fca5410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 --2- 172.21.15.46:0/3015682398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54103660 0x7fca5410bb50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca4402a480 comp rx=0 tx=0).stop 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 -- 172.21.15.46:0/3015682398 shutdown_connections 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 --2- 172.21.15.46:0/3015682398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54103660 0x7fca5410bb50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 --2- 172.21.15.46:0/3015682398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 0x7fca5410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 --2- 172.21.15.46:0/3015682398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca54102d40 0x7fca54103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 -- 172.21.15.46:0/3015682398 >> 172.21.15.46:0/3015682398 conn(0x7fca540fc7a0 msgr2=0x7fca540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 -- 172.21.15.46:0/3015682398 shutdown_connections 2024-09-19T09:19:55.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.930+0000 7fca5bb14640 1 -- 172.21.15.46:0/3015682398 wait complete. 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 Processor -- start 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 -- start start 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 0x7fca541983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca54103660 0x7fca541988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 0x7fca5419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111f70 con 0x7fca54102d40 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111df0 con 0x7fca54103660 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5bb14640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fca541120f0 con 0x7fca5410c170 2024-09-19T09:19:55.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 0x7fca541983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 0x7fca541983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50170/0 (socket says 172.21.15.46:50170) 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 -- 172.21.15.46:0/2053550862 learned_addr learned my addr 172.21.15.46:0/2053550862 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca590af640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca54103660 0x7fca541988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 0x7fca5419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 -- 172.21.15.46:0/2053550862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 msgr2=0x7fca5419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 0x7fca5419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 -- 172.21.15.46:0/2053550862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca54103660 msgr2=0x7fca541988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca54103660 0x7fca541988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca598b0640 1 -- 172.21.15.46:0/2053550862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5419d360 con 0x7fca54102d40 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.931+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 0x7fca5419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.932+0000 7fca598b0640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 0x7fca541983b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c920 tx=0x7fca5000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.932+0000 7fca4affd640 1 -- 172.21.15.46:0/2053550862 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50007c70 con 0x7fca54102d40 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.932+0000 7fca4affd640 1 -- 172.21.15.46:0/2053550862 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca50007e10 con 0x7fca54102d40 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.932+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5419d650 con 0x7fca54102d40 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.932+0000 7fca4affd640 1 -- 172.21.15.46:0/2053550862 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50018890 con 0x7fca54102d40 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.932+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541a4f30 con 0x7fca54102d40 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.934+0000 7fca4affd640 1 -- 172.21.15.46:0/2053550862 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fca50018a70 con 0x7fca54102d40 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.934+0000 7fca5deed740 1 Processor -- start 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 -- start start 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cb0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cbd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5587b6c162f0 con 0x5587b6cbb370 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5587b6bbdcf0 con 0x5587b6cb05d0 2024-09-19T09:19:55.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5deed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5587b6c122b0 con 0x5587b6cb1b40 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cbd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca598b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cb0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cbd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50186/0 (socket says 172.21.15.46:50186) 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 -- 172.21.15.46:0/1114259562 learned_addr learned my addr 172.21.15.46:0/1114259562 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca4affd640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fca400a32c0 0x7fca400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 -- 172.21.15.46:0/1114259562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 msgr2=0x5587b6cb0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 -- 172.21.15.46:0/1114259562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 msgr2=0x5587b6cb0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fca400a32c0 0x7fca400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cb0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.971 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca590af640 1 -- 172.21.15.46:0/1114259562 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587b6ba23a0 con 0x5587b6cbb370 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.935+0000 7fca4affd640 1 -- 172.21.15.46:0/2053550862 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca500cf9a0 con 0x7fca54102d40 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca590af640 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cbd760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca44031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a72fbf3dc4d9b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca3ffff640 1 -- 172.21.15.46:0/1114259562 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44040070 con 0x5587b6cbb370 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fca400a32c0 0x7fca400a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fca4c005cc0 tx=0x7fca4c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca3ffff640 1 -- 172.21.15.46:0/1114259562 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca44005020 con 0x5587b6cbb370 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca3ffff640 1 -- 172.21.15.46:0/1114259562 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44035040 con 0x5587b6cbb370 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca5deed740 1 -- 172.21.15.46:0/1114259562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 msgr2=0x5587b6cbd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.936+0000 7fca5deed740 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cbd760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca44031630 comp rx=0 tx=0).stop 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 -- 172.21.15.46:0/1114259562 shutdown_connections 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cbd760 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cb0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 --2- 172.21.15.46:0/1114259562 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 -- 172.21.15.46:0/1114259562 >> 172.21.15.46:0/1114259562 conn(0x5587b6c79310 msgr2=0x5587b6cacc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 -- 172.21.15.46:0/1114259562 shutdown_connections 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 -- 172.21.15.46:0/1114259562 wait complete. 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 -- start start 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 Processor -- start 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cbac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.937+0000 7fca5deed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5deed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cb8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5deed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5587b6cbe010 con 0x5587b6cbb370 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5deed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5587b6bd1060 con 0x5587b6cb05d0 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5deed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5587b6cbe190 con 0x5587b6cb1b40 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5deed740 10 client.0 _ll_register_callbacks cb 0x5587b69248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cb8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cb8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50190/0 (socket says 172.21.15.46:50190) 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 -- 172.21.15.46:0/159056496 learned_addr learned my addr 172.21.15.46:0/159056496 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca598b0640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cbac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca590af640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 -- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 msgr2=0x5587b6cb7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 -- 172.21.15.46:0/159056496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 msgr2=0x5587b6cbac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cbac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 -- 172.21.15.46:0/159056496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587b69873c0 con 0x5587b6cbb370 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cb8480 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00d3d0 tx=0x7fca4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f8258248edadff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca3d7fa640 1 -- 172.21.15.46:0/159056496 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c024070 con 0x5587b6cbb370 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44005020 con 0x5587b6cbb370 2024-09-19T09:19:55.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.938+0000 7fca3d7fa640 1 -- 172.21.15.46:0/159056496 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca4c020810 con 0x5587b6cbb370 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca3d7fa640 1 -- 172.21.15.46:0/159056496 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca4c030070 con 0x5587b6cbb370 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 10 client.15861 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587b6cc9a30 con 0x5587b6cbb370 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca3d7fa640 1 -- 172.21.15.46:0/159056496 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca44005020 con 0x5587b6cbb370 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca3d7fa640 1 -- 172.21.15.46:0/159056496 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fca4c01eb20 con 0x5587b6cbb370 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 10 client.15861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 20 client.15861 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6ccaef0 0x5587b6ccd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 4 client.15861 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587b6c23860 con 0x5587b6ccaef0 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.939+0000 7fca598b0640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6ccaef0 0x5587b6ccd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.940+0000 7fca598b0640 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6ccaef0 0x5587b6ccd360 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32f70784a441b160 server_cookie=9fc3c6aadd435dda in_seq=0 out_seq=0 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.940+0000 7fca3d7fa640 10 client.15861 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca3d7fa640 1 -- 172.21.15.46:0/159056496 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587b6c23860 con 0x5587b6ccaef0 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca3d7fa640 10 client.15861 handle_command_reply: tid=0 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 client.15861 shutdown 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 msgr2=0x5587b6cb8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cb8480 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00d3d0 tx=0x7fca4c004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 shutdown_connections 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6ccaef0 0x5587b6ccd360 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cbb370 0x5587b6cb8480 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cb7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca3d7fa640 0 client.15861 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 --2- 172.21.15.46:0/159056496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cbac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 >> 172.21.15.46:0/159056496 conn(0x5587b6c79310 msgr2=0x5587b6cb2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 shutdown_connections 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 1 -- 172.21.15.46:0/159056496 wait complete. 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.941+0000 7fca5deed740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 Processor -- start 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 -- start start 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cc72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cbb370 0x5587b6cbcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca541ab250 con 0x5587b6cb1b40 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca541acdc0 con 0x5587b6cb05d0 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.954+0000 7fca5deed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fca541ab920 con 0x5587b6cbb370 2024-09-19T09:19:55.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50202/0 (socket says 172.21.15.46:50202) 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 -- 172.21.15.46:0/850580425 learned_addr learned my addr 172.21.15.46:0/850580425 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cbb370 0x5587b6cbcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca598b0640 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cc72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 -- 172.21.15.46:0/850580425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cbb370 msgr2=0x5587b6cbcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cbb370 0x5587b6cbcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 -- 172.21.15.46:0/850580425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 msgr2=0x5587b6cc72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cc72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 -- 172.21.15.46:0/850580425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587b6ccd9e0 con 0x5587b6cb1b40 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca598b0640 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cc72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca590af640 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca4402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e203671b92c29a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca3f7fe640 1 -- 172.21.15.46:0/850580425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4404b070 con 0x5587b6cb1b40 2024-09-19T09:19:55.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca3f7fe640 1 -- 172.21.15.46:0/850580425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca44005020 con 0x5587b6cb1b40 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.955+0000 7fca3f7fe640 1 -- 172.21.15.46:0/850580425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44040070 con 0x5587b6cb1b40 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 -- 172.21.15.46:0/850580425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 msgr2=0x5587b6cbc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca4402a480 comp rx=0 tx=0).stop 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 -- 172.21.15.46:0/850580425 shutdown_connections 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cbb370 0x5587b6cbcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 --2- 172.21.15.46:0/850580425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cb05d0 0x5587b6cc72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 -- 172.21.15.46:0/850580425 >> 172.21.15.46:0/850580425 conn(0x5587b6c79310 msgr2=0x5587b6cb6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 -- 172.21.15.46:0/850580425 shutdown_connections 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 -- 172.21.15.46:0/850580425 wait complete. 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.956+0000 7fca5deed740 1 -- start start 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 Processor -- start 2024-09-19T09:19:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 0x5587b6cc3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cbb370 0x5587b6cbc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca541ac6c0 con 0x5587b6cb05d0 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca541abff0 con 0x5587b6cbb370 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fca541a9230 con 0x5587b6cb1b40 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5deed740 10 client.0 _ll_register_callbacks cb 0x7fca4c008bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 0x5587b6cc3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 0x5587b6cc3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50204/0 (socket says 172.21.15.46:50204) 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 -- 172.21.15.46:0/3235052666 learned_addr learned my addr 172.21.15.46:0/3235052666 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca5a0b1640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cbb370 0x5587b6cbc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca590af640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 -- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 msgr2=0x5587b6cbc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 -- 172.21.15.46:0/3235052666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cbb370 msgr2=0x5587b6cbc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cbb370 0x5587b6cbc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca598b0640 1 -- 172.21.15.46:0/3235052666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587b6cbcfc0 con 0x5587b6cb05d0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.957+0000 7fca590af640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca598b0640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 0x5587b6cc3bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fca500cd840 tx=0x7fca500983c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7661d2ed473842d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca3d7fa640 1 -- 172.21.15.46:0/3235052666 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5009bff0 con 0x5587b6cb05d0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca3d7fa640 1 -- 172.21.15.46:0/3235052666 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fca50018d60 con 0x5587b6cb05d0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44005020 con 0x5587b6cb05d0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca3d7fa640 1 -- 172.21.15.46:0/3235052666 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca500a03a0 con 0x5587b6cb05d0 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 10 client.15867 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:55.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5587b6d35c60 con 0x5587b6cb05d0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca3d7fa640 1 -- 172.21.15.46:0/3235052666 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca44005020 con 0x5587b6cb05d0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca3d7fa640 1 -- 172.21.15.46:0/3235052666 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fca5009c250 con 0x5587b6cb05d0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 10 client.15867 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 10 client.15867 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 20 client.15867 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6d362e0 0x5587b6d386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 4 client.15867 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.958+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5587b6c1dd70 con 0x5587b6d362e0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca590af640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6d362e0 0x5587b6d386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca590af640 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6d362e0 0x5587b6d386d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e18a765d0c9b875e server_cookie=65e63e8f4692f31a in_seq=0 out_seq=0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca3d7fa640 10 client.15867 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca3d7fa640 1 -- 172.21.15.46:0/3235052666 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5587b6c1dd70 con 0x5587b6d362e0 2024-09-19T09:19:55.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca3d7fa640 10 client.15867 handle_command_reply: tid=0 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca5deed740 1 client.15867 shutdown 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.959+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 msgr2=0x5587b6cc3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 0x5587b6cc3bf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fca500cd840 tx=0x7fca500983c0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 shutdown_connections 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5587b6d362e0 0x5587b6d386d0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5587b6cbb370 0x5587b6cbc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5587b6cb1b40 0x5587b6cbc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca3d7fa640 0 client.15867 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 --2- 172.21.15.46:0/3235052666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5587b6cb05d0 0x5587b6cc3bf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 >> 172.21.15.46:0/3235052666 conn(0x5587b6c79310 msgr2=0x5587b6cab4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 shutdown_connections 2024-09-19T09:19:55.984 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 1 -- 172.21.15.46:0/3235052666 wait complete. 2024-09-19T09:19:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5deed740 20 client.15867 trim_cache size 0 max 16384 2024-09-19T09:19:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fca400a32c0 msgr2=0x7fca400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fca400a32c0 0x7fca400a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fca4c005cc0 tx=0x7fca4c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 msgr2=0x7fca541983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 0x7fca541983b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fca5000c920 tx=0x7fca5000cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 shutdown_connections 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fca400a32c0 0x7fca400a5780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fca5410c170 0x7fca5419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca54103660 0x7fca541988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 --2- 172.21.15.46:0/2053550862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca54102d40 0x7fca541983b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 >> 172.21.15.46:0/2053550862 conn(0x7fca540fc7a0 msgr2=0x7fca540fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.960+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 shutdown_connections 2024-09-19T09:19:55.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:55.961+0000 7fca5bb14640 1 -- 172.21.15.46:0/2053550862 wait complete. 2024-09-19T09:19:56.786 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:19:57.047 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:57.169 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:56 smithi046 ceph-mon[31203]: pgmap v387: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.0 MiB/s wr, 21 op/s 2024-09-19T09:19:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:56 smithi115 ceph-mon[35055]: pgmap v387: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.0 MiB/s wr, 21 op/s 2024-09-19T09:19:57.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:56 smithi099 ceph-mon[35256]: pgmap v387: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.0 MiB/s wr, 21 op/s 2024-09-19T09:19:57.529 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:19:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 -- 172.21.15.46:0/231066637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10c180 msgr2=0x7f13ec10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 --2- 172.21.15.46:0/231066637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10c180 0x7f13ec10e600 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009ca0 tx=0x7f13e402a950 comp rx=0 tx=0).stop 2024-09-19T09:19:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 -- 172.21.15.46:0/231066637 shutdown_connections 2024-09-19T09:19:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 --2- 172.21.15.46:0/231066637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec10c180 0x7f13ec10e600 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 --2- 172.21.15.46:0/231066637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13ec1036c0 0x7f13ec10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 --2- 172.21.15.46:0/231066637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec102da0 0x7f13ec103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 -- 172.21.15.46:0/231066637 >> 172.21.15.46:0/231066637 conn(0x7f13ec0fc7a0 msgr2=0x7f13ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 -- 172.21.15.46:0/231066637 shutdown_connections 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 -- 172.21.15.46:0/231066637 wait complete. 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 Processor -- start 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.539+0000 7f13f3c06640 1 -- start start 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f3c06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13ec102da0 0x7f13ec19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f3c06640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 0x7f13ec19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f3c06640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec10c180 0x7f13ec19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f3c06640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec111fa0 con 0x7f13ec1036c0 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f3c06640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec111e20 con 0x7f13ec102da0 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f3c06640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec112120 con 0x7f13ec10c180 2024-09-19T09:19:57.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 0x7f13ec19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 0x7f13ec19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50234/0 (socket says 172.21.15.46:50234) 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 -- 172.21.15.46:0/1286369238 learned_addr learned my addr 172.21.15.46:0/1286369238 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f19a2640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13ec102da0 0x7f13ec19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f21a3640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec10c180 0x7f13ec19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 -- 172.21.15.46:0/1286369238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec10c180 msgr2=0x7f13ec19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec10c180 0x7f13ec19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 -- 172.21.15.46:0/1286369238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13ec102da0 msgr2=0x7f13ec19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13ec102da0 0x7f13ec19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 -- 172.21.15.46:0/1286369238 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ec19f570 con 0x7f13ec1036c0 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f21a3640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec10c180 0x7f13ec19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13f11a1640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 0x7f13ec19ab00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c920 tx=0x7f13dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.540+0000 7f13e2ffd640 1 -- 172.21.15.46:0/1286369238 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc007c70 con 0x7f13ec1036c0 2024-09-19T09:19:57.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.541+0000 7f13e2ffd640 1 -- 172.21.15.46:0/1286369238 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13dc007e10 con 0x7f13ec1036c0 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.541+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ec19f860 con 0x7f13ec1036c0 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.541+0000 7f13e2ffd640 1 -- 172.21.15.46:0/1286369238 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc018890 con 0x7f13ec1036c0 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.541+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ec1a7140 con 0x7f13ec1036c0 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.543+0000 7f13e2ffd640 1 -- 172.21.15.46:0/1286369238 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f13dc018a70 con 0x7f13ec1036c0 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.543+0000 7f13f5fdf740 1 Processor -- start 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 -- start start 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79d8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5560f793e2f0 con 0x5560f79d9b40 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5560f78e5cf0 con 0x5560f79d85d0 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5560f793a2b0 con 0x5560f79e3370 2024-09-19T09:19:57.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79d8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50242/0 (socket says 172.21.15.46:50242) 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 -- 172.21.15.46:0/269633250 learned_addr learned my addr 172.21.15.46:0/269633250 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13e2ffd640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13d80a3240 0x7f13d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f11a1640 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f19a2640 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79d8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13d80a3240 0x7f13d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 -- 172.21.15.46:0/269633250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 msgr2=0x5560f79e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 -- 172.21.15.46:0/269633250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 msgr2=0x5560f79d8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79d8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13f21a3640 1 -- 172.21.15.46:0/269633250 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f78ca3a0 con 0x5560f79d9b40 2024-09-19T09:19:57.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.544+0000 7f13e2ffd640 1 -- 172.21.15.46:0/1286369238 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f13dc0cfae0 con 0x7f13ec1036c0 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.545+0000 7f13f21a3640 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79d8090 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f13e402fd90 tx=0x7f13e402f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a407338419742599 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.545+0000 7f13f21a3640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13d80a3240 0x7f13d80a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f13e4047000 tx=0x7f13e4049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.545+0000 7f13d7fff640 1 -- 172.21.15.46:0/269633250 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e404e070 con 0x5560f79d9b40 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.545+0000 7f13d7fff640 1 -- 172.21.15.46:0/269633250 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e4004720 con 0x5560f79d9b40 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.545+0000 7f13d7fff640 1 -- 172.21.15.46:0/269633250 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4034040 con 0x5560f79d9b40 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 -- 172.21.15.46:0/269633250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 msgr2=0x5560f79d8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79d8090 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f13e402fd90 tx=0x7f13e402f4a0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 -- 172.21.15.46:0/269633250 shutdown_connections 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79d8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/269633250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79d8090 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 -- 172.21.15.46:0/269633250 >> 172.21.15.46:0/269633250 conn(0x5560f79a1310 msgr2=0x5560f79d4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 -- 172.21.15.46:0/269633250 shutdown_connections 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 -- 172.21.15.46:0/269633250 wait complete. 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 -- start start 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.546+0000 7f13f5fdf740 1 Processor -- start 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79e2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79e0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79e0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5560f79e6010 con 0x5560f79e3370 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5560f78f9060 con 0x5560f79d85d0 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5560f79e6190 con 0x5560f79d9b40 2024-09-19T09:19:57.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f5fdf740 10 client.0 _ll_register_callbacks cb 0x5560f764c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79e0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50258/0 (socket says 172.21.15.46:50258) 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 -- 172.21.15.46:0/4127591657 learned_addr learned my addr 172.21.15.46:0/4127591657 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f19a2640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79e2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f11a1640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 -- 172.21.15.46:0/4127591657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 msgr2=0x5560f79e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 -- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 msgr2=0x5560f79e2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79e2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 -- 172.21.15.46:0/4127591657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f76af3c0 con 0x5560f79e3370 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13f21a3640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79e0800 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f13e4005fc0 tx=0x7f13e402ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f7413ab3dcd5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.547+0000 7f13d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13d57fa640 1 -- 172.21.15.46:0/4127591657 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4055020 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13d57fa640 1 -- 172.21.15.46:0/4127591657 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f13e4049b30 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e4004720 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13d57fa640 1 -- 172.21.15.46:0/4127591657 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f13e404e070 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560f79e6010 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13d57fa640 1 -- 172.21.15.46:0/4127591657 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e4004720 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13d57fa640 1 -- 172.21.15.46:0/4127591657 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f13e4039930 con 0x5560f79e3370 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 20 client.15879 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f79f2ca0 0x5560f79f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 4 client.15879 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.548+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f794b860 con 0x5560f79f2ca0 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.549+0000 7f13f19a2640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f79f2ca0 0x5560f79f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.549+0000 7f13f19a2640 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f79f2ca0 0x5560f79f5090 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f98aa40016982 server_cookie=2de70f5d01a7ba44 in_seq=0 out_seq=0 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.549+0000 7f13d57fa640 10 client.15879 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13d57fa640 1 -- 172.21.15.46:0/4127591657 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560f794b860 con 0x5560f79f2ca0 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13d57fa640 10 client.15879 handle_command_reply: tid=0 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 client.15879 shutdown 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 msgr2=0x5560f79e0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79e0800 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f13e4005fc0 tx=0x7f13e402ff40 comp rx=0 tx=0).stop 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 shutdown_connections 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f79f2ca0 0x5560f79f5090 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79e0800 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/4127591657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79e2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13d57fa640 0 client.15879 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 >> 172.21.15.46:0/4127591657 conn(0x5560f79a1310 msgr2=0x5560f79da960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 shutdown_connections 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 1 -- 172.21.15.46:0/4127591657 wait complete. 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.550+0000 7f13f5fdf740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 Processor -- start 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 -- start start 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79db120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79db660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79fa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1af680 con 0x5560f79e3370 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1b11f0 con 0x5560f79d85d0 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.563+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1afd50 con 0x5560f79d9b40 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79fa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50264/0 (socket says 172.21.15.46:50264) 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 -- 172.21.15.46:0/3886413285 learned_addr learned my addr 172.21.15.46:0/3886413285 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 -- 172.21.15.46:0/3886413285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 msgr2=0x5560f79db660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79db660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 -- 172.21.15.46:0/3886413285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 msgr2=0x5560f79db120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f19a2640 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79db120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 -- 172.21.15.46:0/3886413285 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f79e3130 con 0x5560f79e3370 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13f21a3640 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79fa750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f13e4049550 tx=0x7f13e4009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7c8f84e572e844 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13d77fe640 1 -- 172.21.15.46:0/3886413285 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4055040 con 0x5560f79e3370 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13d77fe640 1 -- 172.21.15.46:0/3886413285 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e4009540 con 0x5560f79e3370 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.564+0000 7f13d77fe640 1 -- 172.21.15.46:0/3886413285 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e4039450 con 0x5560f79e3370 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3886413285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 msgr2=0x5560f79fa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79fa750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f13e4049550 tx=0x7f13e4009360 comp rx=0 tx=0).stop 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3886413285 shutdown_connections 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79e3370 0x5560f79fa750 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79d9b40 0x5560f79db660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3886413285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79db120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3886413285 >> 172.21.15.46:0/3886413285 conn(0x5560f79a1310 msgr2=0x5560f79df160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3886413285 shutdown_connections 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3886413285 wait complete. 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 -- start start 2024-09-19T09:19:57.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.565+0000 7f13f5fdf740 1 Processor -- start 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79ebc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1b0af0 con 0x5560f79d9b40 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1b0420 con 0x5560f79d85d0 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1ad660 con 0x5560f79e3370 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f5fdf740 10 client.0 _ll_register_callbacks cb 0x7f13e404c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50272/0 (socket says 172.21.15.46:50272) 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 -- 172.21.15.46:0/3072971520 learned_addr learned my addr 172.21.15.46:0/3072971520 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:57.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f19a2640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79ebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f21a3640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 -- 172.21.15.46:0/3072971520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 msgr2=0x5560f79e75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 -- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 msgr2=0x5560f79ebc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79ebc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f11a1640 1 -- 172.21.15.46:0/3072971520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f79e7de0 con 0x5560f79d9b40 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.566+0000 7f13f21a3640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f11a1640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79e6fc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0cd980 tx=0x7f13dc00ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab762a3087c1c096 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13d57fa640 1 -- 172.21.15.46:0/3072971520 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc09c830 con 0x5560f79d9b40 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13d57fa640 1 -- 172.21.15.46:0/3072971520 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f13dc00fb30 con 0x5560f79d9b40 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13e4009540 con 0x5560f79d9b40 2024-09-19T09:19:57.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13d57fa640 1 -- 172.21.15.46:0/3072971520 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f13dc00de20 con 0x5560f79d9b40 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 10 client.15885 fetch_fsmap learned FSMap version 29 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560f7a5d8e0 con 0x5560f79d9b40 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13d57fa640 1 -- 172.21.15.46:0/3072971520 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13e4009540 con 0x5560f79d9b40 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13d57fa640 1 -- 172.21.15.46:0/3072971520 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f13dc0987a0 con 0x5560f79d9b40 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 10 client.15885 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 10 client.15885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 20 client.15885 populate_metadata read hostname 'smithi046' 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f7a5e040 0x5560f7a60460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 4 client.15885 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.567+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560f7945d70 con 0x5560f7a5e040 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13f19a2640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f7a5e040 0x5560f7a60460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13f19a2640 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f7a5e040 0x5560f7a60460 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=478bd418bbf52891 server_cookie=461058869e07b8d8 in_seq=0 out_seq=0 2024-09-19T09:19:57.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13d57fa640 10 client.15885 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13d57fa640 1 -- 172.21.15.46:0/3072971520 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560f7945d70 con 0x5560f7a5e040 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13d57fa640 10 client.15885 handle_command_reply: tid=0 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13f5fdf740 1 client.15885 shutdown 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 msgr2=0x5560f79e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.568+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79e6fc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0cd980 tx=0x7f13dc00ef80 comp rx=0 tx=0).stop 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 shutdown_connections 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5560f7a5e040 0x5560f7a60460 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5560f79d9b40 0x5560f79e6fc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5560f79e3370 0x5560f79e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 --2- 172.21.15.46:0/3072971520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560f79d85d0 0x5560f79ebc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13d57fa640 0 client.15885 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 >> 172.21.15.46:0/3072971520 conn(0x5560f79a1310 msgr2=0x5560f79e18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 shutdown_connections 2024-09-19T09:19:57.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 1 -- 172.21.15.46:0/3072971520 wait complete. 2024-09-19T09:19:57.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f5fdf740 20 client.15885 trim_cache size 0 max 16384 2024-09-19T09:19:57.632 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13d80a3240 msgr2=0x7f13d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13d80a3240 0x7f13d80a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f13e4047000 tx=0x7f13e4049000 comp rx=0 tx=0).stop 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 msgr2=0x7f13ec19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 0x7f13ec19ab00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c920 tx=0x7f13dc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 shutdown_connections 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f13d80a3240 0x7f13d80a5700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13ec1036c0 0x7f13ec19ab00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f13ec10c180 0x7f13ec19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 --2- 172.21.15.46:0/1286369238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13ec102da0 0x7f13ec19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 >> 172.21.15.46:0/1286369238 conn(0x7f13ec0fc7a0 msgr2=0x7f13ec0fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 shutdown_connections 2024-09-19T09:19:57.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:57.569+0000 7f13f3c06640 1 -- 172.21.15.46:0/1286369238 wait complete. 2024-09-19T09:19:58.322 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:19:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 -- 172.21.15.46:0/2737794106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 msgr2=0x7fec60103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:58.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 --2- 172.21.15.46:0/2737794106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec60103120 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009900 tx=0x7fec5c02a480 comp rx=0 tx=0).stop 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 -- 172.21.15.46:0/2737794106 shutdown_connections 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 --2- 172.21.15.46:0/2737794106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec6010c170 0x7fec6010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 --2- 172.21.15.46:0/2737794106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec60103660 0x7fec6010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 --2- 172.21.15.46:0/2737794106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec60103120 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.761+0000 7fec68183640 1 -- 172.21.15.46:0/2737794106 >> 172.21.15.46:0/2737794106 conn(0x7fec600fc7a0 msgr2=0x7fec600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 -- 172.21.15.46:0/2737794106 shutdown_connections 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 -- 172.21.15.46:0/2737794106 wait complete. 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 Processor -- start 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 -- start start 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec601009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec60103660 0x7fec60100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:58.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec6010c170 0x7fec60101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fec60112030 con 0x7fec60102d40 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fec60111eb0 con 0x7fec6010c170 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec68183640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fec601121b0 con 0x7fec60103660 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec65f1f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec601009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec65f1f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec601009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40124/0 (socket says 172.21.15.46:40124) 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.762+0000 7fec65f1f640 1 -- 172.21.15.46:0/2745677457 learned_addr learned my addr 172.21.15.46:0/2745677457 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec6571e640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec60103660 0x7fec60100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec66720640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec6010c170 0x7fec60101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec65f1f640 1 -- 172.21.15.46:0/2745677457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec60103660 msgr2=0x7fec60100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec65f1f640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec60103660 0x7fec60100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec65f1f640 1 -- 172.21.15.46:0/2745677457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec6010c170 msgr2=0x7fec60101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec65f1f640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec6010c170 0x7fec60101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec65f1f640 1 -- 172.21.15.46:0/2745677457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec601a6b00 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec65f1f640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec601009a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005ab0 tx=0x7fec5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c03f030 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec601a6d90 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec5c003ce0 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c035070 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.763+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec601a7210 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.764+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec601031a0 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.765+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fec5c042030 con 0x7fec60102d40 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.766+0000 7fec56ffd640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fec4c0a3240 0x7fec4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.766+0000 7fec6571e640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fec4c0a3240 0x7fec4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:58.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.767+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fec5c0f0500 con 0x7fec60102d40 2024-09-19T09:19:58.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.767+0000 7fec6571e640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fec4c0a3240 0x7fec4c0a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fec600fee70 tx=0x7fec50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:58.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.770+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec5c0bd1f0 con 0x7fec60102d40 2024-09-19T09:19:58.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.989+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec60101ed0 con 0x7fec60102d40 2024-09-19T09:19:58.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.990+0000 7fec56ffd640 1 -- 172.21.15.46:0/2745677457 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11960 (secure 0 0 0) 0x7fec5c0bcaf0 con 0x7fec60102d40 2024-09-19T09:19:58.991 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:19:58.991 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"btime":"2024-09-19T09:19:44:798798+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:19:44.198190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:19:58.991 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fec4c0a3240 msgr2=0x7fec4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fec4c0a3240 0x7fec4c0a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fec600fee70 tx=0x7fec50008040 comp rx=0 tx=0).stop 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 msgr2=0x7fec601009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec601009a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005ab0 tx=0x7fec5c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 shutdown_connections 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fec4c0a3240 0x7fec4c0a5700 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec6010c170 0x7fec60101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec60103660 0x7fec60100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 --2- 172.21.15.46:0/2745677457 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fec60102d40 0x7fec601009a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:58.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 >> 172.21.15.46:0/2745677457 conn(0x7fec600fc7a0 msgr2=0x7fec600fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:58.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.992+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 shutdown_connections 2024-09-19T09:19:58.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:19:58.993+0000 7fec68183640 1 -- 172.21.15.46:0/2745677457 wait complete. 2024-09-19T09:19:59.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:58 smithi115 ceph-mon[35055]: pgmap v388: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2024-09-19T09:19:59.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:58 smithi046 ceph-mon[31203]: pgmap v388: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2024-09-19T09:19:59.239 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:19:59.240 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:19:59.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:58 smithi099 ceph-mon[35256]: pgmap v388: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.0 MiB/s wr, 22 op/s 2024-09-19T09:19:59.917 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id a7577c2a --release --await' 2024-09-19T09:19:59.918 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id a7577c2a --release --await 2024-09-19T09:20:00.036 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:00.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:19:59 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2745677457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:00.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:19:59 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2745677457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:00.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:19:59 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2745677457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:00.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 -- 172.21.15.46:0/1940754037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc1036c0 msgr2=0x7f1fcc10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/1940754037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc1036c0 0x7f1fcc10bbb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009900 tx=0x7f1fbc02a480 comp rx=0 tx=0).stop 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 -- 172.21.15.46:0/1940754037 shutdown_connections 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/1940754037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc1036c0 0x7f1fcc10bbb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/1940754037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc10c180 0x7f1fcc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/1940754037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc102da0 0x7f1fcc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 -- 172.21.15.46:0/1940754037 >> 172.21.15.46:0/1940754037 conn(0x7f1fcc0fc7a0 msgr2=0x7f1fcc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 -- 172.21.15.46:0/1940754037 shutdown_connections 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.513+0000 7f1fd45bc640 1 -- 172.21.15.46:0/1940754037 wait complete. 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 Processor -- start 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 -- start start 2024-09-19T09:20:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 0x7f1fcc100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc1036c0 0x7f1fcc100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc10c180 0x7f1fcc101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc111f60 con 0x7f1fcc102da0 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc111de0 con 0x7f1fcc10c180 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd45bc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1120e0 con 0x7f1fcc1036c0 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd2358640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 0x7f1fcc100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd2358640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 0x7f1fcc100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40138/0 (socket says 172.21.15.46:40138) 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.514+0000 7f1fd2358640 1 -- 172.21.15.46:0/4117769394 learned_addr learned my addr 172.21.15.46:0/4117769394 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc10c180 0x7f1fcc101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc1036c0 0x7f1fcc100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2358640 1 -- 172.21.15.46:0/4117769394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc1036c0 msgr2=0x7f1fcc100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2358640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc1036c0 0x7f1fcc100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2358640 1 -- 172.21.15.46:0/4117769394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc10c180 msgr2=0x7f1fcc101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2358640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc10c180 0x7f1fcc101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2358640 1 -- 172.21.15.46:0/4117769394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc1a68e0 con 0x7f1fcc102da0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc10c180 0x7f1fcc101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd2358640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 0x7f1fcc100a00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800d950 tx=0x7f1fc800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fc37fe640 1 -- 172.21.15.46:0/4117769394 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8017070 con 0x7f1fcc102da0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fc37fe640 1 -- 172.21.15.46:0/4117769394 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc8009c30 con 0x7f1fcc102da0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc1a6bd0 con 0x7f1fcc102da0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fc37fe640 1 -- 172.21.15.46:0/4117769394 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc800f6b0 con 0x7f1fcc102da0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.515+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc1a7160 con 0x7f1fcc102da0 2024-09-19T09:20:00.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fc37fe640 1 -- 172.21.15.46:0/4117769394 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1fc80109d0 con 0x7f1fcc102da0 2024-09-19T09:20:00.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 Processor -- start 2024-09-19T09:20:00.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 -- start start 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 0x55f2f44f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f4480 0x55f2f44fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4501130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f2f4459280 con 0x55f2f44f3b60 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f2f4400b10 con 0x55f2f44f4480 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.518+0000 7f1fd6995740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f2f4455240 con 0x55f2f44fed40 2024-09-19T09:20:00.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 0x55f2f44f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 0x55f2f44f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40148/0 (socket says 172.21.15.46:40148) 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 -- 172.21.15.46:0/2076325366 learned_addr learned my addr 172.21.15.46:0/2076325366 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fc37fe640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1fb80a32c0 0x7f1fb80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2358640 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f4480 0x55f2f44fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1fb80a32c0 0x7f1fb80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4501130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 -- 172.21.15.46:0/2076325366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 msgr2=0x55f2f4501130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4501130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 -- 172.21.15.46:0/2076325366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f4480 msgr2=0x55f2f44fe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f4480 0x55f2f44fe800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 -- 172.21.15.46:0/2076325366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2f440d1f0 con 0x55f2f44f3b60 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2358640 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f4480 0x55f2f44fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fc37fe640 1 -- 172.21.15.46:0/4117769394 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1fc80cf580 con 0x7f1fcc102da0 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 0x55f2f44f3f40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4013910 tx=0x7f1fc4013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8c6a26daec7976 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fc0ff9640 1 -- 172.21.15.46:0/2076325366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4004b20 con 0x55f2f44f3b60 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fc0ff9640 1 -- 172.21.15.46:0/2076325366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc4004cc0 con 0x55f2f44f3b60 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.519+0000 7f1fc0ff9640 1 -- 172.21.15.46:0/2076325366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4005850 con 0x55f2f44f3b60 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 -- 172.21.15.46:0/2076325366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 msgr2=0x55f2f44f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 0x55f2f44f3f40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4013910 tx=0x7f1fc4013dd0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1fb80a32c0 0x7f1fb80a5780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4020000 tx=0x7f1fc401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 -- 172.21.15.46:0/2076325366 shutdown_connections 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4501130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f4480 0x55f2f44fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 --2- 172.21.15.46:0/2076325366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f3b60 0x55f2f44f3f40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 -- 172.21.15.46:0/2076325366 >> 172.21.15.46:0/2076325366 conn(0x55f2f44f00f0 msgr2=0x55f2f44f04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 -- 172.21.15.46:0/2076325366 shutdown_connections 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.520+0000 7f1fd6995740 1 -- 172.21.15.46:0/2076325366 wait complete. 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 -- start start 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 Processor -- start 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f44fbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44f4480 0x55f2f44fc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 0x55f2f44fc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f2f4501910 con 0x55f2f44fed40 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f2f4413f10 con 0x55f2f44f3b60 2024-09-19T09:20:00.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f2f4501a90 con 0x55f2f44f4480 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd6995740 10 client.0 _ll_register_callbacks cb 0x55f2f43dca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd2b59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 0x55f2f44fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd2b59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 0x55f2f44fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40164/0 (socket says 172.21.15.46:40164) 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd2b59640 1 -- 172.21.15.46:0/3140440715 learned_addr learned my addr 172.21.15.46:0/3140440715 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd2358640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f44fbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.521+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44f4480 0x55f2f44fc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd2b59640 1 -- 172.21.15.46:0/3140440715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44f4480 msgr2=0x55f2f44fc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44f4480 0x55f2f44fc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd2b59640 1 -- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 msgr2=0x55f2f44fbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f44fbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd2b59640 1 -- 172.21.15.46:0/3140440715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2f41ca6a0 con 0x55f2f44fed40 2024-09-19T09:20:00.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 0x55f2f44fc620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40054b0 tx=0x7f1fc4004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4da6e620dc9cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/3140440715 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4005800 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/3140440715 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1fc4022030 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fc4004cc0 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/3140440715 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1fc4004e70 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd6995740 10 client.15903 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f2f450d4f0 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.522+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/3140440715 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fc4004cc0 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/3140440715 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1fc4026740 con 0x55f2f44fed40 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd6995740 10 client.15903 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd6995740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:00.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd6995740 20 client.15903 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd6995740 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f4510c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd6995740 4 client.15903 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2f44667f0 con 0x55f2f450e8a0 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd2358640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f4510c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fb5ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.523+0000 7f1fd2358640 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f4510c90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d761e59fdad0adab server_cookie=dd0aee877d3bbce4 in_seq=0 out_seq=0 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/3140440715 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2f44667f0 con 0x55f2f450e8a0 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fb5ffb640 10 client.15903 handle_command_reply: tid=0 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 client.15903 shutdown 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 msgr2=0x55f2f44fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 0x55f2f44fc620 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40054b0 tx=0x7f1fc4004b30 comp rx=0 tx=0).stop 2024-09-19T09:20:00.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 shutdown_connections 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f4510c90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44fed40 0x55f2f44fc620 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44f4480 0x55f2f44fc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fb5ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 --2- 172.21.15.46:0/3140440715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f44fbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 >> 172.21.15.46:0/3140440715 conn(0x55f2f44f00f0 msgr2=0x55f2f44ef270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 shutdown_connections 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 1 -- 172.21.15.46:0/3140440715 wait complete. 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.524+0000 7f1fd6995740 20 client.15903 trim_cache size 0 max 16384 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.541+0000 7f1fd6995740 1 Processor -- start 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.541+0000 7f1fd6995740 1 -- start start 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f45162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4516830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f44fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd6995740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1af720 con 0x55f2f44f4480 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd6995740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1b1290 con 0x55f2f44f3b60 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd6995740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1afdf0 con 0x55f2f44fed40 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4516830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4516830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40166/0 (socket says 172.21.15.46:40166) 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 -- 172.21.15.46:0/4252698327 learned_addr learned my addr 172.21.15.46:0/4252698327 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd2358640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f45162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f44fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 -- 172.21.15.46:0/4252698327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 msgr2=0x55f2f44fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f44fd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 -- 172.21.15.46:0/4252698327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 msgr2=0x55f2f45162f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f45162f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 -- 172.21.15.46:0/4252698327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2f44eff20 con 0x55f2f44f4480 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd2358640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f45162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f44fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.542+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4516830 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc005940 tx=0x7f1fbc032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4c1e21bf6de6a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fb7fff640 1 -- 172.21.15.46:0/4252698327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc035040 con 0x55f2f44f4480 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fb7fff640 1 -- 172.21.15.46:0/4252698327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fbc0317b0 con 0x55f2f44f4480 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fb7fff640 1 -- 172.21.15.46:0/4252698327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0046c0 con 0x55f2f44f4480 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 -- 172.21.15.46:0/4252698327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 msgr2=0x55f2f4516830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4516830 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc005940 tx=0x7f1fbc032c30 comp rx=0 tx=0).stop 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 -- 172.21.15.46:0/4252698327 shutdown_connections 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4516830 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f44fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 --2- 172.21.15.46:0/4252698327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f45162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 -- 172.21.15.46:0/4252698327 >> 172.21.15.46:0/4252698327 conn(0x55f2f44f00f0 msgr2=0x55f2f44fac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 -- 172.21.15.46:0/4252698327 shutdown_connections 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.543+0000 7f1fd6995740 1 -- 172.21.15.46:0/4252698327 wait complete. 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 -- start start 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 Processor -- start 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f4507540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4502870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4502e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1b0b90 con 0x55f2f44f4480 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1b04c0 con 0x55f2f44f3b60 2024-09-19T09:20:00.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1ad700 con 0x55f2f44fed40 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4502870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd6995740 10 client.0 _ll_register_callbacks cb 0x7f1fc4013710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4502870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40180/0 (socket says 172.21.15.46:40180) 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 -- 172.21.15.46:0/557175870 learned_addr learned my addr 172.21.15.46:0/557175870 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd2358640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f4507540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd2b59640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4502e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 -- 172.21.15.46:0/557175870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 msgr2=0x55f2f4502e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4502e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 -- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 msgr2=0x55f2f4507540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f4507540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.544+0000 7f1fd1b57640 1 -- 172.21.15.46:0/557175870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2f44ea680 con 0x55f2f44f4480 2024-09-19T09:20:00.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd2358640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f4507540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd1b57640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4502870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc02a4c0 tx=0x7f1fbc005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dd194161d62776 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/557175870 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc035070 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/557175870 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1fbc004440 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fbc0317b0 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/557175870 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1fbc031a20 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd6995740 10 client.15909 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f2f45791b0 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/557175870 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fbc0317b0 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/557175870 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f1fbc045800 con 0x55f2f44f4480 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd6995740 10 client.15909 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:00.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.545+0000 7f1fd6995740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fd6995740 20 client.15909 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fd6995740 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f457b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fd6995740 4 client.15909 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f2f4460d00 con 0x55f2f450e8a0 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fd2358640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f457b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fd2358640 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f457b960 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f801e68eaacc72 server_cookie=93ff7e1d0565aebc in_seq=0 out_seq=0 2024-09-19T09:20:00.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.546+0000 7f1fb5ffb640 10 client.15909 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fb5ffb640 1 -- 172.21.15.46:0/557175870 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f2f4460d00 con 0x55f2f450e8a0 2024-09-19T09:20:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fb5ffb640 10 client.15909 handle_command_reply: tid=0 2024-09-19T09:20:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 client.15909 shutdown 2024-09-19T09:20:00.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 msgr2=0x55f2f4502870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4502870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc02a4c0 tx=0x7f1fbc005750 comp rx=0 tx=0).stop 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 shutdown_connections 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f2f450e8a0 0x55f2f457b960 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f2f44f4480 0x55f2f4502870 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2f44fed40 0x55f2f4502e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fb5ffb640 0 client.15909 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 --2- 172.21.15.46:0/557175870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2f44f3b60 0x55f2f4507540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 >> 172.21.15.46:0/557175870 conn(0x55f2f44f00f0 msgr2=0x55f2f44fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.547+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 shutdown_connections 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd6995740 1 -- 172.21.15.46:0/557175870 wait complete. 2024-09-19T09:20:00.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd6995740 20 client.15909 trim_cache size 0 max 16384 2024-09-19T09:20:00.563 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:00.563 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-19T09:20:00.563 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "a6805da1-73fc-4a99-9a0b-daa82e4e3053", 2024-09-19T09:20:00.563 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-19T09:20:00.563 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1fb80a32c0 msgr2=0x7f1fb80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1fb80a32c0 0x7f1fb80a5780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4020000 tx=0x7f1fc401f000 comp rx=0 tx=0).stop 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 msgr2=0x7f1fcc100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 0x7f1fcc100a00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1fc800d950 tx=0x7f1fc800de10 comp rx=0 tx=0).stop 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 shutdown_connections 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1fb80a32c0 0x7f1fb80a5780 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fcc10c180 0x7f1fcc101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1fcc1036c0 0x7f1fcc100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 --2- 172.21.15.46:0/4117769394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1fcc102da0 0x7f1fcc100a00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 >> 172.21.15.46:0/4117769394 conn(0x7f1fcc0fc7a0 msgr2=0x7f1fcc0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 shutdown_connections 2024-09-19T09:20:00.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:00.548+0000 7f1fd45bc640 1 -- 172.21.15.46:0/4117769394 wait complete. 2024-09-19T09:20:01.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:00 smithi115 ceph-mon[35055]: pgmap v389: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2024-09-19T09:20:01.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:00 smithi115 ceph-mon[35055]: overall HEALTH_OK 2024-09-19T09:20:01.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:00 smithi046 ceph-mon[31203]: pgmap v389: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2024-09-19T09:20:01.214 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:00 smithi046 ceph-mon[31203]: overall HEALTH_OK 2024-09-19T09:20:01.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:20:01.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:00 smithi099 ceph-mon[35256]: pgmap v389: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 7.7 KiB/s wr, 15 op/s 2024-09-19T09:20:01.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:00 smithi099 ceph-mon[35256]: overall HEALTH_OK 2024-09-19T09:20:01.322 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 -- 172.21.15.46:0/3087272169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894100e20 msgr2=0x7fe894101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3087272169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894100e20 0x7fe894101200 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe884009ca0 tx=0x7fe88402a950 comp rx=0 tx=0).stop 2024-09-19T09:20:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 -- 172.21.15.46:0/3087272169 shutdown_connections 2024-09-19T09:20:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3087272169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe894102ef0 0x7fe89410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3087272169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894102570 0x7fe8941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3087272169 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894100e20 0x7fe894101200 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 -- 172.21.15.46:0/3087272169 >> 172.21.15.46:0/3087272169 conn(0x7fe8940fc7d0 msgr2=0x7fe8940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 -- 172.21.15.46:0/3087272169 shutdown_connections 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.805+0000 7fe898aa0640 1 -- 172.21.15.46:0/3087272169 wait complete. 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.806+0000 7fe898aa0640 1 Processor -- start 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.806+0000 7fe898aa0640 1 -- start start 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe898aa0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 0x7fe894199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe898aa0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe894102570 0x7fe8941998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe898aa0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 0x7fe8941a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe898aa0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe894110ff0 con 0x7fe894102ef0 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe898aa0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe894110e70 con 0x7fe894100e20 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe898aa0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe894111170 con 0x7fe894102570 2024-09-19T09:20:01.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 0x7fe8941a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 0x7fe894199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 0x7fe894199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35356/0 (socket says 172.21.15.46:35356) 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 -- 172.21.15.46:0/3333047407 learned_addr learned my addr 172.21.15.46:0/3333047407 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 0x7fe8941a43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40196/0 (socket says 172.21.15.46:40196) 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe891d9b640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe894102570 0x7fe8941998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 -- 172.21.15.46:0/3333047407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe894102570 msgr2=0x7fe8941998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe894102570 0x7fe8941998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 -- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 msgr2=0x7fe8941a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 0x7fe8941a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe89259c640 1 -- 172.21.15.46:0/3333047407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8941a4920 con 0x7fe894100e20 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.807+0000 7fe892d9d640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 0x7fe8941a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:01.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.808+0000 7fe89259c640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 0x7fe894199360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe884005e30 tx=0x7fe884003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.808+0000 7fe88b7fe640 1 -- 172.21.15.46:0/3333047407 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884034040 con 0x7fe894100e20 2024-09-19T09:20:01.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.808+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe894197150 con 0x7fe894100e20 2024-09-19T09:20:01.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.808+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe894197620 con 0x7fe894100e20 2024-09-19T09:20:01.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.808+0000 7fe88b7fe640 1 -- 172.21.15.46:0/3333047407 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe88402fe10 con 0x7fe894100e20 2024-09-19T09:20:01.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.808+0000 7fe88b7fe640 1 -- 172.21.15.46:0/3333047407 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884045480 con 0x7fe894100e20 2024-09-19T09:20:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.811+0000 7fe88b7fe640 1 -- 172.21.15.46:0/3333047407 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe884037020 con 0x7fe894100e20 2024-09-19T09:20:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 Processor -- start 2024-09-19T09:20:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 -- start start 2024-09-19T09:20:01.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba060 0x556ec1eba440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1ec4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 0x556ec1ec7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556ec1e1f620 con 0x556ec1ec5240 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556ec1dc6e50 con 0x556ec1eba980 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe89ae79740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556ec1e1b5e0 con 0x556ec1eba060 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.812+0000 7fe891d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 0x556ec1ec7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 0x556ec1ec7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40198/0 (socket says 172.21.15.46:40198) 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 -- 172.21.15.46:0/1602958253 learned_addr learned my addr 172.21.15.46:0/1602958253 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe88b7fe640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe8800a3240 0x7fe8800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe89259c640 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1ec4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe892d9d640 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba060 0x556ec1eba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe892d9d640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe8800a3240 0x7fe8800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 -- 172.21.15.46:0/1602958253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba060 msgr2=0x556ec1eba440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba060 0x556ec1eba440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 -- 172.21.15.46:0/1602958253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 msgr2=0x556ec1ec4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1ec4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 -- 172.21.15.46:0/1602958253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec1db7d40 con 0x556ec1ec5240 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe892d9d640 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba060 0x556ec1eba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe88b7fe640 1 -- 172.21.15.46:0/3333047407 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8840f06a0 con 0x7fe894100e20 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.813+0000 7fe891d9b640 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 0x556ec1ec7630 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00bcb0 tx=0x7fe87c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3028565e8fdc0783 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.814+0000 7fe892d9d640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe8800a3240 0x7fe8800a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0133c0 tx=0x7fe88c0090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.814+0000 7fe888ff9640 1 -- 172.21.15.46:0/1602958253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c004030 con 0x556ec1ec5240 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.814+0000 7fe888ff9640 1 -- 172.21.15.46:0/1602958253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c0041d0 con 0x556ec1ec5240 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.814+0000 7fe888ff9640 1 -- 172.21.15.46:0/1602958253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0116a0 con 0x556ec1ec5240 2024-09-19T09:20:01.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 -- 172.21.15.46:0/1602958253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 msgr2=0x556ec1ec7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 0x556ec1ec7630 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00bcb0 tx=0x7fe87c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 -- 172.21.15.46:0/1602958253 shutdown_connections 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1ec5240 0x556ec1ec7630 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1ec4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1602958253 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba060 0x556ec1eba440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 -- 172.21.15.46:0/1602958253 >> 172.21.15.46:0/1602958253 conn(0x556ec1eb65f0 msgr2=0x556ec1eb69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 -- 172.21.15.46:0/1602958253 shutdown_connections 2024-09-19T09:20:01.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 -- 172.21.15.46:0/1602958253 wait complete. 2024-09-19T09:20:01.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 -- start start 2024-09-19T09:20:01.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.815+0000 7fe89ae79740 1 Processor -- start 2024-09-19T09:20:01.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ec20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba980 0x556ec1ec2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1ec5240 0x556ec1ec2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x556ec1ec7e10 con 0x556ec1eba060 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x556ec1da7f10 con 0x556ec1ec5240 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556ec1ec7f90 con 0x556ec1eba980 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89ae79740 10 client.0 _ll_register_callbacks cb 0x556ec1dcbdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ec20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ec20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40200/0 (socket says 172.21.15.46:40200) 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 -- 172.21.15.46:0/3676582087 learned_addr learned my addr 172.21.15.46:0/3676582087 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe892d9d640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1ec5240 0x556ec1ec2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe891d9b640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba980 0x556ec1ec2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 -- 172.21.15.46:0/3676582087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba980 msgr2=0x556ec1ec2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba980 0x556ec1ec2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 -- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1ec5240 msgr2=0x556ec1ec2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1ec5240 0x556ec1ec2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.816+0000 7fe89259c640 1 -- 172.21.15.46:0/3676582087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec1b2e580 con 0x556ec1eba060 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe89259c640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ec20e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe8840ee1d0 tx=0x7fe8840bc960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae851c8e905529b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe879ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe879ffb640 1 -- 172.21.15.46:0/3676582087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88402c040 con 0x556ec1eba060 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe879ffb640 1 -- 172.21.15.46:0/3676582087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe8840baff0 con 0x556ec1eba060 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe87c0041d0 con 0x556ec1eba060 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe879ffb640 1 -- 172.21.15.46:0/3676582087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe8840c5960 con 0x556ec1eba060 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe89ae79740 10 client.15921 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ec1bf8960 con 0x556ec1eba060 2024-09-19T09:20:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe879ffb640 1 -- 172.21.15.46:0/3676582087 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c0041d0 con 0x556ec1eba060 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.817+0000 7fe879ffb640 1 -- 172.21.15.46:0/3676582087 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe88404d030 con 0x556ec1eba060 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe89ae79740 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe89ae79740 10 client.15921 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe89ae79740 20 client.15921 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe89ae79740 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1ed4da0 0x556ec1ed7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe89ae79740 4 client.15921 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ec1e2cb90 con 0x556ec1ed4da0 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe891d9b640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1ed4da0 0x556ec1ed7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe891d9b640 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1ed4da0 0x556ec1ed7240 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd934b372c1d713 server_cookie=255f3d4509e2ae94 in_seq=0 out_seq=0 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.818+0000 7fe879ffb640 10 client.15921 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe879ffb640 1 -- 172.21.15.46:0/3676582087 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ec1e2cb90 con 0x556ec1ed4da0 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe879ffb640 10 client.15921 handle_command_reply: tid=0 2024-09-19T09:20:01.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe89ae79740 1 client.15921 shutdown 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 msgr2=0x556ec1ec20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe89ae79740 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ec20e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe8840ee1d0 tx=0x7fe8840bc960 comp rx=0 tx=0).stop 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 shutdown_connections 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe89ae79740 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1ed4da0 0x556ec1ed7240 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.819+0000 7fe89ae79740 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1ec5240 0x556ec1ec2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe89ae79740 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1eba980 0x556ec1ec2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe89ae79740 1 --2- 172.21.15.46:0/3676582087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ec20e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 >> 172.21.15.46:0/3676582087 conn(0x556ec1eb65f0 msgr2=0x556ec1ebc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe879ffb640 0 client.15921 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 shutdown_connections 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe89ae79740 1 -- 172.21.15.46:0/3676582087 wait complete. 2024-09-19T09:20:01.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.820+0000 7fe89ae79740 20 client.15921 trim_cache size 0 max 16384 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 Processor -- start 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 -- start start 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ebcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1eb69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ed07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe87400e330 con 0x556ec1eba060 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe87400fea0 con 0x556ec1eba980 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89ae79740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe87400ea00 con 0x556ec1ec5240 2024-09-19T09:20:01.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe891d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1eb69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ebcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe891d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1eb69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35386/0 (socket says 172.21.15.46:35386) 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe891d9b640 1 -- 172.21.15.46:0/766348488 learned_addr learned my addr 172.21.15.46:0/766348488 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe89259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ebcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40202/0 (socket says 172.21.15.46:40202) 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.847+0000 7fe892d9d640 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ed07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe891d9b640 1 -- 172.21.15.46:0/766348488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 msgr2=0x556ec1ed07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe891d9b640 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ed07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe891d9b640 1 -- 172.21.15.46:0/766348488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 msgr2=0x556ec1ebcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe891d9b640 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ebcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe891d9b640 1 -- 172.21.15.46:0/766348488 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec1eb5610 con 0x556ec1eba980 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe891d9b640 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1eb69d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00bbd0 tx=0x7fe87c003d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fe89a02000d5606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe87bfff640 1 -- 172.21.15.46:0/766348488 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c02c030 con 0x556ec1eba980 2024-09-19T09:20:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe87bfff640 1 -- 172.21.15.46:0/766348488 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c003e70 con 0x556ec1eba980 2024-09-19T09:20:01.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.848+0000 7fe87bfff640 1 -- 172.21.15.46:0/766348488 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c005570 con 0x556ec1eba980 2024-09-19T09:20:01.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 -- 172.21.15.46:0/766348488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 msgr2=0x556ec1eb69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1eb69d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00bbd0 tx=0x7fe87c003d60 comp rx=0 tx=0).stop 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 -- 172.21.15.46:0/766348488 shutdown_connections 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ed07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba980 0x556ec1eb69d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 --2- 172.21.15.46:0/766348488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba060 0x556ec1ebcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 -- 172.21.15.46:0/766348488 >> 172.21.15.46:0/766348488 conn(0x556ec1eb65f0 msgr2=0x556ec1ed00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 -- 172.21.15.46:0/766348488 shutdown_connections 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.849+0000 7fe89ae79740 1 -- 172.21.15.46:0/766348488 wait complete. 2024-09-19T09:20:01.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 -- start start 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 Processor -- start 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba060 0x556ec1ec9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 0x556ec1ec9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ec9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe87400f7a0 con 0x556ec1eba980 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe87400f0d0 con 0x556ec1eba060 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe87400c310 con 0x556ec1ec5240 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89ae79740 10 client.0 _ll_register_callbacks cb 0x7fe884005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe891d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 0x556ec1ec9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe892d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ec9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe891d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 0x556ec1ec9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40218/0 (socket says 172.21.15.46:40218) 2024-09-19T09:20:01.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe891d9b640 1 -- 172.21.15.46:0/1310914314 learned_addr learned my addr 172.21.15.46:0/1310914314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.850+0000 7fe89259c640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba060 0x556ec1ec9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe892d9d640 1 -- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba060 msgr2=0x556ec1ec9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe892d9d640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba060 0x556ec1ec9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe892d9d640 1 -- 172.21.15.46:0/1310914314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 msgr2=0x556ec1ec9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe892d9d640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 0x556ec1ec9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe892d9d640 1 -- 172.21.15.46:0/1310914314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec1f3ed70 con 0x556ec1ec5240 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe891d9b640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 0x556ec1ec9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe89259c640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba060 0x556ec1ec9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe892d9d640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ec9cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009c30 tx=0x7fe88c0047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f444768224729445 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe879ffb640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe879ffb640 1 -- 172.21.15.46:0/1310914314 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c02f060 con 0x556ec1ec5240 2024-09-19T09:20:01.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe879ffb640 1 -- 172.21.15.46:0/1310914314 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe88c022aa0 con 0x556ec1ec5240 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe87c003e70 con 0x556ec1ec5240 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe879ffb640 1 -- 172.21.15.46:0/1310914314 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe88c019040 con 0x556ec1ec5240 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.851+0000 7fe89ae79740 10 client.25435 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ec1f40110 con 0x556ec1ec5240 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe879ffb640 1 -- 172.21.15.46:0/1310914314 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c003e70 con 0x556ec1ec5240 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe879ffb640 1 -- 172.21.15.46:0/1310914314 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe88c029030 con 0x556ec1ec5240 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 10 client.25435 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 10 client.25435 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 20 client.25435 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1f40890 0x556ec1f42cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 4 client.25435 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a7577c2a", "release": true, "await": true}] 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.852+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a7577c2a", "release": true, "await": true}) -- 0x556ec1e270a0 con 0x556ec1f40890 2024-09-19T09:20:01.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.853+0000 7fe89259c640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1f40890 0x556ec1f42cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.853+0000 7fe89259c640 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1f40890 0x556ec1f42cb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12f103f84eb3a46a server_cookie=942d06e6df8e974f in_seq=0 out_seq=0 2024-09-19T09:20:01.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.853+0000 7fe879ffb640 10 client.25435 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:01.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.857+0000 7fe879ffb640 1 -- 172.21.15.46:0/1310914314 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556ec1e270a0 con 0x556ec1f40890 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.857+0000 7fe879ffb640 10 client.25435 handle_command_reply: tid=0 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.857+0000 7fe89ae79740 1 client.25435 shutdown 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 msgr2=0x556ec1ec9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ec9cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009c30 tx=0x7fe88c0047d0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 shutdown_connections 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x556ec1f40890 0x556ec1f42cb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x556ec1eba980 0x556ec1ec9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556ec1ec5240 0x556ec1ec9cd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 --2- 172.21.15.46:0/1310914314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556ec1eba060 0x556ec1ec9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe879ffb640 0 client.25435 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:01.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 >> 172.21.15.46:0/1310914314 conn(0x556ec1eb65f0 msgr2=0x556ec1ed08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 shutdown_connections 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 1 -- 172.21.15.46:0/1310914314 wait complete. 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.858+0000 7fe89ae79740 20 client.25435 trim_cache size 0 max 16384 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 29, 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 8, 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:20:01.861 INFO:teuthology.orchestra.run.smithi046.stdout: "a7577c2a": { 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 8, 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 140.3, 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:20:01.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:01.863 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe8800a3240 msgr2=0x7fe8800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe8800a3240 0x7fe8800a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0133c0 tx=0x7fe88c0090e0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 msgr2=0x7fe894199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 0x7fe894199360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe884005e30 tx=0x7fe884003f90 comp rx=0 tx=0).stop 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 shutdown_connections 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe8800a3240 0x7fe8800a5700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe894102ef0 0x7fe8941a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe894102570 0x7fe8941998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 --2- 172.21.15.46:0/3333047407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe894100e20 0x7fe894199360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 >> 172.21.15.46:0/3333047407 conn(0x7fe8940fc7d0 msgr2=0x7fe894105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 shutdown_connections 2024-09-19T09:20:01.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:01.859+0000 7fe898aa0640 1 -- 172.21.15.46:0/3333047407 wait complete. 2024-09-19T09:20:01.865 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:02.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:01 smithi115 ceph-mon[35055]: scrub queued for path: / 2024-09-19T09:20:02.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:01 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:02.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:01 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:02.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:01 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:02.212 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:01 smithi046 ceph-mon[31203]: scrub queued for path: / 2024-09-19T09:20:02.213 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:01 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:02.213 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:01 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:02.213 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:01 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:02.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:01 smithi099 ceph-mon[35256]: scrub queued for path: / 2024-09-19T09:20:02.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:01 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:02.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:01 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:02.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:01 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:02.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 -- 172.21.15.46:0/2937244845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 msgr2=0x7fe1c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 --2- 172.21.15.46:0/2937244845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c41029b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8009900 tx=0x7fe1b802a480 comp rx=0 tx=0).stop 2024-09-19T09:20:02.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 -- 172.21.15.46:0/2937244845 shutdown_connections 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 --2- 172.21.15.46:0/2937244845 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c41029b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 --2- 172.21.15.46:0/2937244845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1c4102ef0 0x7fe1c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 --2- 172.21.15.46:0/2937244845 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4100e20 0x7fe1c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 -- 172.21.15.46:0/2937244845 >> 172.21.15.46:0/2937244845 conn(0x7fe1c40fc7d0 msgr2=0x7fe1c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 -- 172.21.15.46:0/2937244845 shutdown_connections 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.634+0000 7fe1cc760640 1 -- 172.21.15.46:0/2937244845 wait complete. 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 Processor -- start 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 -- start start 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1c4100e20 0x7fe1c40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4102ef0 0x7fe1c40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4110f80 con 0x7fe1c4102570 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4110e00 con 0x7fe1c4100e20 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cc760640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4111100 con 0x7fe1c4102ef0 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40226/0 (socket says 172.21.15.46:40226) 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/3612661547 learned_addr learned my addr 172.21.15.46:0/3612661547 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1c4100e20 0x7fe1c40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4102ef0 0x7fe1c40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/3612661547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4102ef0 msgr2=0x7fe1c40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4102ef0 0x7fe1c40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/3612661547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1c4100e20 msgr2=0x7fe1c40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.635+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1c4100e20 0x7fe1c40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/3612661547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c41a6a20 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4102ef0 0x7fe1c40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c40fd1c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8006010 tx=0x7fe1b8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1b77fe640 1 -- 172.21.15.46:0/3612661547 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b803f070 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c41a6cb0 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1b77fe640 1 -- 172.21.15.46:0/3612661547 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b8031c30 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1b77fe640 1 -- 172.21.15.46:0/3612661547 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8035030 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.636+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c41a7190 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.638+0000 7fe1b77fe640 1 -- 172.21.15.46:0/3612661547 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe1b8042070 con 0x7fe1c4102570 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 Processor -- start 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 -- start start 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd9a9522e0 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cd9a8f9ce0 con 0x55cd9a9f7680 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cd9a94e2a0 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1cacfd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1b77fe640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe1b00a3240 0x7fe1b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1cacfd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40240/0 (socket says 172.21.15.46:40240) 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1cacfd640 1 -- 172.21.15.46:0/894604180 learned_addr learned my addr 172.21.15.46:0/894604180 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe1b00a3240 0x7fe1b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1b77fe640 1 -- 172.21.15.46:0/3612661547 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe1b80eff80 con 0x7fe1c4102570 2024-09-19T09:20:02.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.639+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 -- 172.21.15.46:0/894604180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 msgr2=0x55cd9a9f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 -- 172.21.15.46:0/894604180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 msgr2=0x55cd9a9f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 -- 172.21.15.46:0/894604180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd9a8de440 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ec880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005c40 tx=0x7fe1bc012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db9d18a8df2ce74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1b4ff9640 1 -- 172.21.15.46:0/894604180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc023030 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1b4ff9640 1 -- 172.21.15.46:0/894604180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1bc01fc90 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1b4ff9640 1 -- 172.21.15.46:0/894604180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00fc20 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.640+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe1b00a3240 0x7fe1b00a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc023000 tx=0x7fe1bc022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 -- 172.21.15.46:0/894604180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 msgr2=0x55cd9a9ec880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ec880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005c40 tx=0x7fe1bc012f80 comp rx=0 tx=0).stop 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 -- 172.21.15.46:0/894604180 shutdown_connections 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/894604180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ec880 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 -- 172.21.15.46:0/894604180 >> 172.21.15.46:0/894604180 conn(0x55cd9a9e8a30 msgr2=0x55cd9a9e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 -- 172.21.15.46:0/894604180 shutdown_connections 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 -- 172.21.15.46:0/894604180 wait complete. 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 -- start start 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.641+0000 7fe1ceb39740 1 Processor -- start 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cd9a9fa250 con 0x55cd9a9f7680 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cd9a90d050 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cd9a9fa3d0 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 10 client.0 _ll_register_callbacks cb 0x55cd9a94d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40242/0 (socket says 172.21.15.46:40242) 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 -- 172.21.15.46:0/235944636 learned_addr learned my addr 172.21.15.46:0/235944636 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 -- 172.21.15.46:0/235944636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 msgr2=0x55cd9a9f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 -- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 msgr2=0x55cd9a9f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 -- 172.21.15.46:0/235944636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd9a6c33c0 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f4740 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005c10 tx=0x7fe1bc009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fadfb49b01633e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1adffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1adffb640 1 -- 172.21.15.46:0/235944636 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0049c0 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1adffb640 1 -- 172.21.15.46:0/235944636 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe1bc004b60 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.642+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1bc01fc90 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1adffb640 1 -- 172.21.15.46:0/235944636 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1bc004d60 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 10 client.15939 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cd9aa05bf0 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1adffb640 1 -- 172.21.15.46:0/235944636 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1bc01fc90 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1adffb640 1 -- 172.21.15.46:0/235944636 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe1bc01e070 con 0x55cd9a9f7680 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 10 client.15939 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:02.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 20 client.15939 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa07000 0x55cd9aa093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 4 client.15939 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd9a95f850 con 0x55cd9aa07000 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.643+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa07000 0x55cd9aa093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1adffb640 10 client.15939 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa07000 0x55cd9aa093f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9871cbad4c211091 server_cookie=2860f44c490a2eaf in_seq=0 out_seq=0 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1adffb640 1 -- 172.21.15.46:0/235944636 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd9a95f850 con 0x55cd9aa07000 2024-09-19T09:20:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1adffb640 10 client.15939 handle_command_reply: tid=0 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1ceb39740 1 client.15939 shutdown 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 msgr2=0x55cd9a9f4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.644+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f4740 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc005c10 tx=0x7fe1bc009480 comp rx=0 tx=0).stop 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 shutdown_connections 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa07000 0x55cd9aa093f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9a9f4740 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/235944636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1adffb640 0 client.15939 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 >> 172.21.15.46:0/235944636 conn(0x55cd9a9e8a30 msgr2=0x55cd9a9ee710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 shutdown_connections 2024-09-19T09:20:02.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 1 -- 172.21.15.46:0/235944636 wait complete. 2024-09-19T09:20:02.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.645+0000 7fe1ceb39740 20 client.15939 trim_cache size 0 max 16384 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 Processor -- start 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 -- start start 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9aa0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9aa0f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41af5d0 con 0x55cd9a9f7680 2024-09-19T09:20:02.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41b1140 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.662+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41afca0 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9aa0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9aa0ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35428/0 (socket says 172.21.15.46:35428) 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/319796002 learned_addr learned my addr 172.21.15.46:0/319796002 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9aa0f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/319796002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 msgr2=0x55cd9a9f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/319796002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 msgr2=0x55cd9aa0f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9aa0f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 -- 172.21.15.46:0/319796002 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd9aa09760 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.663+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9aa0ebe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80bc370 tx=0x7fe1b80bc1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2644c3fe402c4bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.664+0000 7fe1affff640 1 -- 172.21.15.46:0/319796002 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80d5070 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.664+0000 7fe1affff640 1 -- 172.21.15.46:0/319796002 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b80bc670 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.664+0000 7fe1affff640 1 -- 172.21.15.46:0/319796002 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8049070 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 -- 172.21.15.46:0/319796002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 msgr2=0x55cd9aa0ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9aa0ebe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80bc370 tx=0x7fe1b80bc1b0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 -- 172.21.15.46:0/319796002 shutdown_connections 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9f7680 0x55cd9aa0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9ecdc0 0x55cd9aa0ebe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/319796002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 -- 172.21.15.46:0/319796002 >> 172.21.15.46:0/319796002 conn(0x55cd9a9e8a30 msgr2=0x55cd9a9f6280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 -- 172.21.15.46:0/319796002 shutdown_connections 2024-09-19T09:20:02.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 -- 172.21.15.46:0/319796002 wait complete. 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 -- start start 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 Processor -- start 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.665+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ceb39740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9fd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41b0a40 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41b0370 con 0x55cd9a9f7680 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ceb39740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41ad5d0 con 0x55cd9a9ecdc0 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ceb39740 10 client.0 _ll_register_callbacks cb 0x7fe1bc0128f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40262/0 (socket says 172.21.15.46:40262) 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 -- 172.21.15.46:0/703184056 learned_addr learned my addr 172.21.15.46:0/703184056 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 -- 172.21.15.46:0/703184056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 msgr2=0x55cd9a9fcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9fcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 -- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 msgr2=0x55cd9a9fd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9fd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 -- 172.21.15.46:0/703184056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd9a9fdb20 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1cacfd640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1ca4fc640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ffbf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0005f00 tx=0x7fe1c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a687ec3b312f3210 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.666+0000 7fe1adffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1adffb640 1 -- 172.21.15.46:0/703184056 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c001d580 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1adffb640 1 -- 172.21.15.46:0/703184056 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fe1c001d720 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1b80bc670 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1adffb640 1 -- 172.21.15.46:0/703184056 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1c002d070 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 10 client.15945 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cd9aa71a40 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1adffb640 1 -- 172.21.15.46:0/703184056 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b80bc670 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1adffb640 1 -- 172.21.15.46:0/703184056 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fe1c0026ad0 con 0x55cd9a9ec4a0 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 10 client.15945 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 20 client.15945 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa72110 0x55cd9aa74500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 4 client.15945 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:20:02.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.667+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd9a9f4ad0 con 0x55cd9aa72110 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa72110 0x55cd9aa74500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1c9cfb640 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa72110 0x55cd9aa74500 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc2cf41c65ecfa8b server_cookie=3fe079a155219201 in_seq=0 out_seq=0 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1adffb640 10 client.15945 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1adffb640 1 -- 172.21.15.46:0/703184056 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cd9a9f4ad0 con 0x55cd9aa72110 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1adffb640 10 client.15945 handle_command_reply: tid=0 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 client.15945 shutdown 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 msgr2=0x55cd9a9ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ffbf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0005f00 tx=0x7fe1c000be20 comp rx=0 tx=0).stop 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 shutdown_connections 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cd9aa72110 0x55cd9aa74500 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cd9a9f7680 0x55cd9a9fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cd9a9ecdc0 0x55cd9a9fcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 --2- 172.21.15.46:0/703184056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cd9a9ec4a0 0x55cd9a9ffbf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1adffb640 0 client.15945 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.668+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 >> 172.21.15.46:0/703184056 conn(0x55cd9a9e8a30 msgr2=0x55cd9a9e7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 shutdown_connections 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1ceb39740 1 -- 172.21.15.46:0/703184056 wait complete. 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1ceb39740 20 client.15945 trim_cache size 0 max 16384 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stdout: "a6805da1-73fc-4a99-9a0b-daa82e4e3053": { 2024-09-19T09:20:02.675 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "a6805da1-73fc-4a99-9a0b-daa82e4e3053", 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe1b00a3240 msgr2=0x7fe1b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe1b00a3240 0x7fe1b00a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc023000 tx=0x7fe1bc022000 comp rx=0 tx=0).stop 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 msgr2=0x7fe1c40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c40fd1c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8006010 tx=0x7fe1b8003c10 comp rx=0 tx=0).stop 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 shutdown_connections 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe1b00a3240 0x7fe1b00a5700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1c4102570 0x7fe1c40fd1c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c4102ef0 0x7fe1c40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 --2- 172.21.15.46:0/3612661547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1c4100e20 0x7fe1c40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 >> 172.21.15.46:0/3612661547 conn(0x7fe1c40fc7d0 msgr2=0x7fe1c406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 shutdown_connections 2024-09-19T09:20:02.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:02.669+0000 7fe1cc760640 1 -- 172.21.15.46:0/3612661547 wait complete. 2024-09-19T09:20:03.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:02 smithi115 ceph-mon[35055]: pgmap v390: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:20:03.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:02 smithi046 ceph-mon[31203]: pgmap v390: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:20:03.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:02 smithi099 ceph-mon[35256]: pgmap v390: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:20:03.651 INFO:tasks.cephfs.filesystem:scrub status for tag:a6805da1-73fc-4a99-9a0b-daa82e4e3053 - {'path': '/', 'tag': 'a6805da1-73fc-4a99-9a0b-daa82e4e3053', 'options': 'recursive,force'} 2024-09-19T09:20:03.776 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a7577c2a', total seconds elapsed: 26.6 2024-09-19T09:20:03.776 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:20:03.777 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:04.041 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:04.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 -- 172.21.15.46:0/2984297629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 msgr2=0x7f55581021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 --2- 172.21.15.46:0/2984297629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f55581021f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5550009900 tx=0x7f555002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:04.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 -- 172.21.15.46:0/2984297629 shutdown_connections 2024-09-19T09:20:04.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 --2- 172.21.15.46:0/2984297629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 0x7f555810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 --2- 172.21.15.46:0/2984297629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 0x7f5558106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 --2- 172.21.15.46:0/2984297629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f55581021f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 -- 172.21.15.46:0/2984297629 >> 172.21.15.46:0/2984297629 conn(0x7f55580fd8d0 msgr2=0x7f55580ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 -- 172.21.15.46:0/2984297629 shutdown_connections 2024-09-19T09:20:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.524+0000 7f555fda2640 1 -- 172.21.15.46:0/2984297629 wait complete. 2024-09-19T09:20:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 Processor -- start 2024-09-19T09:20:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 -- start start 2024-09-19T09:20:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f5558198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 0x7f5558198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 0x7f555819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5558111fa0 con 0x7f5558101e10 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5558111e20 con 0x7f5558106f40 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555fda2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5558112120 con 0x7f55581027c0 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f5558198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f5558198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40282/0 (socket says 172.21.15.46:40282) 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 -- 172.21.15.46:0/375294666 learned_addr learned my addr 172.21.15.46:0/375294666 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:04.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555e33f640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 0x7f555819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555d33d640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 0x7f5558198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 -- 172.21.15.46:0/375294666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 msgr2=0x7f5558198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 0x7f5558198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 -- 172.21.15.46:0/375294666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 msgr2=0x7f555819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 0x7f555819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555db3e640 1 -- 172.21.15.46:0/375294666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555819d3d0 con 0x7f5558101e10 2024-09-19T09:20:04.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555d33d640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 0x7f5558198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.525+0000 7f555e33f640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 0x7f555819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.526+0000 7f555db3e640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f5558198420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5550006010 tx=0x7f55500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.526+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555003f030 con 0x7f5558101e10 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.526+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5550003ce0 con 0x7f5558101e10 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.526+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550035070 con 0x7f5558101e10 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.526+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555819d660 con 0x7f5558101e10 2024-09-19T09:20:04.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.526+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55581a4fa0 con 0x7f5558101e10 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.527+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55581021f0 con 0x7f5558101e10 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.528+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5550042030 con 0x7f5558101e10 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.529+0000 7f5556ffd640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f55400a32c0 0x7f55400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.529+0000 7f555d33d640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f55400a32c0 0x7f55400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.529+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f55500efe20 con 0x7f5558101e10 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.529+0000 7f555d33d640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f55400a32c0 0x7f55400a5780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f554c0058c0 tx=0x7f554c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:04.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.533+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55500bcbd0 con 0x7f5558101e10 2024-09-19T09:20:04.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.746+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f555810a120 con 0x7f5558101e10 2024-09-19T09:20:04.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.746+0000 7f5556ffd640 1 -- 172.21.15.46:0/375294666 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11960 (secure 0 0 0) 0x7f55500bc4d0 con 0x7f5558101e10 2024-09-19T09:20:04.747 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:20:04.747 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"btime":"2024-09-19T09:19:44:798798+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:19:44.198190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:20:04.747 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-09-19T09:20:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f55400a32c0 msgr2=0x7f55400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f55400a32c0 0x7f55400a5780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f554c0058c0 tx=0x7f554c005850 comp rx=0 tx=0).stop 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 msgr2=0x7f5558198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f5558198420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5550006010 tx=0x7f55500042f0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 shutdown_connections 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f55400a32c0 0x7f55400a5780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5558106f40 0x7f555819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55581027c0 0x7f5558198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 --2- 172.21.15.46:0/375294666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5558101e10 0x7f5558198420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.748+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 >> 172.21.15.46:0/375294666 conn(0x7f55580fd8d0 msgr2=0x7f55580fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.749+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 shutdown_connections 2024-09-19T09:20:04.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:04.749+0000 7f555fda2640 1 -- 172.21.15.46:0/375294666 wait complete. 2024-09-19T09:20:05.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:04 smithi115 ceph-mon[35055]: pgmap v391: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2024-09-19T09:20:05.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:04 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:20:05.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:04 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/375294666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:04 smithi046 ceph-mon[31203]: pgmap v391: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2024-09-19T09:20:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:04 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:20:05.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:04 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/375294666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:05.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:04 smithi099 ceph-mon[35256]: pgmap v391: 97 pgs: 97 active+clean; 13 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2024-09-19T09:20:05.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:04 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:20:05.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:04 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/375294666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:05.408 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:20:05.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:20:05.667 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:06.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 -- 172.21.15.46:0/3380419787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 msgr2=0x7f12e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:06.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 --2- 172.21.15.46:0/3380419787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e0103120 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f12d0009900 tx=0x7f12d002a480 comp rx=0 tx=0).stop 2024-09-19T09:20:06.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 -- 172.21.15.46:0/3380419787 shutdown_connections 2024-09-19T09:20:06.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 --2- 172.21.15.46:0/3380419787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e010c170 0x7f12e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 --2- 172.21.15.46:0/3380419787 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e0103660 0x7f12e010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 --2- 172.21.15.46:0/3380419787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e0103120 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 -- 172.21.15.46:0/3380419787 >> 172.21.15.46:0/3380419787 conn(0x7f12e00fc7a0 msgr2=0x7f12e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 -- 172.21.15.46:0/3380419787 shutdown_connections 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.150+0000 7f12e6373640 1 -- 172.21.15.46:0/3380419787 wait complete. 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.151+0000 7f12e6373640 1 Processor -- start 2024-09-19T09:20:06.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.151+0000 7f12e6373640 1 -- start start 2024-09-19T09:20:06.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e6373640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e6373640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e0103660 0x7f12e0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e6373640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e010c170 0x7f12e0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e6373640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0111fc0 con 0x7f12e0102d40 2024-09-19T09:20:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e6373640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0111e40 con 0x7f12e0103660 2024-09-19T09:20:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e6373640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0112140 con 0x7f12e010c170 2024-09-19T09:20:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e01009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40302/0 (socket says 172.21.15.46:40302) 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 -- 172.21.15.46:0/3816011152 learned_addr learned my addr 172.21.15.46:0/3816011152 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12df7fe640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e0103660 0x7f12e0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e4910640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e010c170 0x7f12e0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 -- 172.21.15.46:0/3816011152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e010c170 msgr2=0x7f12e0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e010c170 0x7f12e0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 -- 172.21.15.46:0/3816011152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e0103660 msgr2=0x7f12e0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e0103660 0x7f12e0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 -- 172.21.15.46:0/3816011152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e01a68f0 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12e4910640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e010c170 0x7f12e0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dffff640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e01009a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f12d0004770 tx=0x7f12d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dd7fa640 1 -- 172.21.15.46:0/3816011152 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d003f070 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.152+0000 7f12dd7fa640 1 -- 172.21.15.46:0/3816011152 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d0031ca0 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.153+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e01a6b80 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.153+0000 7f12dd7fa640 1 -- 172.21.15.46:0/3816011152 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0035030 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.153+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e01a7060 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12dd7fa640 1 -- 172.21.15.46:0/3816011152 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f12d0042070 con 0x7f12e0102d40 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 Processor -- start 2024-09-19T09:20:06.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 -- start start 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a249850 0x55683a249c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 0x55683a2544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a256e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55683a1ae160 con 0x55683a24a170 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55683a155720 con 0x55683a249850 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.155+0000 7f12e874c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55683a1aa120 con 0x55683a254a30 2024-09-19T09:20:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 0x55683a2544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 0x55683a2544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40304/0 (socket says 172.21.15.46:40304) 2024-09-19T09:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 -- 172.21.15.46:0/1899764702 learned_addr learned my addr 172.21.15.46:0/1899764702 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dd7fa640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f12c80a3240 0x7f12c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12e4910640 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a249850 0x55683a249c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12e4910640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f12c80a3240 0x7f12c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12df7fe640 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a256e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dd7fa640 1 -- 172.21.15.46:0/3816011152 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f12d00f00c0 con 0x7f12e0102d40 2024-09-19T09:20:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 -- 172.21.15.46:0/1899764702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 msgr2=0x55683a256e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a256e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 -- 172.21.15.46:0/1899764702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a249850 msgr2=0x55683a249c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a249850 0x55683a249c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 -- 172.21.15.46:0/1899764702 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556839f1fba0 con 0x55683a24a170 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12df7fe640 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a256e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12dffff640 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 0x55683a2544f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f12d00bc410 tx=0x7f12d003b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed81e9d225bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.156+0000 7f12c67fc640 1 -- 172.21.15.46:0/1899764702 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0049070 con 0x55683a24a170 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12c67fc640 1 -- 172.21.15.46:0/1899764702 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d00b8f00 con 0x55683a24a170 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12c67fc640 1 -- 172.21.15.46:0/1899764702 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d00c5380 con 0x55683a24a170 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 -- 172.21.15.46:0/1899764702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 msgr2=0x55683a2544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e4910640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f12c80a3240 0x7f12c80a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f12d8005c40 tx=0x7f12d8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 0x55683a2544f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f12d00bc410 tx=0x7f12d003b890 comp rx=0 tx=0).stop 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 -- 172.21.15.46:0/1899764702 shutdown_connections 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a24a170 0x55683a2544f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a256e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 --2- 172.21.15.46:0/1899764702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a249850 0x55683a249c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 -- 172.21.15.46:0/1899764702 >> 172.21.15.46:0/1899764702 conn(0x55683a245de0 msgr2=0x55683a2461c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 -- 172.21.15.46:0/1899764702 shutdown_connections 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.157+0000 7f12e874c740 1 -- 172.21.15.46:0/1899764702 wait complete. 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 -- start start 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 Processor -- start 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a251e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a252350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55683a2573c0 con 0x55683a249850 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55683a136900 con 0x55683a24a170 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55683a257540 con 0x55683a254a30 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12e874c740 10 client.0 _ll_register_callbacks cb 0x55683a134780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2518d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40306/0 (socket says 172.21.15.46:40306) 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12dffff640 1 -- 172.21.15.46:0/415340665 learned_addr learned my addr 172.21.15.46:0/415340665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.158+0000 7f12df7fe640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a251e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12e4910640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a252350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12dffff640 1 -- 172.21.15.46:0/415340665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 msgr2=0x55683a252350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12dffff640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a252350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12dffff640 1 -- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 msgr2=0x55683a251e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12dffff640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a251e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12dffff640 1 -- 172.21.15.46:0/415340665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55683a176c50 con 0x55683a249850 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12e4910640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a252350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12dffff640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2518d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f12d00b90e0 tx=0x7f12d00c0ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d323526f1b680a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:06.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12bf7fe640 1 -- 172.21.15.46:0/415340665 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0049070 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12bf7fe640 1 -- 172.21.15.46:0/415340665 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f12d003b4f0 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55683a1bb890 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12bf7fe640 1 -- 172.21.15.46:0/415340665 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12d0005d50 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12e874c740 10 client.15963 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55683a2573c0 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.159+0000 7f12bf7fe640 1 -- 172.21.15.46:0/415340665 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55683a1bb890 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12bf7fe640 1 -- 172.21.15.46:0/415340665 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f12d00bbb60 con 0x55683a249850 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12e874c740 10 client.15963 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12e874c740 10 client.15963 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12e874c740 20 client.15963 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12e874c740 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a264340 0x55683a266760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12e874c740 4 client.15963 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55683a1b5be0 con 0x55683a264340 2024-09-19T09:20:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12df7fe640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a264340 0x55683a266760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12df7fe640 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a264340 0x55683a266760 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e4cbbc80671da7 server_cookie=8a6dcd2433b911f1 in_seq=0 out_seq=0 2024-09-19T09:20:06.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.160+0000 7f12bf7fe640 10 client.15963 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12bf7fe640 1 -- 172.21.15.46:0/415340665 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55683a1b5be0 con 0x55683a264340 2024-09-19T09:20:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12bf7fe640 10 client.15963 handle_command_reply: tid=0 2024-09-19T09:20:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 client.15963 shutdown 2024-09-19T09:20:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 msgr2=0x55683a2518d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2518d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f12d00b90e0 tx=0x7f12d00c0ac0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 shutdown_connections 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a264340 0x55683a266760 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a254a30 0x55683a252350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a251e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 --2- 172.21.15.46:0/415340665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2518d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12bf7fe640 0 client.15963 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 >> 172.21.15.46:0/415340665 conn(0x55683a245de0 msgr2=0x55683a24bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 shutdown_connections 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.161+0000 7f12e874c740 1 -- 172.21.15.46:0/415340665 wait complete. 2024-09-19T09:20:06.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.162+0000 7f12e874c740 20 client.15963 trim_cache size 0 max 16384 2024-09-19T09:20:06.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.178+0000 7f12e874c740 1 Processor -- start 2024-09-19T09:20:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.178+0000 7f12e874c740 1 -- start start 2024-09-19T09:20:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e874c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a249850 0x55683a2537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e874c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a2521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e874c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 0x55683a26c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e874c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01af750 con 0x55683a254a30 2024-09-19T09:20:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e874c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01b12c0 con 0x55683a24a170 2024-09-19T09:20:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e874c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01afe20 con 0x55683a249850 2024-09-19T09:20:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 0x55683a26c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 0x55683a26c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40310/0 (socket says 172.21.15.46:40310) 2024-09-19T09:20:06.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 -- 172.21.15.46:0/376142869 learned_addr learned my addr 172.21.15.46:0/376142869 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12dffff640 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a249850 0x55683a2537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12df7fe640 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a2521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 -- 172.21.15.46:0/376142869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a249850 msgr2=0x55683a2537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a249850 0x55683a2537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 -- 172.21.15.46:0/376142869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 msgr2=0x55683a2521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a2521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 -- 172.21.15.46:0/376142869 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55683a245c10 con 0x55683a254a30 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12dffff640 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a249850 0x55683a2537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.179+0000 7f12e4910640 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 0x55683a26c070 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009270 tx=0x7f12d8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfea8b1dbf33d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12c5ffb640 1 -- 172.21.15.46:0/376142869 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8029070 con 0x55683a254a30 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12c5ffb640 1 -- 172.21.15.46:0/376142869 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d801bb60 con 0x55683a254a30 2024-09-19T09:20:06.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12c5ffb640 1 -- 172.21.15.46:0/376142869 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8024ce0 con 0x55683a254a30 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 -- 172.21.15.46:0/376142869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 msgr2=0x55683a26c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 0x55683a26c070 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009270 tx=0x7f12d8005bd0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 -- 172.21.15.46:0/376142869 shutdown_connections 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a254a30 0x55683a26c070 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a24a170 0x55683a2521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 --2- 172.21.15.46:0/376142869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a249850 0x55683a2537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 -- 172.21.15.46:0/376142869 >> 172.21.15.46:0/376142869 conn(0x55683a245de0 msgr2=0x55683a244ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:06.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 -- 172.21.15.46:0/376142869 shutdown_connections 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.180+0000 7f12e874c740 1 -- 172.21.15.46:0/376142869 wait complete. 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 -- start start 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 Processor -- start 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a24a170 0x55683a2c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a254a30 0x55683a258d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01b0bc0 con 0x55683a249850 2024-09-19T09:20:06.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01b04f0 con 0x55683a254a30 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f12e01ad730 con 0x55683a24a170 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12e874c740 10 client.0 _ll_register_callbacks cb 0x7f12d00b82f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40322/0 (socket says 172.21.15.46:40322) 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.181+0000 7f12dffff640 1 -- 172.21.15.46:0/452901153 learned_addr learned my addr 172.21.15.46:0/452901153 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12e4910640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a254a30 0x55683a258d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12df7fe640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a24a170 0x55683a2c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12dffff640 1 -- 172.21.15.46:0/452901153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a24a170 msgr2=0x55683a2c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12dffff640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a24a170 0x55683a2c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12dffff640 1 -- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a254a30 msgr2=0x55683a258d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:06.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12dffff640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a254a30 0x55683a258d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:06.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12dffff640 1 -- 172.21.15.46:0/452901153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55683a260620 con 0x55683a249850 2024-09-19T09:20:06.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12e4910640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a254a30 0x55683a258d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:06.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12df7fe640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a24a170 0x55683a2c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:06.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12dffff640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2c83d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f12d00bbf30 tx=0x7f12d00f03c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c23b32e4708cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:06.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:06.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12bf7fe640 1 -- 172.21.15.46:0/452901153 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0049040 con 0x55683a249850 2024-09-19T09:20:06.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12bf7fe640 1 -- 172.21.15.46:0/452901153 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f12d003b4f0 con 0x55683a249850 2024-09-19T09:20:06.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12d801bb60 con 0x55683a249850 2024-09-19T09:20:06.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12bf7fe640 1 -- 172.21.15.46:0/452901153 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12d00c4ef0 con 0x55683a249850 2024-09-19T09:20:06.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12e874c740 10 client.15969 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:06.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.182+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55683a2413f0 con 0x55683a249850 2024-09-19T09:20:06.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12bf7fe640 1 -- 172.21.15.46:0/452901153 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d801bb60 con 0x55683a249850 2024-09-19T09:20:06.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12bf7fe640 1 -- 172.21.15.46:0/452901153 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f12d0081ae0 con 0x55683a249850 2024-09-19T09:20:06.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12e874c740 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:06.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12e874c740 10 client.15969 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:20:06.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12e874c740 20 client.15969 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:06.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12e874c740 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a2cfb70 0x55683a2d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:06.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12e874c740 4 client.15969 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:20:06.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x55683a131f40 con 0x55683a2cfb70 2024-09-19T09:20:06.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.183+0000 7f12df7fe640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a2cfb70 0x55683a2d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:06.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.184+0000 7f12df7fe640 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a2cfb70 0x55683a2d1f60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20dc6a514a1ed36b server_cookie=95b90405f48ca0db in_seq=0 out_seq=0 2024-09-19T09:20:06.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:06.184+0000 7f12bf7fe640 10 client.15969 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:07.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:06 smithi115 ceph-mon[35055]: pgmap v392: 97 pgs: 97 active+clean; 13 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 19 op/s 2024-09-19T09:20:07.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:06 smithi046 ceph-mon[31203]: pgmap v392: 97 pgs: 97 active+clean; 13 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 19 op/s 2024-09-19T09:20:07.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:06 smithi099 ceph-mon[35256]: pgmap v392: 97 pgs: 97 active+clean; 13 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 19 op/s 2024-09-19T09:20:07.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 -- 172.21.15.46:0/1934713166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c102d30 msgr2=0x7fc23c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 --2- 172.21.15.46:0/1934713166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c102d30 0x7fc23c1031b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009900 tx=0x7fc22c02a410 comp rx=0 tx=0).stop 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 -- 172.21.15.46:0/1934713166 shutdown_connections 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 --2- 172.21.15.46:0/1934713166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c102d30 0x7fc23c1031b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 --2- 172.21.15.46:0/1934713166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc23c1036f0 0x7fc23c109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 --2- 172.21.15.46:0/1934713166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23c101b40 0x7fc23c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 -- 172.21.15.46:0/1934713166 >> 172.21.15.46:0/1934713166 conn(0x7fc23c0fd2e0 msgr2=0x7fc23c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 -- 172.21.15.46:0/1934713166 shutdown_connections 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 -- 172.21.15.46:0/1934713166 wait complete. 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.572+0000 7fc2436d7640 1 Processor -- start 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 -- start start 2024-09-19T09:20:07.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 0x7fc23c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc23c102d30 0x7fc23c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23c1036f0 0x7fc23c19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10d7c0 con 0x7fc23c101b40 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10d640 con 0x7fc23c1036f0 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc2436d7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c10d940 con 0x7fc23c102d30 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 0x7fc23c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 0x7fc23c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40340/0 (socket says 172.21.15.46:40340) 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 -- 172.21.15.46:0/3900523891 learned_addr learned my addr 172.21.15.46:0/3900523891 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241c74640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23c1036f0 0x7fc23c19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc240c72640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc23c102d30 0x7fc23c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 -- 172.21.15.46:0/3900523891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc23c102d30 msgr2=0x7fc23c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc23c102d30 0x7fc23c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 -- 172.21.15.46:0/3900523891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23c1036f0 msgr2=0x7fc23c19f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23c1036f0 0x7fc23c19f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 -- 172.21.15.46:0/3900523891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c19f9c0 con 0x7fc23c101b40 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.573+0000 7fc241473640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 0x7fc23c197db0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc23800d950 tx=0x7fc23800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.574+0000 7fc2327fc640 1 -- 172.21.15.46:0/3900523891 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc238017020 con 0x7fc23c101b40 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.574+0000 7fc2327fc640 1 -- 172.21.15.46:0/3900523891 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc238009c30 con 0x7fc23c101b40 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.574+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c19fcb0 con 0x7fc23c101b40 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.574+0000 7fc2327fc640 1 -- 172.21.15.46:0/3900523891 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23800f740 con 0x7fc23c101b40 2024-09-19T09:20:07.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.574+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c1a01b0 con 0x7fc23c101b40 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.576+0000 7fc2327fc640 1 -- 172.21.15.46:0/3900523891 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc23801a020 con 0x7fc23c101b40 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 Processor -- start 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 -- start start 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c397510da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c397515da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397518830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c3974742f0 con 0x55c3975109a0 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c39741c270 con 0x55c3975112e0 2024-09-19T09:20:07.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc246470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c3974702b0 con 0x55c397516370 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc241c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c397510da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc241c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c397510da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40354/0 (socket says 172.21.15.46:40354) 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc241c74640 1 -- 172.21.15.46:0/4137839615 learned_addr learned my addr 172.21.15.46:0/4137839615 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc240c72640 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397518830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc241473640 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c397515da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc2327fc640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2280a32f0 0x7fc2280a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.577+0000 7fc241c74640 1 -- 172.21.15.46:0/4137839615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 msgr2=0x55c397518830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241c74640 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397518830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241c74640 1 -- 172.21.15.46:0/4137839615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 msgr2=0x55c397515da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241c74640 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c397515da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241c74640 1 -- 172.21.15.46:0/4137839615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39741b340 con 0x55c3975109a0 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241473640 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c397515da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241c74640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2280a32f0 0x7fc2280a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc2327fc640 1 -- 172.21.15.46:0/3900523891 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc2380cf350 con 0x7fc23c101b40 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc241c74640 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c397510da0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc234011590 tx=0x7fc234011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b359f02ee03165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc2277fe640 1 -- 172.21.15.46:0/4137839615 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234017050 con 0x55c3975109a0 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc2277fe640 1 -- 172.21.15.46:0/4137839615 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc23401bb90 con 0x55c3975109a0 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.578+0000 7fc2277fe640 1 -- 172.21.15.46:0/4137839615 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23400e3b0 con 0x55c3975109a0 2024-09-19T09:20:07.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 -- 172.21.15.46:0/4137839615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 msgr2=0x55c397510da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc241c74640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2280a32f0 0x7fc2280a57b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc234022000 tx=0x7fc234023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c397510da0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc234011590 tx=0x7fc234011a50 comp rx=0 tx=0).stop 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 -- 172.21.15.46:0/4137839615 shutdown_connections 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397518830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c397515da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 --2- 172.21.15.46:0/4137839615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c397510da0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 -- 172.21.15.46:0/4137839615 >> 172.21.15.46:0/4137839615 conn(0x55c39750c010 msgr2=0x55c39750c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 -- 172.21.15.46:0/4137839615 shutdown_connections 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 -- 172.21.15.46:0/4137839615 wait complete. 2024-09-19T09:20:07.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 -- start start 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.579+0000 7fc246470740 1 Processor -- start 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c39751ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975112e0 0x55c39751b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c397516370 0x55c3975220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c397519340 con 0x55c3975109a0 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c3973fd290 con 0x55c397516370 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c3975194c0 con 0x55c3975112e0 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc246470740 10 client.0 _ll_register_callbacks cb 0x55c39742e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c39751ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c39751ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40364/0 (socket says 172.21.15.46:40364) 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 -- 172.21.15.46:0/2018381596 learned_addr learned my addr 172.21.15.46:0/2018381596 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:07.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241c74640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c397516370 0x55c3975220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc240c72640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975112e0 0x55c39751b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 -- 172.21.15.46:0/2018381596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975112e0 msgr2=0x55c39751b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975112e0 0x55c39751b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 -- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c397516370 msgr2=0x55c3975220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c397516370 0x55c3975220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 -- 172.21.15.46:0/2018381596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c397187210 con 0x55c3975109a0 2024-09-19T09:20:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc241473640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c39751ab70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc238098280 tx=0x7fc238099b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef73077d94192a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.580+0000 7fc224ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc224ff9640 1 -- 172.21.15.46:0/2018381596 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23809c040 con 0x55c3975109a0 2024-09-19T09:20:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc224ff9640 1 -- 172.21.15.46:0/2018381596 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc2380a4120 con 0x55c3975109a0 2024-09-19T09:20:07.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc23401bb90 con 0x55c3975109a0 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc224ff9640 1 -- 172.21.15.46:0/2018381596 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2380afe60 con 0x55c3975109a0 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 10 client.15981 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c397253620 con 0x55c3975109a0 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc224ff9640 1 -- 172.21.15.46:0/2018381596 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc23401bb90 con 0x55c3975109a0 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc224ff9640 1 -- 172.21.15.46:0/2018381596 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc23809ad90 con 0x55c3975109a0 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 10 client.15981 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 20 client.15981 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c3975267e0 0x55c397528c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 4 client.15981 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.581+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c397481a20 con 0x55c3975267e0 2024-09-19T09:20:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.582+0000 7fc240c72640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c3975267e0 0x55c397528c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.582+0000 7fc224ff9640 10 client.15981 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:07.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.582+0000 7fc240c72640 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c3975267e0 0x55c397528c10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a2a9f6e9fe9a8a5 server_cookie=d3129ce209ac6853 in_seq=0 out_seq=0 2024-09-19T09:20:07.592 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc224ff9640 1 -- 172.21.15.46:0/2018381596 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c397481a20 con 0x55c3975267e0 2024-09-19T09:20:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc224ff9640 10 client.15981 handle_command_reply: tid=0 2024-09-19T09:20:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 client.15981 shutdown 2024-09-19T09:20:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 msgr2=0x55c39751ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c39751ab70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc238098280 tx=0x7fc238099b40 comp rx=0 tx=0).stop 2024-09-19T09:20:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 shutdown_connections 2024-09-19T09:20:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c3975267e0 0x55c397528c10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c397516370 0x55c3975220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975112e0 0x55c39751b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc224ff9640 0 client.15981 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 --2- 172.21.15.46:0/2018381596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975109a0 0x55c39751ab70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 >> 172.21.15.46:0/2018381596 conn(0x55c39750c010 msgr2=0x55c39750d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 shutdown_connections 2024-09-19T09:20:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 1 -- 172.21.15.46:0/2018381596 wait complete. 2024-09-19T09:20:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.583+0000 7fc246470740 20 client.15981 trim_cache size 0 max 16384 2024-09-19T09:20:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 Processor -- start 2024-09-19T09:20:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 -- start start 2024-09-19T09:20:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975109a0 0x55c39751b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c3975220b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 0x55c39750b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1a8ee0 con 0x55c397516370 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1aaa50 con 0x55c3975112e0 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc246470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1a95b0 con 0x55c3975109a0 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 0x55c39750b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 0x55c39750b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40374/0 (socket says 172.21.15.46:40374) 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 -- 172.21.15.46:0/1887531927 learned_addr learned my addr 172.21.15.46:0/1887531927 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:07.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc240c72640 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c3975220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 -- 172.21.15.46:0/1887531927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975109a0 msgr2=0x55c39751b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975109a0 0x55c39751b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 -- 172.21.15.46:0/1887531927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 msgr2=0x55c3975220b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c3975220b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc241c74640 1 -- 172.21.15.46:0/1887531927 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c397523240 con 0x55c397516370 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.598+0000 7fc240c72640 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c3975220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc241c74640 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 0x55c39750b0b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc234011590 tx=0x7fc234014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3854fdbbc66ad36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc226ffd640 1 -- 172.21.15.46:0/1887531927 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23402a040 con 0x55c397516370 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc226ffd640 1 -- 172.21.15.46:0/1887531927 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc234034070 con 0x55c397516370 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc226ffd640 1 -- 172.21.15.46:0/1887531927 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234025430 con 0x55c397516370 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc246470740 1 -- 172.21.15.46:0/1887531927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 msgr2=0x55c39750b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc246470740 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 0x55c39750b0b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc234011590 tx=0x7fc234014000 comp rx=0 tx=0).stop 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc246470740 1 -- 172.21.15.46:0/1887531927 shutdown_connections 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc246470740 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c397516370 0x55c39750b0b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.599+0000 7fc246470740 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975112e0 0x55c3975220b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 --2- 172.21.15.46:0/1887531927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c3975109a0 0x55c39751b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- 172.21.15.46:0/1887531927 >> 172.21.15.46:0/1887531927 conn(0x55c39750c010 msgr2=0x55c39750a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- 172.21.15.46:0/1887531927 shutdown_connections 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- 172.21.15.46:0/1887531927 wait complete. 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- start start 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 Processor -- start 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975109a0 0x55c39751f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 0x55c39751fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397520bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1aa350 con 0x55c3975112e0 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1a9c80 con 0x55c3975109a0 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1a6ec0 con 0x55c397516370 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.600+0000 7fc246470740 10 client.0 _ll_register_callbacks cb 0x7fc238010d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 0x55c39751fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 0x55c39751fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40390/0 (socket says 172.21.15.46:40390) 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 -- 172.21.15.46:0/2884148482 learned_addr learned my addr 172.21.15.46:0/2884148482 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc241473640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975109a0 0x55c39751f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc241c74640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397520bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 -- 172.21.15.46:0/2884148482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 msgr2=0x55c397520bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397520bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 -- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975109a0 msgr2=0x55c39751f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975109a0 0x55c39751f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 -- 172.21.15.46:0/2884148482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3975211e0 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc240c72640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 0x55c39751fbc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02a450 tx=0x7fc22c0040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7c15540ecc3f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc224ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc224ff9640 1 -- 172.21.15.46:0/2884148482 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c035040 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc224ff9640 1 -- 172.21.15.46:0/2884148482 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fc22c005240 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc234034070 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc224ff9640 1 -- 172.21.15.46:0/2884148482 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc22c005440 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc246470740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.601+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3975914f0 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc224ff9640 1 -- 172.21.15.46:0/2884148482 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc234034070 con 0x55c3975112e0 2024-09-19T09:20:07.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc224ff9640 1 -- 172.21.15.46:0/2884148482 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc22c04d030 con 0x55c3975112e0 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc246470740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc246470740 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc246470740 20 client.15987 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc246470740 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c397591e30 0x55c397594250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc246470740 4 client.15987 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c39747bd70 con 0x55c397591e30 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc241473640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c397591e30 0x55c397594250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc241473640 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c397591e30 0x55c397594250 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bc368a3c509f29a server_cookie=94d00b1bf9d4ee48 in_seq=0 out_seq=0 2024-09-19T09:20:07.610 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:07.602+0000 7fc224ff9640 10 client.15987 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.681+0000 7fc224ff9640 1 -- 172.21.15.46:0/2884148482 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c39747bd70 con 0x55c397591e30 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.681+0000 7fc224ff9640 10 client.15987 handle_command_reply: tid=0 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.681+0000 7fc246470740 1 client.15987 shutdown 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.681+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 msgr2=0x55c39751fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 0x55c39751fbc0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02a450 tx=0x7fc22c0040d0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 shutdown_connections 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c397591e30 0x55c397594250 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c3975112e0 0x55c39751fbc0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c397516370 0x55c397520bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 --2- 172.21.15.46:0/2884148482 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c3975109a0 0x55c39751f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc224ff9640 0 client.15987 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 >> 172.21.15.46:0/2884148482 conn(0x55c39750c010 msgr2=0x55c39750b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 shutdown_connections 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 1 -- 172.21.15.46:0/2884148482 wait complete. 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc246470740 20 client.15987 trim_cache size 0 max 16384 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:20:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:20:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:20:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2280a32f0 msgr2=0x7fc2280a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc2436d7640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2280a32f0 0x7fc2280a57b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc234022000 tx=0x7fc234023000 comp rx=0 tx=0).stop 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 msgr2=0x7fc23c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.682+0000 7fc2436d7640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 0x7fc23c197db0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc23800d950 tx=0x7fc23800de10 comp rx=0 tx=0).stop 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 shutdown_connections 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc2280a32f0 0x7fc2280a57b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc23c1036f0 0x7fc23c19f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc23c102d30 0x7fc23c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 --2- 172.21.15.46:0/3900523891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc23c101b40 0x7fc23c197db0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 >> 172.21.15.46:0/3900523891 conn(0x7fc23c0fd2e0 msgr2=0x7fc23c106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 shutdown_connections 2024-09-19T09:20:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:08.683+0000 7fc2436d7640 1 -- 172.21.15.46:0/3900523891 wait complete. 2024-09-19T09:20:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.692+0000 7f12bf7fe640 1 -- 172.21.15.46:0/452901153 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55683a131f40 con 0x55683a2cfb70 2024-09-19T09:20:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.692+0000 7f12bf7fe640 10 client.15969 handle_command_reply: tid=0 2024-09-19T09:20:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.692+0000 7f12e874c740 1 client.15969 shutdown 2024-09-19T09:20:08.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.692+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 msgr2=0x55683a2c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.692+0000 7f12e874c740 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2c83d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f12d00bbf30 tx=0x7f12d00f03c0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 shutdown_connections 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55683a2cfb70 0x55683a2d1f60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55683a254a30 0x55683a258d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55683a24a170 0x55683a2c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 --2- 172.21.15.46:0/452901153 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55683a249850 0x55683a2c83d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12bf7fe640 0 client.15969 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 >> 172.21.15.46:0/452901153 conn(0x55683a245de0 msgr2=0x55683a25fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 shutdown_connections 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 1 -- 172.21.15.46:0/452901153 wait complete. 2024-09-19T09:20:08.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e874c740 20 client.15969 trim_cache size 0 max 16384 2024-09-19T09:20:08.695 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:08.695 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 29, 2024-09-19T09:20:08.695 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:20:08.695 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 10, 2024-09-19T09:20:08.695 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:20:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: "3294eb0f": { 2024-09-19T09:20:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 10, 2024-09-19T09:20:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:20:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:20:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:20:08.696 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 140.3, 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:08.697 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:08.698 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:08.698 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:08.698 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f12c80a3240 msgr2=0x7f12c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e6373640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f12c80a3240 0x7f12c80a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f12d8005c40 tx=0x7f12d8009500 comp rx=0 tx=0).stop 2024-09-19T09:20:08.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 msgr2=0x7f12e01009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.693+0000 7f12e6373640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e01009a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f12d0004770 tx=0x7f12d0003c10 comp rx=0 tx=0).stop 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 shutdown_connections 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f12c80a3240 0x7f12c80a5700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12e010c170 0x7f12e0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12e0103660 0x7f12e0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 --2- 172.21.15.46:0/3816011152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f12e0102d40 0x7f12e01009a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 >> 172.21.15.46:0/3816011152 conn(0x7f12e00fc7a0 msgr2=0x7f12e00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 shutdown_connections 2024-09-19T09:20:08.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:08.694+0000 7f12e6373640 1 -- 172.21.15.46:0/3816011152 wait complete. 2024-09-19T09:20:08.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:08 smithi046 ceph-mon[31203]: pgmap v393: 97 pgs: 97 active+clean; 15 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 224 KiB/s wr, 23 op/s 2024-09-19T09:20:09.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:08 smithi115 ceph-mon[35055]: pgmap v393: 97 pgs: 97 active+clean; 15 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 224 KiB/s wr, 23 op/s 2024-09-19T09:20:09.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:08 smithi099 ceph-mon[35256]: pgmap v393: 97 pgs: 97 active+clean; 15 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 224 KiB/s wr, 23 op/s 2024-09-19T09:20:09.371 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3294eb0f', quiesce took 5.6 seconds. Will release after: 14.750000000000002 2024-09-19T09:20:11.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:10 smithi115 ceph-mon[35055]: pgmap v394: 97 pgs: 97 active+clean; 16 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 237 KiB/s wr, 29 op/s 2024-09-19T09:20:11.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:10 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:10 smithi046 ceph-mon[31203]: pgmap v394: 97 pgs: 97 active+clean; 16 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 237 KiB/s wr, 29 op/s 2024-09-19T09:20:11.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:10 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:11.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:10 smithi099 ceph-mon[35256]: pgmap v394: 97 pgs: 97 active+clean; 16 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 237 KiB/s wr, 29 op/s 2024-09-19T09:20:11.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:10 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:12.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:12 smithi046 ceph-mon[31203]: pgmap v395: 97 pgs: 97 active+clean; 17 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 360 KiB/s wr, 91 op/s 2024-09-19T09:20:13.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:12 smithi115 ceph-mon[35055]: pgmap v395: 97 pgs: 97 active+clean; 17 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 360 KiB/s wr, 91 op/s 2024-09-19T09:20:13.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:12 smithi099 ceph-mon[35256]: pgmap v395: 97 pgs: 97 active+clean; 17 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 360 KiB/s wr, 91 op/s 2024-09-19T09:20:15.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:14 smithi115 ceph-mon[35055]: pgmap v396: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 KiB/s wr, 184 op/s 2024-09-19T09:20:15.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:14 smithi046 ceph-mon[31203]: pgmap v396: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 KiB/s wr, 184 op/s 2024-09-19T09:20:15.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:14 smithi099 ceph-mon[35256]: pgmap v396: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 KiB/s wr, 184 op/s 2024-09-19T09:20:17.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:16 smithi115 ceph-mon[35055]: pgmap v397: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 KiB/s wr, 181 op/s 2024-09-19T09:20:17.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:16 smithi046 ceph-mon[31203]: pgmap v397: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 KiB/s wr, 181 op/s 2024-09-19T09:20:17.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:16 smithi099 ceph-mon[35256]: pgmap v397: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 678 KiB/s wr, 181 op/s 2024-09-19T09:20:19.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:18 smithi115 ceph-mon[35055]: pgmap v398: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 674 KiB/s wr, 181 op/s 2024-09-19T09:20:19.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:18 smithi046 ceph-mon[31203]: pgmap v398: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 674 KiB/s wr, 181 op/s 2024-09-19T09:20:19.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:18 smithi099 ceph-mon[35256]: pgmap v398: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 674 KiB/s wr, 181 op/s 2024-09-19T09:20:21.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:20 smithi115 ceph-mon[35055]: pgmap v399: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 459 KiB/s wr, 174 op/s 2024-09-19T09:20:21.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:20 smithi046 ceph-mon[31203]: pgmap v399: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 459 KiB/s wr, 174 op/s 2024-09-19T09:20:21.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:20 smithi099 ceph-mon[35256]: pgmap v399: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 459 KiB/s wr, 174 op/s 2024-09-19T09:20:21.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 -- 172.21.15.46:0/35813675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 msgr2=0x7f4a3c100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 --2- 172.21.15.46:0/35813675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c100e60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009900 tx=0x7f4a3802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 -- 172.21.15.46:0/35813675 shutdown_connections 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 --2- 172.21.15.46:0/35813675 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a3c102610 0x7f4a3c108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 --2- 172.21.15.46:0/35813675 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a3c101c50 0x7f4a3c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 --2- 172.21.15.46:0/35813675 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c100e60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 -- 172.21.15.46:0/35813675 >> 172.21.15.46:0/35813675 conn(0x7f4a3c0fc1e0 msgr2=0x7f4a3c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 -- 172.21.15.46:0/35813675 shutdown_connections 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 -- 172.21.15.46:0/35813675 wait complete. 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.784+0000 7f4a442f1640 1 Processor -- start 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 -- start start 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a3c101c50 0x7f4a3c197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a3c102610 0x7f4a3c19e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c10c6e0 con 0x7f4a3c100a60 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c10c560 con 0x7f4a3c101c50 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a442f1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c10c860 con 0x7f4a3c102610 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32964/0 (socket says 172.21.15.46:32964) 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 -- 172.21.15.46:0/1940748137 learned_addr learned my addr 172.21.15.46:0/1940748137 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4288e640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a3c102610 0x7f4a3c19e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4188c640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a3c101c50 0x7f4a3c197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 -- 172.21.15.46:0/1940748137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a3c102610 msgr2=0x7f4a3c19e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a3c102610 0x7f4a3c19e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 -- 172.21.15.46:0/1940748137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a3c101c50 msgr2=0x7f4a3c197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a3c101c50 0x7f4a3c197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.785+0000 7f4a4208d640 1 -- 172.21.15.46:0/1940748137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c19e930 con 0x7f4a3c100a60 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.786+0000 7f4a4208d640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c196d20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4a38031610 tx=0x7f4a380043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.786+0000 7f4a337fe640 1 -- 172.21.15.46:0/1940748137 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3803f030 con 0x7f4a3c100a60 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.786+0000 7f4a337fe640 1 -- 172.21.15.46:0/1940748137 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a38003ce0 con 0x7f4a3c100a60 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.786+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c19ebc0 con 0x7f4a3c100a60 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.786+0000 7f4a337fe640 1 -- 172.21.15.46:0/1940748137 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38035070 con 0x7f4a3c100a60 2024-09-19T09:20:21.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.786+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c19f0b0 con 0x7f4a3c100a60 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.788+0000 7f4a337fe640 1 -- 172.21.15.46:0/1940748137 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4a38042030 con 0x7f4a3c100a60 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.788+0000 7f4a4708b740 1 Processor -- start 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 -- start start 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 0x555746b41fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b424f0 0x555746b46fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b49a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555746aa32f0 con 0x555746b424f0 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555746a4b270 con 0x555746b41bb0 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4708b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x555746a9f2b0 con 0x555746b47580 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4288e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 0x555746b41fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4208d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b424f0 0x555746b46fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4288e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 0x555746b41fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:57912/0 (socket says 172.21.15.46:57912) 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4288e640 1 -- 172.21.15.46:0/2132477770 learned_addr learned my addr 172.21.15.46:0/2132477770 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a4188c640 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b49a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.789+0000 7f4a337fe640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4a280a32f0 0x7f4a280a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 -- 172.21.15.46:0/2132477770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 msgr2=0x555746b49a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b49a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 -- 172.21.15.46:0/2132477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b424f0 msgr2=0x555746b46fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b424f0 0x555746b46fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 -- 172.21.15.46:0/2132477770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555746a4a340 con 0x555746b41bb0 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4188c640 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b49a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b424f0 0x555746b46fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a337fe640 1 -- 172.21.15.46:0/1940748137 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4a380efe60 con 0x7f4a3c100a60 2024-09-19T09:20:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4a280a32f0 0x7f4a280a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 0x555746b41fb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a34010440 tx=0x7f4a34010900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5707dfd22fd295d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a30bfe640 1 -- 172.21.15.46:0/2132477770 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34013520 con 0x555746b41bb0 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a4288e640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4a280a32f0 0x7f4a280a57b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a34021000 tx=0x7f4a3401e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a30bfe640 1 -- 172.21.15.46:0/2132477770 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3401d8e0 con 0x555746b41bb0 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.790+0000 7f4a30bfe640 1 -- 172.21.15.46:0/2132477770 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34011a40 con 0x555746b41bb0 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 -- 172.21.15.46:0/2132477770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 msgr2=0x555746b41fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 0x555746b41fb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a34010440 tx=0x7f4a34010900 comp rx=0 tx=0).stop 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 -- 172.21.15.46:0/2132477770 shutdown_connections 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b424f0 0x555746b46fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b49a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2132477770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b41bb0 0x555746b41fb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 -- 172.21.15.46:0/2132477770 >> 172.21.15.46:0/2132477770 conn(0x555746b3b010 msgr2=0x555746b3b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 -- 172.21.15.46:0/2132477770 shutdown_connections 2024-09-19T09:20:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 -- 172.21.15.46:0/2132477770 wait complete. 2024-09-19T09:20:21.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.791+0000 7f4a4708b740 1 -- start start 2024-09-19T09:20:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 Processor -- start 2024-09-19T09:20:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b50fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x555746b3f800 con 0x555746b47580 2024-09-19T09:20:21.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x555746a2c290 con 0x555746b424f0 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x555746b3f980 con 0x555746b41bb0 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4708b740 10 client.0 _ll_register_callbacks cb 0x555746a5d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b50fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b50fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32974/0 (socket says 172.21.15.46:32974) 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 -- 172.21.15.46:0/2792219920 learned_addr learned my addr 172.21.15.46:0/2792219920 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4188c640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 -- 172.21.15.46:0/2792219920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 msgr2=0x555746b4c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 -- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 msgr2=0x555746b4ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.792+0000 7f4a4288e640 1 -- 172.21.15.46:0/2792219920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557467b6210 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b50fd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009b30 tx=0x7f4a3401dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4e3327decb0ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2792219920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34034060 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2792219920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4a34013520 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a3401d8e0 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2792219920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a34003b80 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a4708b740 10 client.15999 fetch_fsmap learned FSMap version 30 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555746882620 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2792219920 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a3401d8e0 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.793+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2792219920 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4a3400f040 con 0x555746b47580 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4708b740 10 client.15999 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:20:21.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4708b740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4708b740 20 client.15999 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746b55790 0x555746b57b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4708b740 4 client.15999 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555746ab0a20 con 0x555746b55790 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746b55790 0x555746b57b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a25ffb640 10 client.15999 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.794+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746b55790 0x555746b57b80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f637462474e2c2be server_cookie=dc76e9c09400c76c in_seq=0 out_seq=0 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2792219920 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555746ab0a20 con 0x555746b55790 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a25ffb640 10 client.15999 handle_command_reply: tid=0 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 client.15999 shutdown 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 msgr2=0x555746b50fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b50fd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009b30 tx=0x7f4a3401dca0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 shutdown_connections 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746b55790 0x555746b57b80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b50fd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2792219920 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a25ffb640 0 client.15999 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.795+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 >> 172.21.15.46:0/2792219920 conn(0x555746b3b010 msgr2=0x555746b3c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.796+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 shutdown_connections 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.796+0000 7f4a4708b740 1 -- 172.21.15.46:0/2792219920 wait complete. 2024-09-19T09:20:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.796+0000 7f4a4708b740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T09:20:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 Processor -- start 2024-09-19T09:20:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 -- start start 2024-09-19T09:20:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 0x555746b45d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b50340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b50880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a6d60 con 0x555746b41bb0 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a8900 con 0x555746b424f0 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4708b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a7430 con 0x555746b47580 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.810+0000 7f4a4208d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 0x555746b45d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 0x555746b45d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32982/0 (socket says 172.21.15.46:32982) 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 -- 172.21.15.46:0/432298654 learned_addr learned my addr 172.21.15.46:0/432298654 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4288e640 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b50880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4188c640 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b50340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 -- 172.21.15.46:0/432298654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 msgr2=0x555746b50880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b50880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 -- 172.21.15.46:0/432298654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 msgr2=0x555746b50340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b50340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 -- 172.21.15.46:0/432298654 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555746b57ef0 con 0x555746b41bb0 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4188c640 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b50340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a4208d640 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 0x555746b45d40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4a380314e0 tx=0x7f4a380fc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4306cceb5ad4c847 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a27fff640 1 -- 172.21.15.46:0/432298654 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38049040 con 0x555746b41bb0 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a27fff640 1 -- 172.21.15.46:0/432298654 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a380ede50 con 0x555746b41bb0 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.811+0000 7f4a27fff640 1 -- 172.21.15.46:0/432298654 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380c0860 con 0x555746b41bb0 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 -- 172.21.15.46:0/432298654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 msgr2=0x555746b45d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 0x555746b45d40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4a380314e0 tx=0x7f4a380fc040 comp rx=0 tx=0).stop 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 -- 172.21.15.46:0/432298654 shutdown_connections 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b47580 0x555746b50880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b50340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 --2- 172.21.15.46:0/432298654 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b41bb0 0x555746b45d40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 -- 172.21.15.46:0/432298654 >> 172.21.15.46:0/432298654 conn(0x555746b3b010 msgr2=0x555746b3a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 -- 172.21.15.46:0/432298654 shutdown_connections 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 -- 172.21.15.46:0/432298654 wait complete. 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 -- start start 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 Processor -- start 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.812+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4708b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b4f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4708b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a81d0 con 0x555746b47580 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4708b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a7b00 con 0x555746b424f0 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4708b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c1a4d40 con 0x555746b41bb0 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4708b740 10 client.0 _ll_register_callbacks cb 0x7f4a34013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b4f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b4f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32988/0 (socket says 172.21.15.46:32988) 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 -- 172.21.15.46:0/2639125443 learned_addr learned my addr 172.21.15.46:0/2639125443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4188c640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 -- 172.21.15.46:0/2639125443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 msgr2=0x555746b4c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 -- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 msgr2=0x555746b4cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 -- 172.21.15.46:0/2639125443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555746b4fb50 con 0x555746b47580 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4188c640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4288e640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b4f510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4a34010940 tx=0x7f4a34010400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20a738bd028ce49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2639125443 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3403f070 con 0x555746b47580 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2639125443 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4a34023070 con 0x555746b47580 2024-09-19T09:20:21.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.813+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a380ede50 con 0x555746b47580 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2639125443 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4a34034040 con 0x555746b47580 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 10 client.16005 fetch_fsmap learned FSMap version 30 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555746b50dd0 con 0x555746b47580 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2639125443 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a380ede50 con 0x555746b47580 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2639125443 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4a34042020 con 0x555746b47580 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 10 client.16005 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 20 client.16005 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746bc06c0 0x555746bc2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 4 client.16005 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555746aaad70 con 0x555746bc06c0 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.814+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746bc06c0 0x555746bc2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.821 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.815+0000 7f4a4208d640 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746bc06c0 0x555746bc2ab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=328338d14002582c server_cookie=88fcbbdeed33c385 in_seq=0 out_seq=0 2024-09-19T09:20:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.815+0000 7f4a25ffb640 10 client.16005 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a25ffb640 1 -- 172.21.15.46:0/2639125443 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555746aaad70 con 0x555746bc06c0 2024-09-19T09:20:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a25ffb640 10 client.16005 handle_command_reply: tid=0 2024-09-19T09:20:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 client.16005 shutdown 2024-09-19T09:20:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 msgr2=0x555746b4f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b4f510 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4a34010940 tx=0x7f4a34010400 comp rx=0 tx=0).stop 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 shutdown_connections 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x555746bc06c0 0x555746bc2ab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x555746b47580 0x555746b4f510 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555746b424f0 0x555746b4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a25ffb640 0 client.16005 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 --2- 172.21.15.46:0/2639125443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x555746b41bb0 0x555746b4c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 >> 172.21.15.46:0/2639125443 conn(0x555746b3b010 msgr2=0x555746b3bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 shutdown_connections 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 1 -- 172.21.15.46:0/2639125443 wait complete. 2024-09-19T09:20:21.852 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.850+0000 7f4a4708b740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T09:20:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:20:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:20:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:20:21.853 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4a280a32f0 msgr2=0x7f4a280a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4a280a32f0 0x7f4a280a57b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4a34021000 tx=0x7f4a3401e000 comp rx=0 tx=0).stop 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 msgr2=0x7f4a3c196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c196d20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4a38031610 tx=0x7f4a380043b0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 shutdown_connections 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4a280a32f0 0x7f4a280a57b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4a3c102610 0x7f4a3c19e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a3c101c50 0x7f4a3c197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 --2- 172.21.15.46:0/1940748137 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4a3c100a60 0x7f4a3c196d20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 >> 172.21.15.46:0/1940748137 conn(0x7f4a3c0fc1e0 msgr2=0x7f4a3c105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 shutdown_connections 2024-09-19T09:20:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:21.851+0000 7f4a442f1640 1 -- 172.21.15.46:0/1940748137 wait complete. 2024-09-19T09:20:23.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:22 smithi115 ceph-mon[35055]: pgmap v400: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 443 KiB/s wr, 164 op/s 2024-09-19T09:20:23.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:22 smithi046 ceph-mon[31203]: pgmap v400: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 443 KiB/s wr, 164 op/s 2024-09-19T09:20:23.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:22 smithi099 ceph-mon[35256]: pgmap v400: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 443 KiB/s wr, 164 op/s 2024-09-19T09:20:24.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.845+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1799915610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0102da0 msgr2=0x7f6ea0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.845+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1799915610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0102da0 0x7f6ea0103180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009900 tx=0x7f6e9002a480 comp rx=0 tx=0).stop 2024-09-19T09:20:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1799915610 shutdown_connections 2024-09-19T09:20:24.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1799915610 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea010c180 0x7f6ea010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1799915610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ea01036c0 0x7f6ea010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1799915610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea0102da0 0x7f6ea0103180 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1799915610 >> 172.21.15.46:0/1799915610 conn(0x7f6ea00fc7a0 msgr2=0x7f6ea00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1799915610 shutdown_connections 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1799915610 wait complete. 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 Processor -- start 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- start start 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ea0102da0 0x7f6ea01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea01036c0 0x7f6ea0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 0x7f6ea019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea0111f60 con 0x7f6ea010c180 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea0111de0 con 0x7f6ea0102da0 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.846+0000 7f6ea57ea640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea01120e0 con 0x7f6ea01036c0 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 0x7f6ea019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 0x7f6ea019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33000/0 (socket says 172.21.15.46:33000) 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 -- 172.21.15.46:0/1850844329 learned_addr learned my addr 172.21.15.46:0/1850844329 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e97fff640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea01036c0 0x7f6ea0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9effd640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ea0102da0 0x7f6ea01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 -- 172.21.15.46:0/1850844329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea01036c0 msgr2=0x7f6ea0198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea01036c0 0x7f6ea0198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 -- 172.21.15.46:0/1850844329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ea0102da0 msgr2=0x7f6ea01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ea0102da0 0x7f6ea01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 -- 172.21.15.46:0/1850844329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea019d490 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9f7fe640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 0x7f6ea019cdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800cad0 tx=0x7f6e9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800ae20 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e98005020 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea019d780 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800f6f0 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.847+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea01a5060 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.848+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea0103180 con 0x7f6ea010c180 2024-09-19T09:20:24.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.850+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6e980051d0 con 0x7f6ea010c180 2024-09-19T09:20:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.850+0000 7f6e9cff9640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6e8c0a32c0 0x7f6e8c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.850+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f6e980cfd00 con 0x7f6ea010c180 2024-09-19T09:20:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.850+0000 7f6e9effd640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6e8c0a32c0 0x7f6e8c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.851+0000 7f6e9effd640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6e8c0a32c0 0x7f6e8c0a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005ab0 tx=0x7f6e90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:24.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:24.854+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e98014030 con 0x7f6ea010c180 2024-09-19T09:20:25.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.067+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ea0199840 con 0x7f6ea010c180 2024-09-19T09:20:25.252 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:24 smithi046 ceph-mon[31203]: pgmap v401: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 321 KiB/s wr, 105 op/s 2024-09-19T09:20:25.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.068+0000 7f6e9cff9640 1 -- 172.21.15.46:0/1850844329 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11962 (secure 0 0 0) 0x7f6ea0199840 con 0x7f6ea010c180 2024-09-19T09:20:25.253 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:20:25.253 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"btime":"2024-09-19T09:20:09:851331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:20:09.199142+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6e8c0a32c0 msgr2=0x7f6e8c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6e8c0a32c0 0x7f6e8c0a5780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005ab0 tx=0x7f6e90005a20 comp rx=0 tx=0).stop 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 msgr2=0x7f6ea019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 0x7f6ea019cdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800cad0 tx=0x7f6e9800cf90 comp rx=0 tx=0).stop 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 shutdown_connections 2024-09-19T09:20:25.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6e8c0a32c0 0x7f6e8c0a5780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ea010c180 0x7f6ea019cdb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea01036c0 0x7f6ea0198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 --2- 172.21.15.46:0/1850844329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ea0102da0 0x7f6ea01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.070+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 >> 172.21.15.46:0/1850844329 conn(0x7f6ea00fc7a0 msgr2=0x7f6ea00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.071+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 shutdown_connections 2024-09-19T09:20:25.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:25.071+0000 7f6ea57ea640 1 -- 172.21.15.46:0/1850844329 wait complete. 2024-09-19T09:20:25.255 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:24 smithi115 ceph-mon[35055]: pgmap v401: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 321 KiB/s wr, 105 op/s 2024-09-19T09:20:25.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:24 smithi099 ceph-mon[35256]: pgmap v401: 97 pgs: 97 active+clean; 20 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 321 KiB/s wr, 105 op/s 2024-09-19T09:20:25.796 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 3294eb0f --release --await' 2024-09-19T09:20:25.796 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 3294eb0f --release --await 2024-09-19T09:20:26.057 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:26.178 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:25 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1850844329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:26.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:25 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1850844329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:26.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:25 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1850844329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.519+0000 7fbce226b640 1 -- 172.21.15.46:0/2534582007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 msgr2=0x7fbcdc1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.519+0000 7fbce226b640 1 --2- 172.21.15.46:0/2534582007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc1067f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009900 tx=0x7fbcd002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 -- 172.21.15.46:0/2534582007 shutdown_connections 2024-09-19T09:20:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 --2- 172.21.15.46:0/2534582007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc1067f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 --2- 172.21.15.46:0/2534582007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc106f20 0x7fbcdc10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 --2- 172.21.15.46:0/2534582007 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcdc101df0 0x7fbcdc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 -- 172.21.15.46:0/2534582007 >> 172.21.15.46:0/2534582007 conn(0x7fbcdc0fd8b0 msgr2=0x7fbcdc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 -- 172.21.15.46:0/2534582007 shutdown_connections 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 -- 172.21.15.46:0/2534582007 wait complete. 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 Processor -- start 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.520+0000 7fbce226b640 1 -- start start 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc101df0 0x7fbcdc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcdc106f20 0x7fbcdc19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc111f80 con 0x7fbcdc1027a0 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc111e00 con 0x7fbcdc101df0 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc112100 con 0x7fbcdc106f20 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33016/0 (socket says 172.21.15.46:33016) 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/3163062473 learned_addr learned my addr 172.21.15.46:0/3163062473 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc101df0 0x7fbcdc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce0808640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcdc106f20 0x7fbcdc19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/3163062473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcdc106f20 msgr2=0x7fbcdc19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcdc106f20 0x7fbcdc19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/3163062473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc101df0 msgr2=0x7fbcdc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc101df0 0x7fbcdc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/3163062473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc19d3d0 con 0x7fbcdc1027a0 2024-09-19T09:20:26.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc101df0 0x7fbcdc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc198960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0006010 tx=0x7fbcd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcd97fa640 1 -- 172.21.15.46:0/3163062473 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd003f030 con 0x7fbcdc1027a0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcd97fa640 1 -- 172.21.15.46:0/3163062473 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd0003ce0 con 0x7fbcdc1027a0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc19d660 con 0x7fbcdc1027a0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.521+0000 7fbcd97fa640 1 -- 172.21.15.46:0/3163062473 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0035070 con 0x7fbcdc1027a0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.522+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc1a4fa0 con 0x7fbcdc1027a0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbcd97fa640 1 -- 172.21.15.46:0/3163062473 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbcd0042030 con 0x7fbcdc1027a0 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 Processor -- start 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 -- start start 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04060 0x55b5cef04440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef11630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b5cee69620 con 0x55b5cef04980 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b5cee10e50 con 0x55b5cef0f240 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce4644740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b5cee655e0 con 0x55b5cef04060 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33018/0 (socket says 172.21.15.46:33018) 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbcdbfff640 1 -- 172.21.15.46:0/4100062005 learned_addr learned my addr 172.21.15.46:0/4100062005 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbce0808640 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04060 0x55b5cef04440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.524+0000 7fbcd97fa640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbcc40a3240 0x7fbcc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef11630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdbfff640 1 -- 172.21.15.46:0/4100062005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04060 msgr2=0x55b5cef04440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04060 0x55b5cef04440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdbfff640 1 -- 172.21.15.46:0/4100062005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 msgr2=0x55b5cef11630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef11630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbce0808640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbcc40a3240 0x7fbcc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdbfff640 1 -- 172.21.15.46:0/4100062005 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5cee01d40 con 0x55b5cef04980 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef11630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:26.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcd97fa640 1 -- 172.21.15.46:0/3163062473 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbcd00effb0 con 0x7fbcdc1027a0 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0ed00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bb70 tx=0x7fbccc00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb98e255f641fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcc27fc640 1 -- 172.21.15.46:0/4100062005 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc017620 con 0x55b5cef04980 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbce0808640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbcc40a3240 0x7fbcc40a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcc27fc640 1 -- 172.21.15.46:0/4100062005 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc017ca0 con 0x55b5cef04980 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.525+0000 7fbcc27fc640 1 -- 172.21.15.46:0/4100062005 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00fc90 con 0x55b5cef04980 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 -- 172.21.15.46:0/4100062005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 msgr2=0x55b5cef0ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0ed00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bb70 tx=0x7fbccc00d710 comp rx=0 tx=0).stop 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 -- 172.21.15.46:0/4100062005 shutdown_connections 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0ed00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef11630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 --2- 172.21.15.46:0/4100062005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04060 0x55b5cef04440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 -- 172.21.15.46:0/4100062005 >> 172.21.15.46:0/4100062005 conn(0x55b5cef005f0 msgr2=0x55b5cef009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 -- 172.21.15.46:0/4100062005 shutdown_connections 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 -- 172.21.15.46:0/4100062005 wait complete. 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.526+0000 7fbce4644740 1 -- start start 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 Processor -- start 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef0c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef0cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b5cef11e10 con 0x55b5cef04980 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b5cedf1f10 con 0x55b5cef04060 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b5cef11f90 con 0x55b5cef0f240 2024-09-19T09:20:26.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce4644740 10 client.0 _ll_register_callbacks cb 0x55b5cee15db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef0c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33020/0 (socket says 172.21.15.46:33020) 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/468052183 learned_addr learned my addr 172.21.15.46:0/468052183 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbce0808640 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef0cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/468052183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 msgr2=0x55b5cef0cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef0cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 msgr2=0x55b5cef0c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef0c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.527+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/468052183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ceb78580 con 0x55b5cef04980 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0c600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00c4ea0 tx=0x7fbcd008b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b461ab1b1ecd0d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:26.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/468052183 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0049070 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/468052183 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbcd00f20d0 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbccc017ca0 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/468052183 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbcd00bc2a0 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 10 client.16023 fetch_fsmap learned FSMap version 30 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5cec42960 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/468052183 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbccc017ca0 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/468052183 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fbcd00bc9c0 con 0x55b5cef04980 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 10 client.16023 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 10 client.16023 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 20 client.16023 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef21050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 4 client.16023 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:26.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.528+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5cee76b90 con 0x55b5cef1ebe0 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.529+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef21050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.529+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef21050 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd07f87558755544 server_cookie=12e3103926f03080 in_seq=0 out_seq=0 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.529+0000 7fbcbb7fe640 10 client.16023 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/468052183 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5cee76b90 con 0x55b5cef1ebe0 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbcbb7fe640 10 client.16023 handle_command_reply: tid=0 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 client.16023 shutdown 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 msgr2=0x55b5cef0c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0c600 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00c4ea0 tx=0x7fbcd008b560 comp rx=0 tx=0).stop 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 shutdown_connections 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef21050 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbcbb7fe640 0 client.16023 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0c600 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef0cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 --2- 172.21.15.46:0/468052183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef0c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 >> 172.21.15.46:0/468052183 conn(0x55b5cef005f0 msgr2=0x55b5cef062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 shutdown_connections 2024-09-19T09:20:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.530+0000 7fbce4644740 1 -- 172.21.15.46:0/468052183 wait complete. 2024-09-19T09:20:26.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.531+0000 7fbce4644740 20 client.16023 trim_cache size 0 max 16384 2024-09-19T09:20:26.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.547+0000 7fbce4644740 1 Processor -- start 2024-09-19T09:20:26.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.547+0000 7fbce4644740 1 -- start start 2024-09-19T09:20:26.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce4644740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce4644740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce4644740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef26960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce4644740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ad490 con 0x55b5cef04980 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce4644740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1af030 con 0x55b5cef04060 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce4644740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1adb60 con 0x55b5cef0f240 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33022/0 (socket says 172.21.15.46:33022) 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/13253670 learned_addr learned my addr 172.21.15.46:0/13253670 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbce0808640 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef26960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/13253670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 msgr2=0x55b5cef26960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef26960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/13253670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 msgr2=0x55b5cef073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 -- 172.21.15.46:0/13253670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ceeff610 con 0x55b5cef04980 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0e030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbcd008f670 tx=0x7fbcd002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263f1c8a59d9886b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.548+0000 7fbcc1ffb640 1 -- 172.21.15.46:0/13253670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0049070 con 0x55b5cef04980 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbcc1ffb640 1 -- 172.21.15.46:0/13253670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd00bce60 con 0x55b5cef04980 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbcc1ffb640 1 -- 172.21.15.46:0/13253670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00044e0 con 0x55b5cef04980 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 -- 172.21.15.46:0/13253670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 msgr2=0x55b5cef0e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0e030 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbcd008f670 tx=0x7fbcd002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 -- 172.21.15.46:0/13253670 shutdown_connections 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04980 0x55b5cef0e030 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef0f240 0x55b5cef26960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 --2- 172.21.15.46:0/13253670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef04060 0x55b5cef073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 -- 172.21.15.46:0/13253670 >> 172.21.15.46:0/13253670 conn(0x55b5cef005f0 msgr2=0x55b5cef0d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 -- 172.21.15.46:0/13253670 shutdown_connections 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.549+0000 7fbce4644740 1 -- 172.21.15.46:0/13253670 wait complete. 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 -- start start 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 Processor -- start 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 0x55b5cef17680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04980 0x55b5cef14180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef146c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ae900 con 0x55b5cef04060 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ae230 con 0x55b5cef0f240 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ab470 con 0x55b5cef04980 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce4644740 10 client.0 _ll_register_callbacks cb 0x7fbcd0003e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 0x55b5cef17680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 0x55b5cef17680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33024/0 (socket says 172.21.15.46:33024) 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbcdbfff640 1 -- 172.21.15.46:0/3940656816 learned_addr learned my addr 172.21.15.46:0/3940656816 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.550+0000 7fbce0808640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef146c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04980 0x55b5cef14180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdbfff640 1 -- 172.21.15.46:0/3940656816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04980 msgr2=0x55b5cef14180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04980 0x55b5cef14180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdbfff640 1 -- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 msgr2=0x55b5cef146c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef146c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdbfff640 1 -- 172.21.15.46:0/3940656816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5cef14c80 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04980 0x55b5cef14180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcdbfff640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 0x55b5cef17680 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bb70 tx=0x7fbccc00f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9629dde4d61ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/3940656816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00f8a0 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/3940656816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fbccc00fa40 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcd00bce60 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/3940656816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbccc039070 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbce4644740 10 client.16029 fetch_fsmap learned FSMap version 30 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b5cef8a7b0 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.551+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/3940656816 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd00bce60 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/3940656816 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fbccc031030 con 0x55b5cef04060 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbce4644740 10 client.16029 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:20:26.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbce4644740 10 client.16029 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbce4644740 20 client.16029 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbce4644740 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef8cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbce4644740 4 client.16029 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3294eb0f", "release": true, "await": true}] 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3294eb0f", "release": true, "await": true}) -- 0x55b5cee710a0 con 0x55b5cef1ebe0 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef8cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbcbb7fe640 10 client.16029 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:26.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.552+0000 7fbcdb7fe640 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef8cce0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6efcd16974694d7 server_cookie=88bf490669abc731 in_seq=0 out_seq=0 2024-09-19T09:20:26.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.580+0000 7fbcbb7fe640 1 -- 172.21.15.46:0/3940656816 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b5cee710a0 con 0x55b5cef1ebe0 2024-09-19T09:20:26.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.580+0000 7fbcbb7fe640 10 client.16029 handle_command_reply: tid=0 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.580+0000 7fbce4644740 1 client.16029 shutdown 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 msgr2=0x55b5cef17680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 0x55b5cef17680 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bb70 tx=0x7fbccc00f830 comp rx=0 tx=0).stop 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 shutdown_connections 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5cef1ebe0 0x55b5cef8cce0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5cef0f240 0x55b5cef146c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5cef04980 0x55b5cef14180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbcbb7fe640 0 client.16029 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 --2- 172.21.15.46:0/3940656816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5cef04060 0x55b5cef17680 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 >> 172.21.15.46:0/3940656816 conn(0x55b5cef005f0 msgr2=0x55b5cef0e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 shutdown_connections 2024-09-19T09:20:26.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 1 -- 172.21.15.46:0/3940656816 wait complete. 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce4644740 20 client.16029 trim_cache size 0 max 16384 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 30, 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 12, 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "3294eb0f": { 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 12, 2024-09-19T09:20:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 140.3, 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:20:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbcc40a3240 msgr2=0x7fbcc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce226b640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbcc40a3240 0x7fbcc40a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005fd0 tx=0x7fbcd4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 msgr2=0x7fbcdc198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.581+0000 7fbce226b640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc198960 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0006010 tx=0x7fbcd00042f0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 shutdown_connections 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fbcc40a3240 0x7fbcc40a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbcdc1027a0 0x7fbcdc198960 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbcdc106f20 0x7fbcdc19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 --2- 172.21.15.46:0/3163062473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc101df0 0x7fbcdc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 >> 172.21.15.46:0/3163062473 conn(0x7fbcdc0fd8b0 msgr2=0x7fbcdc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 shutdown_connections 2024-09-19T09:20:26.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:26.582+0000 7fbce226b640 1 -- 172.21.15.46:0/3163062473 wait complete. 2024-09-19T09:20:27.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:26 smithi115 ceph-mon[35055]: pgmap v402: 97 pgs: 97 active+clean; 20 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 36 KiB/s wr, 19 op/s 2024-09-19T09:20:27.212 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:26 smithi046 ceph-mon[31203]: pgmap v402: 97 pgs: 97 active+clean; 20 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 36 KiB/s wr, 19 op/s 2024-09-19T09:20:27.241 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3294eb0f', total seconds elapsed: 23.5 2024-09-19T09:20:27.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:26 smithi099 ceph-mon[35256]: pgmap v402: 97 pgs: 97 active+clean; 20 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 36 KiB/s wr, 19 op/s 2024-09-19T09:20:29.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:28 smithi115 ceph-mon[35055]: pgmap v403: 97 pgs: 97 active+clean; 21 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 145 KiB/s wr, 37 op/s 2024-09-19T09:20:29.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:28 smithi046 ceph-mon[31203]: pgmap v403: 97 pgs: 97 active+clean; 21 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 145 KiB/s wr, 37 op/s 2024-09-19T09:20:29.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:28 smithi099 ceph-mon[35256]: pgmap v403: 97 pgs: 97 active+clean; 21 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 145 KiB/s wr, 37 op/s 2024-09-19T09:20:31.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:30 smithi115 ceph-mon[35055]: pgmap v404: 97 pgs: 97 active+clean; 21 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 156 KiB/s wr, 36 op/s 2024-09-19T09:20:31.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:30 smithi046 ceph-mon[31203]: pgmap v404: 97 pgs: 97 active+clean; 21 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 156 KiB/s wr, 36 op/s 2024-09-19T09:20:31.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:30 smithi099 ceph-mon[35256]: pgmap v404: 97 pgs: 97 active+clean; 21 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 156 KiB/s wr, 36 op/s 2024-09-19T09:20:33.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:32 smithi115 ceph-mon[35055]: pgmap v405: 97 pgs: 97 active+clean; 24 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 358 KiB/s wr, 42 op/s 2024-09-19T09:20:33.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:32 smithi046 ceph-mon[31203]: pgmap v405: 97 pgs: 97 active+clean; 24 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 358 KiB/s wr, 42 op/s 2024-09-19T09:20:33.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:32 smithi099 ceph-mon[35256]: pgmap v405: 97 pgs: 97 active+clean; 24 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 358 KiB/s wr, 42 op/s 2024-09-19T09:20:33.652 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:20:33.911 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:20:33.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:33 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:20:34.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:33 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:20:34.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:33 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:20:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.413+0000 7f3008125640 1 -- 172.21.15.46:0/2228970259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000106f10 msgr2=0x7f300010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.413+0000 7f3008125640 1 --2- 172.21.15.46:0/2228970259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000106f10 0x7f300010ea90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8009ca0 tx=0x7f2ff802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- 172.21.15.46:0/2228970259 shutdown_connections 2024-09-19T09:20:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 --2- 172.21.15.46:0/2228970259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000106f10 0x7f300010ea90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 --2- 172.21.15.46:0/2228970259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3000102790 0x7f30001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 --2- 172.21.15.46:0/2228970259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3000101de0 0x7f30001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- 172.21.15.46:0/2228970259 >> 172.21.15.46:0/2228970259 conn(0x7f30000fd8c0 msgr2=0x7f30000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- 172.21.15.46:0/2228970259 shutdown_connections 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- 172.21.15.46:0/2228970259 wait complete. 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 Processor -- start 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- start start 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 0x7f300019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3000102790 0x7f300019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3000106f10 0x7f300019eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3000111f70 con 0x7f3000101de0 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3000111df0 con 0x7f3000102790 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.414+0000 7f3008125640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f30001120f0 con 0x7f3000106f10 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 0x7f300019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 0x7f300019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51112/0 (socket says 172.21.15.46:51112) 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 -- 172.21.15.46:0/2273855392 learned_addr learned my addr 172.21.15.46:0/2273855392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f30056c0640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3000102790 0x7f300019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f30066c2640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3000106f10 0x7f300019eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 -- 172.21.15.46:0/2273855392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3000106f10 msgr2=0x7f300019eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3000106f10 0x7f300019eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 -- 172.21.15.46:0/2273855392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3000102790 msgr2=0x7f300019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3000102790 0x7f300019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 -- 172.21.15.46:0/2273855392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300019f580 con 0x7f3000101de0 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3005ec1640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 0x7f300019a5d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00e9f0 tx=0x7f2ffc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f2ff6ffd640 1 -- 172.21.15.46:0/2273855392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00cd80 con 0x7f3000101de0 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f2ff6ffd640 1 -- 172.21.15.46:0/2273855392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ffc010910 con 0x7f3000101de0 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300019f870 con 0x7f3000101de0 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f2ff6ffd640 1 -- 172.21.15.46:0/2273855392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc018990 con 0x7f3000101de0 2024-09-19T09:20:34.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.415+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001a7150 con 0x7f3000101de0 2024-09-19T09:20:34.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.418+0000 7f2ff6ffd640 1 -- 172.21.15.46:0/2273855392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2ffc010ac0 con 0x7f3000101de0 2024-09-19T09:20:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.418+0000 7f300a4fe740 1 Processor -- start 2024-09-19T09:20:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.418+0000 7f300a4fe740 1 -- start start 2024-09-19T09:20:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.418+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a0292a4a0 0x557a0292a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.418+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a02935140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a02935680 0x557a02937a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f300a4fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557a028902e0 con 0x557a0292adc0 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f300a4fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557a02837ce0 con 0x557a02935680 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f300a4fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557a0288c2a0 con 0x557a0292a4a0 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a02935140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f2ff6ffd640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2fec0a32c0 0x7f2fec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a02935680 0x557a02937a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a02935140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51126/0 (socket says 172.21.15.46:51126) 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f3005ec1640 1 -- 172.21.15.46:0/1492318051 learned_addr learned my addr 172.21.15.46:0/1492318051 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30066c2640 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a0292a4a0 0x557a0292a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30066c2640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2fec0a32c0 0x7f2fec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 -- 172.21.15.46:0/1492318051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a0292a4a0 msgr2=0x557a0292a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a0292a4a0 0x557a0292a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 -- 172.21.15.46:0/1492318051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 msgr2=0x557a02935140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a02935140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 -- 172.21.15.46:0/1492318051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a0281c440 con 0x557a02935680 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f2ff6ffd640 1 -- 172.21.15.46:0/2273855392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2ffc0cfb50 con 0x7f3000101de0 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.419+0000 7f30056c0640 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a02935680 0x557a02937a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0005fd0 tx=0x7f2ff000ba60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d5a102d7287eac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f2febfff640 1 -- 172.21.15.46:0/1492318051 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0003a90 con 0x557a02935680 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f30066c2640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2fec0a32c0 0x7f2fec0a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8004af0 tx=0x7f2ff8004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f2febfff640 1 -- 172.21.15.46:0/1492318051 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff0015070 con 0x557a02935680 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f2febfff640 1 -- 172.21.15.46:0/1492318051 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0004d20 con 0x557a02935680 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 -- 172.21.15.46:0/1492318051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a02935680 msgr2=0x557a02937a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a02935680 0x557a02937a70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0005fd0 tx=0x7f2ff000ba60 comp rx=0 tx=0).stop 2024-09-19T09:20:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 -- 172.21.15.46:0/1492318051 shutdown_connections 2024-09-19T09:20:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a02935140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a02935680 0x557a02937a70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1492318051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a0292a4a0 0x557a0292a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.420+0000 7f300a4fe740 1 -- 172.21.15.46:0/1492318051 >> 172.21.15.46:0/1492318051 conn(0x557a02926a30 msgr2=0x557a02926e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.421+0000 7f300a4fe740 1 -- 172.21.15.46:0/1492318051 shutdown_connections 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.421+0000 7f300a4fe740 1 -- 172.21.15.46:0/1492318051 wait complete. 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.421+0000 7f300a4fe740 1 -- start start 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.421+0000 7f300a4fe740 1 Processor -- start 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.421+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 0x557a02934f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.421+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292adc0 0x557a02932200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a02932740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f300a4fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557a02938250 con 0x557a0292a4a0 2024-09-19T09:20:34.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f300a4fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557a0284b050 con 0x557a0292adc0 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f300a4fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557a029383d0 con 0x557a02935680 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 0x557a02934f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f300a4fe740 10 client.0 _ll_register_callbacks cb 0x557a0288b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 0x557a02934f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51134/0 (socket says 172.21.15.46:51134) 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 -- 172.21.15.46:0/2804717121 learned_addr learned my addr 172.21.15.46:0/2804717121 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f30056c0640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292adc0 0x557a02932200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f30066c2640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a02932740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 -- 172.21.15.46:0/2804717121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 msgr2=0x557a02932740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a02932740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 -- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292adc0 msgr2=0x557a02932200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292adc0 0x557a02932200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 -- 172.21.15.46:0/2804717121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a026013c0 con 0x557a0292a4a0 2024-09-19T09:20:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f2fe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:34.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f3005ec1640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 0x557a02934f50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00c6a0 tx=0x7f2ffc09be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2080aef13ef407c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f2fe97fa640 1 -- 172.21.15.46:0/2804717121 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0a4e10 con 0x557a0292a4a0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff0015070 con 0x557a0292a4a0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.422+0000 7f2fe97fa640 1 -- 172.21.15.46:0/2804717121 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2ffc0a00b0 con 0x557a0292a4a0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f2fe97fa640 1 -- 172.21.15.46:0/2804717121 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ffc0b5170 con 0x557a0292a4a0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 10 client.16041 fetch_fsmap learned FSMap version 30 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a02943c50 con 0x557a0292a4a0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f2fe97fa640 1 -- 172.21.15.46:0/2804717121 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff0015070 con 0x557a0292a4a0 2024-09-19T09:20:34.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f2fe97fa640 1 -- 172.21.15.46:0/2804717121 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f2ffc018b30 con 0x557a0292a4a0 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 10 client.16041 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 20 client.16041 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a02945240 0x557a02947630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 4 client.16041 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a0289d850 con 0x557a02945240 2024-09-19T09:20:34.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.423+0000 7f30056c0640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a02945240 0x557a02947630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.424+0000 7f30056c0640 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a02945240 0x557a02947630 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d4e3fbc233ddc1 server_cookie=4cb15262e86bcee2 in_seq=0 out_seq=0 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.424+0000 7f2fe97fa640 10 client.16041 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f2fe97fa640 1 -- 172.21.15.46:0/2804717121 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a0289d850 con 0x557a02945240 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f2fe97fa640 10 client.16041 handle_command_reply: tid=0 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 client.16041 shutdown 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 msgr2=0x557a02934f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 0x557a02934f50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00c6a0 tx=0x7f2ffc09be10 comp rx=0 tx=0).stop 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 shutdown_connections 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a02945240 0x557a02947630 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a02932740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292adc0 0x557a02932200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f2fe97fa640 0 client.16041 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 --2- 172.21.15.46:0/2804717121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292a4a0 0x557a02934f50 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 >> 172.21.15.46:0/2804717121 conn(0x557a02926a30 msgr2=0x557a0292c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 shutdown_connections 2024-09-19T09:20:34.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 1 -- 172.21.15.46:0/2804717121 wait complete. 2024-09-19T09:20:34.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.425+0000 7f300a4fe740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T09:20:34.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 Processor -- start 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 -- start start 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a029414b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0292c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0294cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f30001af5f0 con 0x557a0292adc0 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b1190 con 0x557a0292a4a0 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f300a4fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f30001afcc0 con 0x557a02935680 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f30056c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0292c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a029414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f30056c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0292c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51150/0 (socket says 172.21.15.46:51150) 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.443+0000 7f30056c0640 1 -- 172.21.15.46:0/1743471385 learned_addr learned my addr 172.21.15.46:0/1743471385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f30066c2640 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0294cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f3005ec1640 1 -- 172.21.15.46:0/1743471385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 msgr2=0x557a0294cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f3005ec1640 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0294cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f3005ec1640 1 -- 172.21.15.46:0/1743471385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 msgr2=0x557a0292c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f3005ec1640 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0292c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f3005ec1640 1 -- 172.21.15.46:0/1743471385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a02926860 con 0x557a0292a4a0 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f30056c0640 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0292c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f3005ec1640 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a029414b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc09bf50 tx=0x7f2ffc09a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c06273b6fdaf2c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f2feb7fe640 1 -- 172.21.15.46:0/1743471385 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0bc070 con 0x557a0292a4a0 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f2feb7fe640 1 -- 172.21.15.46:0/1743471385 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ffc0bc210 con 0x557a0292a4a0 2024-09-19T09:20:34.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.444+0000 7f2feb7fe640 1 -- 172.21.15.46:0/1743471385 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0a0310 con 0x557a0292a4a0 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 -- 172.21.15.46:0/1743471385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 msgr2=0x557a029414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a029414b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc09bf50 tx=0x7f2ffc09a760 comp rx=0 tx=0).stop 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 -- 172.21.15.46:0/1743471385 shutdown_connections 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0292c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0294cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 --2- 172.21.15.46:0/1743471385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a029414b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 -- 172.21.15.46:0/1743471385 >> 172.21.15.46:0/1743471385 conn(0x557a02926a30 msgr2=0x557a0292bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 -- 172.21.15.46:0/1743471385 shutdown_connections 2024-09-19T09:20:34.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 -- 172.21.15.46:0/1743471385 wait complete. 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 -- start start 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.445+0000 7f300a4fe740 1 Processor -- start 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a0293d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0293db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0293a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b0a60 con 0x557a0292adc0 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b0390 con 0x557a0292a4a0 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f30001ad5d0 con 0x557a02935680 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f300a4fe740 10 client.0 _ll_register_callbacks cb 0x7f2ffc00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0293db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f3005ec1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a0293d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0293db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51156/0 (socket says 172.21.15.46:51156) 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 -- 172.21.15.46:0/208338273 learned_addr learned my addr 172.21.15.46:0/208338273 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30066c2640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0293a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 -- 172.21.15.46:0/208338273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 msgr2=0x557a0293a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0293a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 -- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 msgr2=0x557a0293d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a0293d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f30056c0640 1 -- 172.21.15.46:0/208338273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a02938130 con 0x557a0292adc0 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.446+0000 7f3005ec1640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a0293d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f30056c0640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0293db60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x557a02927db0 tx=0x7f2ff00048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322a1a288b8efff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f2fe97fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f2fe97fa640 1 -- 172.21.15.46:0/208338273 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0003ee0 con 0x557a0292adc0 2024-09-19T09:20:34.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f2fe97fa640 1 -- 172.21.15.46:0/208338273 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2ff0011440 con 0x557a0292adc0 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ffc0bc210 con 0x557a0292adc0 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f2fe97fa640 1 -- 172.21.15.46:0/208338273 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2ff0011640 con 0x557a0292adc0 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 10 client.16047 fetch_fsmap learned FSMap version 30 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557a029b02a0 con 0x557a0292adc0 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f2fe97fa640 1 -- 172.21.15.46:0/208338273 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ffc0bc210 con 0x557a0292adc0 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f2fe97fa640 1 -- 172.21.15.46:0/208338273 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f2ff003b9a0 con 0x557a0292adc0 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 10 client.16047 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 20 client.16047 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a029b0790 0x557a029b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 4 client.16047 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.447+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a02897d60 con 0x557a029b0790 2024-09-19T09:20:34.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.448+0000 7f3005ec1640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a029b0790 0x557a029b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.448+0000 7f3005ec1640 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a029b0790 0x557a029b2bb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e14506e970a7ac8 server_cookie=a5d0be783fd12df6 in_seq=0 out_seq=0 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.448+0000 7f2fe97fa640 10 client.16047 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.448+0000 7f2fe97fa640 1 -- 172.21.15.46:0/208338273 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557a02897d60 con 0x557a029b0790 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.448+0000 7f2fe97fa640 10 client.16047 handle_command_reply: tid=0 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.448+0000 7f300a4fe740 1 client.16047 shutdown 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 msgr2=0x557a0293db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0293db60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x557a02927db0 tx=0x7f2ff00048d0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 shutdown_connections 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557a029b0790 0x557a029b2bb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557a0292adc0 0x557a0293db60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557a02935680 0x557a0293a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 --2- 172.21.15.46:0/208338273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557a0292a4a0 0x557a0293d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f2fe97fa640 0 client.16047 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 >> 172.21.15.46:0/208338273 conn(0x557a02926a30 msgr2=0x557a02925b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 shutdown_connections 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 1 -- 172.21.15.46:0/208338273 wait complete. 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f300a4fe740 20 client.16047 trim_cache size 0 max 16384 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {} 2024-09-19T09:20:34.456 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2fec0a32c0 msgr2=0x7f2fec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f3008125640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2fec0a32c0 0x7f2fec0a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8004af0 tx=0x7f2ff8004a80 comp rx=0 tx=0).stop 2024-09-19T09:20:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 msgr2=0x7f300019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.449+0000 7f3008125640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 0x7f300019a5d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00e9f0 tx=0x7f2ffc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 shutdown_connections 2024-09-19T09:20:34.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2fec0a32c0 0x7f2fec0a5780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3000106f10 0x7f300019eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3000102790 0x7f300019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 --2- 172.21.15.46:0/2273855392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3000101de0 0x7f300019a5d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 >> 172.21.15.46:0/2273855392 conn(0x7f30000fd8c0 msgr2=0x7f30000feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 shutdown_connections 2024-09-19T09:20:34.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:34.450+0000 7f3008125640 1 -- 172.21.15.46:0/2273855392 wait complete. 2024-09-19T09:20:34.948 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 -- 172.21.15.46:0/1943022975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100410 msgr2=0x7f23d4100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1943022975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100410 0x7f23d4100810 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009900 tx=0x7f23d002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 -- 172.21.15.46:0/1943022975 shutdown_connections 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1943022975 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d41016f0 0x7f23d4101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1943022975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4100d50 0x7f23d41011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1943022975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100410 0x7f23d4100810 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 -- 172.21.15.46:0/1943022975 >> 172.21.15.46:0/1943022975 conn(0x7f23d40fc1e0 msgr2=0x7f23d40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 -- 172.21.15.46:0/1943022975 shutdown_connections 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 -- 172.21.15.46:0/1943022975 wait complete. 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 Processor -- start 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.942+0000 7f23db9cf640 1 -- start start 2024-09-19T09:20:34.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23db9cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4100410 0x7f23d4199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23db9cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 0x7f23d419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23db9cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d41016f0 0x7f23d41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23db9cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23d410f9b0 con 0x7f23d4100d50 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23db9cf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23d410f830 con 0x7f23d4100410 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23db9cf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23d410fb30 con 0x7f23d41016f0 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 0x7f23d419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 0x7f23d419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51172/0 (socket says 172.21.15.46:51172) 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1076262483 learned_addr learned my addr 172.21.15.46:0/1076262483 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d976b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4100410 0x7f23d4199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d41016f0 0x7f23d41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1076262483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d41016f0 msgr2=0x7f23d41a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.950 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d41016f0 0x7f23d41a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1076262483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4100410 msgr2=0x7f23d4199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4100410 0x7f23d4199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1076262483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41a1bf0 con 0x7f23d4100d50 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 0x7f23d419a510 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f23c400e9f0 tx=0x7f23c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23ca7fc640 1 -- 172.21.15.46:0/1076262483 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c400cd80 con 0x7f23d4100d50 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.943+0000 7f23ca7fc640 1 -- 172.21.15.46:0/1076262483 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c4010910 con 0x7f23d4100d50 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.944+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41a1ee0 con 0x7f23d4100d50 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.944+0000 7f23ca7fc640 1 -- 172.21.15.46:0/1076262483 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4018990 con 0x7f23d4100d50 2024-09-19T09:20:34.951 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.944+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a2420 con 0x7f23d4100d50 2024-09-19T09:20:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 Processor -- start 2024-09-19T09:20:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23ca7fc640 1 -- 172.21.15.46:0/1076262483 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f23c4010ac0 con 0x7f23d4100d50 2024-09-19T09:20:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 -- start start 2024-09-19T09:20:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad3994da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.957 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad3999da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad399c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55dad38f82f0 con 0x55dad399a370 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55dad38a0270 con 0x55dad39952e0 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23de844740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55dad38f42b0 con 0x55dad39949a0 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad399c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad399c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51174/0 (socket says 172.21.15.46:51174) 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d976b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad3999da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1282389408 learned_addr learned my addr 172.21.15.46:0/1282389408 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad3994da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1282389408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 msgr2=0x55dad3994da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad3994da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.958 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1282389408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 msgr2=0x55dad3999da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad3999da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 -- 172.21.15.46:0/1282389408 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad389f340 con 0x55dad399a370 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d976b640 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad3999da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad3994da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23ca7fc640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f23c00a32f0 0x7f23c00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.947+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad399c830 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f23c40d3e50 tx=0x7f23c40d8780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb6b994cdcc56f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.948+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f23c00a32f0 0x7f23c00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.948+0000 7f23bf7fe640 1 -- 172.21.15.46:0/1282389408 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40985a0 con 0x55dad399a370 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.948+0000 7f23ca7fc640 1 -- 172.21.15.46:0/1076262483 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f23c40cfcb0 con 0x7f23d4100d50 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.948+0000 7f23bf7fe640 1 -- 172.21.15.46:0/1282389408 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c40dd070 con 0x55dad399a370 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.948+0000 7f23bf7fe640 1 -- 172.21.15.46:0/1282389408 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c409eb10 con 0x55dad399a370 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 -- 172.21.15.46:0/1282389408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 msgr2=0x55dad399c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.959 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad399c830 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f23c40d3e50 tx=0x7f23c40d8780 comp rx=0 tx=0).stop 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f23c00a32f0 0x7f23c00a57b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009fd0 tx=0x7f23cc00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 -- 172.21.15.46:0/1282389408 shutdown_connections 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad399c830 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad3999da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 --2- 172.21.15.46:0/1282389408 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad3994da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 -- 172.21.15.46:0/1282389408 >> 172.21.15.46:0/1282389408 conn(0x55dad3990010 msgr2=0x55dad3990410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 -- 172.21.15.46:0/1282389408 shutdown_connections 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 -- 172.21.15.46:0/1282389408 wait complete. 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 -- start start 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 Processor -- start 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 0x55dad399eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.960 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.949+0000 7f23de844740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39952e0 0x55dad399f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23de844740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad39a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23de844740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55dad399d340 con 0x55dad399a370 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23de844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55dad3881290 con 0x55dad39949a0 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23de844740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55dad399d4c0 con 0x55dad39952e0 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23de844740 10 client.0 _ll_register_callbacks cb 0x55dad38b2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d976b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 0x55dad399eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad39a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d976b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 0x55dad399eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:55616/0 (socket says 172.21.15.46:55616) 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d976b640 1 -- 172.21.15.46:0/3172387592 learned_addr learned my addr 172.21.15.46:0/3172387592 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39952e0 0x55dad399f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 -- 172.21.15.46:0/3172387592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39952e0 msgr2=0x55dad399f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39952e0 0x55dad399f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 -- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 msgr2=0x55dad399eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 0x55dad399eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 -- 172.21.15.46:0/3172387592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad360b210 con 0x55dad399a370 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d976b640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 0x55dad399eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad39a6110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00bfd0 tx=0x7f23cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f54184fb6c548b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23bcff9640 1 -- 172.21.15.46:0/3172387592 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc028060 con 0x55dad399a370 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23bcff9640 1 -- 172.21.15.46:0/3172387592 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f23cc018d70 con 0x55dad399a370 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.950+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23c40dd070 con 0x55dad399a370 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23bcff9640 1 -- 172.21.15.46:0/3172387592 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f23cc023420 con 0x55dad399a370 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 10 client.16059 fetch_fsmap learned FSMap version 31 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dad36d7620 con 0x55dad399a370 2024-09-19T09:20:34.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23bcff9640 1 -- 172.21.15.46:0/3172387592 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c40dd070 con 0x55dad399a370 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23bcff9640 1 -- 172.21.15.46:0/3172387592 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f23cc016070 con 0x55dad399a370 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 10 client.16059 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 20 client.16059 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad39aa920 0x55dad39acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 4 client.16059 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dad3905a20 con 0x55dad39aa920 2024-09-19T09:20:34.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23d976b640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad39aa920 0x55dad39acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23d976b640 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad39aa920 0x55dad39acd80 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56ec6afc1b4983c server_cookie=6a3eabc948073853 in_seq=0 out_seq=0 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.951+0000 7f23bcff9640 10 client.16059 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.953+0000 7f23bcff9640 1 -- 172.21.15.46:0/3172387592 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dad3905a20 con 0x55dad39aa920 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.953+0000 7f23bcff9640 10 client.16059 handle_command_reply: tid=0 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.953+0000 7f23de844740 1 client.16059 shutdown 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.953+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 msgr2=0x55dad39a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.953+0000 7f23de844740 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad39a6110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f23cc00bfd0 tx=0x7f23cc004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 shutdown_connections 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad39aa920 0x55dad39acd80 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad399a370 0x55dad39a6110 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39952e0 0x55dad399f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 --2- 172.21.15.46:0/3172387592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39949a0 0x55dad399eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23bcff9640 0 client.16059 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 >> 172.21.15.46:0/3172387592 conn(0x55dad3990010 msgr2=0x55dad3991820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 shutdown_connections 2024-09-19T09:20:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 1 -- 172.21.15.46:0/3172387592 wait complete. 2024-09-19T09:20:34.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.954+0000 7f23de844740 20 client.16059 trim_cache size 0 max 16384 2024-09-19T09:20:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 Processor -- start 2024-09-19T09:20:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 -- start start 2024-09-19T09:20:34.971 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad398f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 0x55dad39a6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad399a370 0x55dad3991400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41ab160 con 0x55dad39952e0 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41acd30 con 0x55dad399a370 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23de844740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41ab830 con 0x55dad39949a0 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 0x55dad39a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 0x55dad39a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51178/0 (socket says 172.21.15.46:51178) 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23d8f6a640 1 -- 172.21.15.46:0/101047016 learned_addr learned my addr 172.21.15.46:0/101047016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad399a370 0x55dad3991400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.968+0000 7f23d976b640 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad398f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d8f6a640 1 -- 172.21.15.46:0/101047016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 msgr2=0x55dad398f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad398f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d8f6a640 1 -- 172.21.15.46:0/101047016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad399a370 msgr2=0x55dad3991400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad399a370 0x55dad3991400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d8f6a640 1 -- 172.21.15.46:0/101047016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad398fe30 con 0x55dad39952e0 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad399a370 0x55dad3991400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 0x55dad39a6060 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f23c40d8bc0 tx=0x7f23c40d8ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01f264d59a113e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23beffd640 1 -- 172.21.15.46:0/101047016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c409ed70 con 0x55dad39952e0 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23beffd640 1 -- 172.21.15.46:0/101047016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c40dd070 con 0x55dad39952e0 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.969+0000 7f23beffd640 1 -- 172.21.15.46:0/101047016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c409efd0 con 0x55dad39952e0 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- 172.21.15.46:0/101047016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 msgr2=0x55dad39a6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 0x55dad39a6060 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f23c40d8bc0 tx=0x7f23c40d8ef0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- 172.21.15.46:0/101047016 shutdown_connections 2024-09-19T09:20:34.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39952e0 0x55dad39a6060 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad399a370 0x55dad3991400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- 172.21.15.46:0/101047016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad39949a0 0x55dad398f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- 172.21.15.46:0/101047016 >> 172.21.15.46:0/101047016 conn(0x55dad3990010 msgr2=0x55dad398e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- 172.21.15.46:0/101047016 shutdown_connections 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- 172.21.15.46:0/101047016 wait complete. 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- start start 2024-09-19T09:20:34.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 Processor -- start 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 0x55dad39a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad39a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad399a370 0x55dad39a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41ac5d0 con 0x55dad39949a0 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41abf00 con 0x55dad39952e0 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41a9140 con 0x55dad399a370 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23de844740 10 client.0 _ll_register_callbacks cb 0x7f23cc009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:34.977 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.970+0000 7f23d976b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 0x55dad39a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 0x55dad39a35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51194/0 (socket says 172.21.15.46:51194) 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 -- 172.21.15.46:0/1176595006 learned_addr learned my addr 172.21.15.46:0/1176595006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d8f6a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad39a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d9f6c640 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad399a370 0x55dad39a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 -- 172.21.15.46:0/1176595006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad399a370 msgr2=0x55dad39a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad399a370 0x55dad39a4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 -- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 msgr2=0x55dad39a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad39a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 -- 172.21.15.46:0/1176595006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad39a50f0 con 0x55dad39949a0 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23d976b640 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 0x55dad39a35e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f23d00314e0 tx=0x7f23d002abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6536c01f46251606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:34.978 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23bcff9640 1 -- 172.21.15.46:0/1176595006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0035040 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23bcff9640 1 -- 172.21.15.46:0/1176595006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f23d0031910 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23c40dd070 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23bcff9640 1 -- 172.21.15.46:0/1176595006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f23d0031b10 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23de844740 10 client.16065 fetch_fsmap learned FSMap version 31 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.971+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dad3a15660 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23bcff9640 1 -- 172.21.15.46:0/1176595006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c40dd070 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23bcff9640 1 -- 172.21.15.46:0/1176595006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f23d0004b60 con 0x55dad39949a0 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23de844740 10 client.16065 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23de844740 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23de844740 20 client.16065 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23de844740 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad3a15fc0 0x55dad3a183e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23de844740 4 client.16065 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:20:34.979 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dad38ffd70 con 0x55dad3a15fc0 2024-09-19T09:20:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad3a15fc0 0x55dad3a183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23bcff9640 10 client.16065 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:34.980 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:34.972+0000 7f23d8f6a640 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad3a15fc0 0x55dad3a183e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed9a09090129fd75 server_cookie=994c4f65dcb28e46 in_seq=0 out_seq=0 2024-09-19T09:20:35.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:34 smithi115 ceph-mon[35055]: pgmap v406: 97 pgs: 97 active+clean; 24 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 49 op/s 2024-09-19T09:20:35.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:34 smithi046 ceph-mon[31203]: pgmap v406: 97 pgs: 97 active+clean; 24 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 49 op/s 2024-09-19T09:20:35.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:34 smithi099 ceph-mon[35256]: pgmap v406: 97 pgs: 97 active+clean; 24 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 49 op/s 2024-09-19T09:20:35.270 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:20:35.271 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:20:35.746 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23bcff9640 1 -- 172.21.15.46:0/1176595006 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dad38ffd70 con 0x55dad3a15fc0 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23bcff9640 10 client.16065 handle_command_reply: tid=0 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 client.16065 shutdown 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 msgr2=0x55dad39a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 0x55dad39a35e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f23d00314e0 tx=0x7f23d002abc0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 shutdown_connections 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55dad3a15fc0 0x55dad3a183e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55dad399a370 0x55dad39a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dad39952e0 0x55dad39a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 --2- 172.21.15.46:0/1176595006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55dad39949a0 0x55dad39a35e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.911+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 >> 172.21.15.46:0/1176595006 conn(0x55dad3990010 msgr2=0x55dad398e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.912+0000 7f23bcff9640 0 client.16065 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.912+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 shutdown_connections 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.912+0000 7f23de844740 1 -- 172.21.15.46:0/1176595006 wait complete. 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.912+0000 7f23de844740 20 client.16065 trim_cache size 0 max 16384 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:20:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:20:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f23c00a32f0 msgr2=0x7f23c00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f23c00a32f0 0x7f23c00a57b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009fd0 tx=0x7f23cc00e040 comp rx=0 tx=0).stop 2024-09-19T09:20:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 msgr2=0x7f23d419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 0x7f23d419a510 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f23c400e9f0 tx=0x7f23c400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 shutdown_connections 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f23c00a32f0 0x7f23c00a57b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23d4100d50 0x7f23d419a510 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f23d41016f0 0x7f23d41a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 --2- 172.21.15.46:0/1076262483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d4100410 0x7f23d4199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 >> 172.21.15.46:0/1076262483 conn(0x7f23d40fc1e0 msgr2=0x7f23d40fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 shutdown_connections 2024-09-19T09:20:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:35.913+0000 7f23db9cf640 1 -- 172.21.15.46:0/1076262483 wait complete. 2024-09-19T09:20:36.179 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:35 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:36.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:35 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:36.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:35 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:36.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 -- 172.21.15.46:0/2292782796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc102d30 msgr2=0x7f74dc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 --2- 172.21.15.46:0/2292782796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc102d30 0x7f74dc103110 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009930 tx=0x7f74cc02a420 comp rx=0 tx=0).stop 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 -- 172.21.15.46:0/2292782796 shutdown_connections 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 --2- 172.21.15.46:0/2292782796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc1082a0 0x7f74dc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 --2- 172.21.15.46:0/2292782796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74dc1036e0 0x7f74dc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 --2- 172.21.15.46:0/2292782796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc102d30 0x7f74dc103110 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 -- 172.21.15.46:0/2292782796 >> 172.21.15.46:0/2292782796 conn(0x7f74dc0fc7d0 msgr2=0x7f74dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 -- 172.21.15.46:0/2292782796 shutdown_connections 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 -- 172.21.15.46:0/2292782796 wait complete. 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 Processor -- start 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.262+0000 7f74e22e4640 1 -- start start 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e22e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc102d30 0x7f74dc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e22e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 0x7f74dc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e22e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74dc1082a0 0x7f74dc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e22e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc1120a0 con 0x7f74dc1036e0 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e22e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc111f20 con 0x7f74dc1082a0 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e22e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc112220 con 0x7f74dc102d30 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 0x7f74dc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc102d30 0x7f74dc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74e0881640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74dc1082a0 0x7f74dc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 0x7f74dc100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51214/0 (socket says 172.21.15.46:51214) 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 -- 172.21.15.46:0/1634615615 learned_addr learned my addr 172.21.15.46:0/1634615615 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 -- 172.21.15.46:0/1634615615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc102d30 msgr2=0x7f74dc100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc102d30 0x7f74dc100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 -- 172.21.15.46:0/1634615615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74dc1082a0 msgr2=0x7f74dc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74dc1082a0 0x7f74dc101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.263+0000 7f74db7fe640 1 -- 172.21.15.46:0/1634615615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc1a6a80 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.264+0000 7f74db7fe640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 0x7f74dc100ed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d950 tx=0x7f74d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.264+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0017070 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.264+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74d0009c30 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.264+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc1a6d70 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.264+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d00047a0 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.264+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc1a7250 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.265+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc06a850 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.266+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f74d0004020 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.267+0000 7f74d97fa640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f74c40a3240 0x7f74c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.267+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f74d00cf4a0 con 0x7f74dc1036e0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.267+0000 7f74dbfff640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f74c40a3240 0x7f74c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.268+0000 7f74dbfff640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f74c40a3240 0x7f74c40a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009900 tx=0x7f74cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.271+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74d0020020 con 0x7f74dc1036e0 2024-09-19T09:20:36.385 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 7% (322/4351) Updating files: 8% (349/4351) Updating files: 9% (392/4351) Updating files: 10% (436/4351) Updating files: 11% (479/4351) Updating files: 11% (493/4351) Updating files: 12% (523/4351) Updating files: 13% (566/4351) Updating files: 14% (610/4351) Updating files: 15% (653/4351) Updating files: 16% (697/4351) Updating files: 17% (740/4351) Updating files: 18% (784/4351) Updating files: 19% (827/4351) Updating files: 20% (871/4351) Updating files: 21% (914/4351) Updating files: 22% (958/4351) Updating files: 23% (1001/4351) Updating files: 24% (1045/4351) Updating files: 25% (1088/4351) Updating files: 26% (1132/4351) Updating files: 27% (1175/4351) Updating files: 28% (1219/4351) Updating files: 29% (1262/4351) Updating files: 29% (1303/4351) Updating files: 30% (1306/4351) Updating files: 31% (1349/4351) Updating files: 32% (1393/4351) Updating files: 33% (1436/4351) Updating files: 34% (1480/4351) Updating files: 35% (1523/4351) Updating files: 36% (1567/4351) Updating files: 37% (1610/4351) Updating files: 38% (1654/4351) Updating files: 39% (1697/4351) Updating files: 40% (1741/4351) Updating files: 40% (1769/4351) Updating files: 41% (1784/4351) Updating files: 42% (1828/4351) Updating files: 43% (1871/4351) Updating files: 44% (1915/4351) Updating files: 45% (1958/4351) Updating files: 46% (2002/4351) Updating files: 47% (2045/4351) Updating files: 48% (2089/4351) Updating files: 49% (2132/4351) Updating files: 50% (2176/4351) Updating files: 51% (2220/4351) Updating files: 52% (2263/4351) Updating files: 53% (2307/4351) Updating files: 54% (2350/4351) Updating files: 54% (2388/4351) Updating files: 55% (2394/4351) Updating files: 56% (2437/4351) Updating files: 57% (2481/4351) Updating files: 58% (2524/4351) Updating files: 59% (2568/4351) Updating files: 60% (2611/4351) Updating files: 61% (2655/4351) Updating files: 62% (2698/4351) Updating files: 63% (2742/4351) Updating files: 64% (2785/4351) Updating files: 64% (2809/4351) Updating files: 65% (2829/4351) Updating files: 66% (2872/4351) Updating files: 67% (2916/4351) Updating files: 68% (2959/4351) Updating files: 69% (3003/4351) Updating files: 69% (3040/4351) Updating files: 70% (3046/4351) Updating files: 71% (3090/4351) Updating files: 72% (3133/4351) Updating files: 73% (3177/4351) Updating files: 74% (3220/4351) Updating files: 75% (3264/4351) Updating files: 76% (3307/4351) Updating files: 77% (3351/4351) Updating files: 78% (3394/4351) Updating files: 79% (3438/4351) Updating files: 80% (3481/4351) Updating files: 81% (3525/4351) Updating files: 82% (3568/4351) Updating files: 83% (3612/4351) Updating files: 84% (3655/4351) Updating files: 85% (3699/4351) Updating files: 86% (3742/4351) Updating files: 87% (3786/4351) Updating files: 87% (3828/4351) Updating files: 88% (3829/4351) Updating files: 89% (3873/4351) Updating files: 90% (3916/4351) Updating files: 91% (3960/4351) Updating files: 92% (4003/4351) Updating files: 93% (4047/4351) Updating files: 94% (4090/4351) Updating files: 94% (4114/4351) Updating files: 95% (4134/4351) Updating files: 96% (4177/4351) Updating files: 97% (4221/4351) Updating files: 98% (4264/4351) Updating files: 99% (4308/4351) Updating files: 100% (4351/4351) Updating files: 100% (4351/4351), done. 2024-09-19T09:20:36.395 INFO:tasks.workunit.client.0.smithi046.stderr:+ cd xfstests-dev 2024-09-19T09:20:36.396 INFO:tasks.workunit.client.0.smithi046.stderr:+ git checkout 0e5c12dfd008efc2848c98108c9237487e91ef35 2024-09-19T09:20:36.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.496+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74dc10a2b0 con 0x7f74dc1036e0 2024-09-19T09:20:36.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.497+0000 7f74d97fa640 1 -- 172.21.15.46:0/1634615615 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11964 (secure 0 0 0) 0x7f74d009c1f0 con 0x7f74dc1036e0 2024-09-19T09:20:36.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:20:36.498 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"btime":"2024-09-19T09:20:34:897481+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:20:34.199849+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:20:36.499 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-19T09:20:36.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f74c40a3240 msgr2=0x7f74c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f74c40a3240 0x7f74c40a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f74cc009900 tx=0x7f74cc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 msgr2=0x7f74dc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 0x7f74dc100ed0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f74d000d950 tx=0x7f74d000de10 comp rx=0 tx=0).stop 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 shutdown_connections 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f74c40a3240 0x7f74c40a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74dc1036e0 0x7f74dc100ed0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74dc1082a0 0x7f74dc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 --2- 172.21.15.46:0/1634615615 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc102d30 0x7f74dc100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 >> 172.21.15.46:0/1634615615 conn(0x7f74dc0fc7d0 msgr2=0x7f74dc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 shutdown_connections 2024-09-19T09:20:36.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:36.499+0000 7f74e22e4640 1 -- 172.21.15.46:0/1634615615 wait complete. 2024-09-19T09:20:37.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:36 smithi115 ceph-mon[35055]: pgmap v407: 97 pgs: 97 active+clean; 26 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 615 KiB/s wr, 57 op/s 2024-09-19T09:20:37.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:36 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1634615615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:37.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:36 smithi046 ceph-mon[31203]: pgmap v407: 97 pgs: 97 active+clean; 26 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 615 KiB/s wr, 57 op/s 2024-09-19T09:20:37.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:36 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1634615615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:37.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:36 smithi099 ceph-mon[35256]: pgmap v407: 97 pgs: 97 active+clean; 26 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 615 KiB/s wr, 57 op/s 2024-09-19T09:20:37.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:36 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1634615615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:20:37.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:20:37.754 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 -- 172.21.15.46:0/816277211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220102790 msgr2=0x7fa2201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 --2- 172.21.15.46:0/816277211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220102790 0x7fa2201067e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa210009900 tx=0x7fa21002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 -- 172.21.15.46:0/816277211 shutdown_connections 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 --2- 172.21.15.46:0/816277211 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220102790 0x7fa2201067e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 --2- 172.21.15.46:0/816277211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 0x7fa22010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 --2- 172.21.15.46:0/816277211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa220101de0 0x7fa2201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 -- 172.21.15.46:0/816277211 >> 172.21.15.46:0/816277211 conn(0x7fa2200fd8c0 msgr2=0x7fa2200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 -- 172.21.15.46:0/816277211 shutdown_connections 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.250+0000 7fa22724b640 1 -- 172.21.15.46:0/816277211 wait complete. 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 Processor -- start 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 -- start start 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 0x7fa220198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa220102790 0x7fa2201989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 0x7fa22019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa220111f70 con 0x7fa220101de0 2024-09-19T09:20:38.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa220111df0 con 0x7fa220106f10 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa22724b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201120f0 con 0x7fa220102790 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 0x7fa220198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 0x7fa220198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51240/0 (socket says 172.21.15.46:51240) 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 -- 172.21.15.46:0/944127472 learned_addr learned my addr 172.21.15.46:0/944127472 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa2257e8640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 0x7fa22019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa217fff640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa220102790 0x7fa2201989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 -- 172.21.15.46:0/944127472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa220102790 msgr2=0x7fa2201989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa220102790 0x7fa2201989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 -- 172.21.15.46:0/944127472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 msgr2=0x7fa22019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.251+0000 7fa224fe7640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 0x7fa22019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa224fe7640 1 -- 172.21.15.46:0/944127472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa22019d440 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa2257e8640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 0x7fa22019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa224fe7640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 0x7fa220198490 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c890 tx=0x7fa21c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa215ffb640 1 -- 172.21.15.46:0/944127472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004220 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa22019d730 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa215ffb640 1 -- 172.21.15.46:0/944127472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21c0043c0 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa215ffb640 1 -- 172.21.15.46:0/944127472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004a00 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.252+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2201a5010 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.254+0000 7fa215ffb640 1 -- 172.21.15.46:0/944127472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa21c0079b0 con 0x7fa220101de0 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.254+0000 7fa229624740 1 Processor -- start 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 -- start start 2024-09-19T09:20:38.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4744090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4744a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4753780 0x5631c4755b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5631c46aa2f0 con 0x5631c4745b40 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631c4651cf0 con 0x5631c4753780 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa229624740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5631c46a62b0 con 0x5631c47445d0 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4744090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa217fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4753780 0x5631c4755b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4744090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51244/0 (socket says 172.21.15.46:51244) 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa224fe7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4744a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 -- 172.21.15.46:0/1762376345 learned_addr learned my addr 172.21.15.46:0/1762376345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 -- 172.21.15.46:0/1762376345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 msgr2=0x5631c4744a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa215ffb640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa2080a3240 0x7fa2080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4744a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 -- 172.21.15.46:0/1762376345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4753780 msgr2=0x5631c4755b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4753780 0x5631c4755b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa2257e8640 1 -- 172.21.15.46:0/1762376345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c46363a0 con 0x5631c4745b40 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.255+0000 7fa217fff640 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4753780 0x5631c4755b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.256+0000 7fa215ffb640 1 -- 172.21.15.46:0/944127472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa21c0cf5b0 con 0x7fa220101de0 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.256+0000 7fa2257e8640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa2080a3240 0x7fa2080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.256+0000 7fa2257e8640 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4744090 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa218011790 tx=0x7fa218011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1502169f242e3e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.256+0000 7fa206ffd640 1 -- 172.21.15.46:0/1762376345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21801b630 con 0x5631c4745b40 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.256+0000 7fa206ffd640 1 -- 172.21.15.46:0/1762376345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa218019db0 con 0x5631c4745b40 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.256+0000 7fa206ffd640 1 -- 172.21.15.46:0/1762376345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21800e8e0 con 0x5631c4745b40 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 -- 172.21.15.46:0/1762376345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 msgr2=0x5631c4744090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4744090 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa218011790 tx=0x7fa218011c50 comp rx=0 tx=0).stop 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa2257e8640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa2080a3240 0x7fa2080a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa218020000 tx=0x7fa218021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 -- 172.21.15.46:0/1762376345 shutdown_connections 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4753780 0x5631c4755b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4744a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 --2- 172.21.15.46:0/1762376345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4744090 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 -- 172.21.15.46:0/1762376345 >> 172.21.15.46:0/1762376345 conn(0x5631c470d310 msgr2=0x5631c4740c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 -- 172.21.15.46:0/1762376345 shutdown_connections 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 -- 172.21.15.46:0/1762376345 wait complete. 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 -- start start 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.257+0000 7fa229624740 1 Processor -- start 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4753140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c47503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c47509e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5631c4756480 con 0x5631c4753780 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631c4665060 con 0x5631c4745b40 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5631c4756600 con 0x5631c47445d0 2024-09-19T09:20:38.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa229624740 10 client.0 _ll_register_callbacks cb 0x5631c43b88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c47503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa2257e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c47509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c47503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:55686/0 (socket says 172.21.15.46:55686) 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 -- 172.21.15.46:0/3133174581 learned_addr learned my addr 172.21.15.46:0/3133174581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa2257e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c47509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51260/0 (socket says 172.21.15.46:51260) 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa224fe7640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4753140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 -- 172.21.15.46:0/3133174581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 msgr2=0x5631c4753140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4753140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 -- 172.21.15.46:0/3133174581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 msgr2=0x5631c47509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c47509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa217fff640 1 -- 172.21.15.46:0/3133174581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c441b3c0 con 0x5631c4745b40 2024-09-19T09:20:38.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.258+0000 7fa2257e8640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c47509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa217fff640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c47503f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa21002a930 tx=0x7fa210031a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d325a03549f87c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa1fffff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa1fffff640 1 -- 172.21.15.46:0/3133174581 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210035040 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa1fffff640 1 -- 172.21.15.46:0/3133174581 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa210004380 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa218019db0 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa1fffff640 1 -- 172.21.15.46:0/3133174581 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa21004c070 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa229624740 10 client.25589 fetch_fsmap learned FSMap version 31 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5631c4761ee0 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa1fffff640 1 -- 172.21.15.46:0/3133174581 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa218019db0 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.259+0000 7fa1fffff640 1 -- 172.21.15.46:0/3133174581 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fa210004bc0 con 0x5631c4745b40 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa229624740 10 client.25589 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T09:20:38.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa229624740 10 client.25589 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa229624740 20 client.25589 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa229624740 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47633f0 0x5631c4765820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa229624740 4 client.25589 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c46b7860 con 0x5631c47633f0 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa224fe7640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47633f0 0x5631c4765820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa1fffff640 10 client.25589 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.260+0000 7fa224fe7640 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47633f0 0x5631c4765820 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9a3fdbe443fde751 server_cookie=8d5bdb57ddcdcbfb in_seq=0 out_seq=0 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa1fffff640 1 -- 172.21.15.46:0/3133174581 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631c46b7860 con 0x5631c47633f0 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa1fffff640 10 client.25589 handle_command_reply: tid=0 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 client.25589 shutdown 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 msgr2=0x5631c47503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c47503f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa21002a930 tx=0x7fa210031a80 comp rx=0 tx=0).stop 2024-09-19T09:20:38.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 shutdown_connections 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c47509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47633f0 0x5631c4765820 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c47503f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa1fffff640 0 client.25589 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 --2- 172.21.15.46:0/3133174581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4753140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 >> 172.21.15.46:0/3133174581 conn(0x5631c470d310 msgr2=0x5631c4746960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 shutdown_connections 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 1 -- 172.21.15.46:0/3133174581 wait complete. 2024-09-19T09:20:38.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.261+0000 7fa229624740 20 client.25589 trim_cache size 0 max 16384 2024-09-19T09:20:38.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 Processor -- start 2024-09-19T09:20:38.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 -- start start 2024-09-19T09:20:38.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4740e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c475f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c476b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201ab3d0 con 0x5631c4753780 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201acfa0 con 0x5631c4745b40 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa229624740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201abaa0 con 0x5631c47445d0 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa2257e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c476b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa2257e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c476b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51266/0 (socket says 172.21.15.46:51266) 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa2257e8640 1 -- 172.21.15.46:0/410853835 learned_addr learned my addr 172.21.15.46:0/410853835 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa217fff640 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c475f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.275+0000 7fa224fe7640 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4740e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2257e8640 1 -- 172.21.15.46:0/410853835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 msgr2=0x5631c4740e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2257e8640 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4740e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2257e8640 1 -- 172.21.15.46:0/410853835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 msgr2=0x5631c475f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2257e8640 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c475f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2257e8640 1 -- 172.21.15.46:0/410853835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c47565f0 con 0x5631c4753780 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa217fff640 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c475f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2257e8640 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c476b0f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa218011760 tx=0x7fa218027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5f0528a71c3c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2067fc640 1 -- 172.21.15.46:0/410853835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21801bce0 con 0x5631c4753780 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2067fc640 1 -- 172.21.15.46:0/410853835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21800e3b0 con 0x5631c4753780 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.276+0000 7fa2067fc640 1 -- 172.21.15.46:0/410853835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21800ede0 con 0x5631c4753780 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 -- 172.21.15.46:0/410853835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 msgr2=0x5631c476b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c476b0f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa218011760 tx=0x7fa218027000 comp rx=0 tx=0).stop 2024-09-19T09:20:38.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 -- 172.21.15.46:0/410853835 shutdown_connections 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4753780 0x5631c476b0f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c4745b40 0x5631c475f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 --2- 172.21.15.46:0/410853835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c47445d0 0x5631c4740e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 -- 172.21.15.46:0/410853835 >> 172.21.15.46:0/410853835 conn(0x5631c470d310 msgr2=0x5631c4740700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 -- 172.21.15.46:0/410853835 shutdown_connections 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 -- 172.21.15.46:0/410853835 wait complete. 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 -- start start 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.277+0000 7fa229624740 1 Processor -- start 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c47445d0 0x5631c47575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4757ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c4753780 0x5631c4758020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201ac840 con 0x5631c4745b40 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201ac170 con 0x5631c47445d0 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa2201a93b0 con 0x5631c4753780 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa229624740 10 client.0 _ll_register_callbacks cb 0x7fa210009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4757ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa224fe7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c47445d0 0x5631c47575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4757ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51270/0 (socket says 172.21.15.46:51270) 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 -- 172.21.15.46:0/3895936488 learned_addr learned my addr 172.21.15.46:0/3895936488 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa2257e8640 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c4753780 0x5631c4758020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 -- 172.21.15.46:0/3895936488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c4753780 msgr2=0x5631c4758020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c4753780 0x5631c4758020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 -- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c47445d0 msgr2=0x5631c47575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c47445d0 0x5631c47575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.278+0000 7fa217fff640 1 -- 172.21.15.46:0/3895936488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c47cd0c0 con 0x5631c4745b40 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa217fff640 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4757ae0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa21002a450 tx=0x7fa2100039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc8c036ec671772 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa1fffff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa1fffff640 1 -- 172.21.15.46:0/3895936488 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210035070 con 0x5631c4745b40 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa1fffff640 1 -- 172.21.15.46:0/3895936488 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fa210004180 con 0x5631c4745b40 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa21800e3b0 con 0x5631c4745b40 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa1fffff640 1 -- 172.21.15.46:0/3895936488 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa210061050 con 0x5631c4745b40 2024-09-19T09:20:38.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 10 client.16089 fetch_fsmap learned FSMap version 31 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5631c47ce380 con 0x5631c4745b40 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa1fffff640 1 -- 172.21.15.46:0/3895936488 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21800e3b0 con 0x5631c4745b40 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa1fffff640 1 -- 172.21.15.46:0/3895936488 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7fa210004f60 con 0x5631c4745b40 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 10 client.16089 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 10 client.16089 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 20 client.16089 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47ceb30 0x5631c47d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 4 client.16089 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.279+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631c46b1d70 con 0x5631c47ceb30 2024-09-19T09:20:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa224fe7640 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47ceb30 0x5631c47d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa224fe7640 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47ceb30 0x5631c47d0f50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e161ba5228b25dc server_cookie=1376a74ad7e8124c in_seq=0 out_seq=0 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa1fffff640 10 client.16089 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa1fffff640 1 -- 172.21.15.46:0/3895936488 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631c46b1d70 con 0x5631c47ceb30 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa1fffff640 10 client.16089 handle_command_reply: tid=0 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 client.16089 shutdown 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 msgr2=0x5631c4757ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4757ae0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa21002a450 tx=0x7fa2100039e0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 shutdown_connections 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631c4745b40 0x5631c4757ae0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x5631c47ceb30 0x5631c47d0f50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa1fffff640 0 client.16089 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631c4753780 0x5631c4758020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 --2- 172.21.15.46:0/3895936488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631c47445d0 0x5631c47575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 >> 172.21.15.46:0/3895936488 conn(0x5631c470d310 msgr2=0x5631c473f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.280+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 shutdown_connections 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa229624740 1 -- 172.21.15.46:0/3895936488 wait complete. 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa229624740 20 client.16089 trim_cache size 0 max 16384 2024-09-19T09:20:38.299 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:20:38.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa2080a3240 msgr2=0x7fa2080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa2080a3240 0x7fa2080a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa218020000 tx=0x7fa218021000 comp rx=0 tx=0).stop 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 msgr2=0x7fa220198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 0x7fa220198490 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00c890 tx=0x7fa21c00cc90 comp rx=0 tx=0).stop 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 shutdown_connections 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fa2080a3240 0x7fa2080a5700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa220106f10 0x7fa22019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa220102790 0x7fa2201989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 --2- 172.21.15.46:0/944127472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa220101de0 0x7fa220198490 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.301 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 >> 172.21.15.46:0/944127472 conn(0x7fa2200fd8c0 msgr2=0x7fa2200fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.281+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 shutdown_connections 2024-09-19T09:20:38.302 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:38.282+0000 7fa22724b640 1 -- 172.21.15.46:0/944127472 wait complete. 2024-09-19T09:20:38.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:20:39.201 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:39.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:38 smithi115 ceph-mon[35055]: pgmap v408: 97 pgs: 97 active+clean; 25 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 999 KiB/s wr, 345 op/s 2024-09-19T09:20:39.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:38 smithi046 ceph-mon[31203]: pgmap v408: 97 pgs: 97 active+clean; 25 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 999 KiB/s wr, 345 op/s 2024-09-19T09:20:39.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:38 smithi099 ceph-mon[35256]: pgmap v408: 97 pgs: 97 active+clean; 25 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 999 KiB/s wr, 345 op/s 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 -- 172.21.15.46:0/3809634200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c1008d0 msgr2=0x7f407c100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 --2- 172.21.15.46:0/3809634200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c1008d0 0x7f407c100cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4078009860 tx=0x7f407802a340 comp rx=0 tx=0).stop 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 -- 172.21.15.46:0/3809634200 shutdown_connections 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 --2- 172.21.15.46:0/3809634200 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c101280 0x7f407c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 --2- 172.21.15.46:0/3809634200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c10e480 0x7f407c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 --2- 172.21.15.46:0/3809634200 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c1008d0 0x7f407c100cb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.660+0000 7f4083549640 1 -- 172.21.15.46:0/3809634200 >> 172.21.15.46:0/3809634200 conn(0x7f407c0fc7a0 msgr2=0x7f407c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 -- 172.21.15.46:0/3809634200 shutdown_connections 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 -- 172.21.15.46:0/3809634200 wait complete. 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 Processor -- start 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 -- start start 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 0x7f407c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c101280 0x7f407c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 0x7f407c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1141b0 con 0x7f407c10e480 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f407c114030 con 0x7f407c1008d0 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.661+0000 7f4083549640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f407c114330 con 0x7f407c101280 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 0x7f407c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f40812e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 0x7f407c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 0x7f407c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55072/0 (socket says 172.21.15.46:55072) 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f40812e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 0x7f407c19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:57462/0 (socket says 172.21.15.46:57462) 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 -- 172.21.15.46:0/1867025917 learned_addr learned my addr 172.21.15.46:0/1867025917 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4080ae4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c101280 0x7f407c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 -- 172.21.15.46:0/1867025917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c101280 msgr2=0x7f407c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c101280 0x7f407c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 -- 172.21.15.46:0/1867025917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 msgr2=0x7f407c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 0x7f407c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 -- 172.21.15.46:0/1867025917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407c19f660 con 0x7f407c10e480 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f40812e5640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 0x7f407c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4081ae6640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 0x7f407c19ef80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f407400ef30 tx=0x7f407400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f40727fc640 1 -- 172.21.15.46:0/1867025917 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004b20 con 0x7f407c10e480 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407c19f950 con 0x7f407c10e480 2024-09-19T09:20:39.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f40727fc640 1 -- 172.21.15.46:0/1867025917 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4074003e50 con 0x7f407c10e480 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407c1a7230 con 0x7f407c10e480 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.662+0000 7f40727fc640 1 -- 172.21.15.46:0/1867025917 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407400b570 con 0x7f407c10e480 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 Processor -- start 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f40727fc640 1 -- 172.21.15.46:0/1867025917 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f407401d020 con 0x7f407c10e480 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 -- start start 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c3b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c3ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451c48760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f451ba12f0 con 0x55f451c46370 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f451b48cf0 con 0x55f451c3b5d0 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4085922740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f451b9d2b0 con 0x55f451c3cb40 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f40812e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c3ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4080ae4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c3b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f40812e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c3ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:57466/0 (socket says 172.21.15.46:57466) 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f40812e5640 1 -- 172.21.15.46:0/3876661112 learned_addr learned my addr 172.21.15.46:0/3876661112 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.666+0000 7f4080ae4640 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451c48760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40812e5640 1 -- 172.21.15.46:0/3876661112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 msgr2=0x55f451c3b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40812e5640 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c3b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40727fc640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40680a32c0 0x7f40680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40812e5640 1 -- 172.21.15.46:0/3876661112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 msgr2=0x55f451c48760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40812e5640 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451c48760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40812e5640 1 -- 172.21.15.46:0/3876661112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f451b2d3a0 con 0x55f451c3b5d0 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40727fc640 1 -- 172.21.15.46:0/1867025917 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f40740cf680 con 0x7f407c10e480 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40812e5640 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c3ba10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f407802a860 tx=0x7f4078009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81aacd03e24a5e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f4081ae6640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40680a32c0 0x7f40680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40677fe640 1 -- 172.21.15.46:0/3876661112 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078037040 con 0x55f451c3b5d0 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40677fe640 1 -- 172.21.15.46:0/3876661112 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4078004230 con 0x55f451c3b5d0 2024-09-19T09:20:39.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.667+0000 7f40677fe640 1 -- 172.21.15.46:0/3876661112 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078003c50 con 0x55f451c3b5d0 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 -- 172.21.15.46:0/3876661112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 msgr2=0x55f451c3ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4081ae6640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40680a32c0 0x7f40680a5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f40740986a0 tx=0x7f40740099a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c3ba10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f407802a860 tx=0x7f4078009510 comp rx=0 tx=0).stop 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 -- 172.21.15.46:0/3876661112 shutdown_connections 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451c48760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c3ba10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 --2- 172.21.15.46:0/3876661112 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c3b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 -- 172.21.15.46:0/3876661112 >> 172.21.15.46:0/3876661112 conn(0x55f451c04310 msgr2=0x55f451c37c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 -- 172.21.15.46:0/3876661112 shutdown_connections 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.668+0000 7f4085922740 1 -- 172.21.15.46:0/3876661112 wait complete. 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 -- start start 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 Processor -- start 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3b5d0 0x55f451c45cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c46370 0x55f451c43520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f451c49010 con 0x55f451c3cb40 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f451b5c060 con 0x55f451c46370 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f451c49190 con 0x55f451c3b5d0 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4085922740 10 client.0 _ll_register_callbacks cb 0x55f4518af8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:39.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f40812e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f40812e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55100/0 (socket says 172.21.15.46:55100) 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4080ae4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c46370 0x55f451c43520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f40812e5640 1 -- 172.21.15.46:0/3235080885 learned_addr learned my addr 172.21.15.46:0/3235080885 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.669+0000 7f4080ae4640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3b5d0 0x55f451c45cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4080ae4640 1 -- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3b5d0 msgr2=0x55f451c45cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4080ae4640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3b5d0 0x55f451c45cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4080ae4640 1 -- 172.21.15.46:0/3235080885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 msgr2=0x55f451c42fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4080ae4640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4080ae4640 1 -- 172.21.15.46:0/3235080885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4519123c0 con 0x55f451c46370 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f40812e5640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4080ae4640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c46370 0x55f451c43520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f406c009fd0 tx=0x7f406c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe0a8e60d61ea34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4064ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:20:39.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4064ff9640 1 -- 172.21.15.46:0/3235080885 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c00fe30 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4078004230 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4064ff9640 1 -- 172.21.15.46:0/3235080885 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f406c022430 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4064ff9640 1 -- 172.21.15.46:0/3235080885 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f406c028030 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4085922740 10 client.25607 fetch_fsmap learned FSMap version 31 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f451c54a90 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.670+0000 7f4064ff9640 1 -- 172.21.15.46:0/3235080885 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4078004230 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4064ff9640 1 -- 172.21.15.46:0/3235080885 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f406c004a70 con 0x55f451c46370 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4085922740 10 client.25607 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4085922740 10 client.25607 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4085922740 20 client.25607 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4085922740 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451c58620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4085922740 4 client.25607 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:39.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f451bae860 con 0x55f451c56230 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f40812e5640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451c58620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f4064ff9640 10 client.25607 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.671+0000 7f40812e5640 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451c58620 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6e9671f173cd3dfd server_cookie=3bfb845e0b711dff in_seq=0 out_seq=0 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4064ff9640 1 -- 172.21.15.46:0/3235080885 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f451bae860 con 0x55f451c56230 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4064ff9640 10 client.25607 handle_command_reply: tid=0 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 client.25607 shutdown 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c46370 msgr2=0x55f451c43520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c46370 0x55f451c43520 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f406c009fd0 tx=0x7f406c004730 comp rx=0 tx=0).stop 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 shutdown_connections 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451c58620 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4064ff9640 0 client.25607 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c46370 0x55f451c43520 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 --2- 172.21.15.46:0/3235080885 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3b5d0 0x55f451c45cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 >> 172.21.15.46:0/3235080885 conn(0x55f451c04310 msgr2=0x55f451c3d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 shutdown_connections 2024-09-19T09:20:39.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 1 -- 172.21.15.46:0/3235080885 wait complete. 2024-09-19T09:20:39.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.672+0000 7f4085922740 20 client.25607 trim_cache size 0 max 16384 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 Processor -- start 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 -- start start 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c37e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c46370 0x55f451c3e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1af7c0 con 0x55f451c3cb40 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1b1390 con 0x55f451c3b5d0 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f4085922740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1afe90 con 0x55f451c46370 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f40812e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f40812e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55106/0 (socket says 172.21.15.46:55106) 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.686+0000 7f40812e5640 1 -- 172.21.15.46:0/2417550531 learned_addr learned my addr 172.21.15.46:0/2417550531 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:39.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f4080ae4640 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c37e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f4080ae4640 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c46370 0x55f451c3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f40812e5640 1 -- 172.21.15.46:0/2417550531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c46370 msgr2=0x55f451c3e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f40812e5640 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c46370 0x55f451c3e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f40812e5640 1 -- 172.21.15.46:0/2417550531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 msgr2=0x55f451c37e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f40812e5640 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c37e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f40812e5640 1 -- 172.21.15.46:0/2417550531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f451c41510 con 0x55f451c3cb40 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f40812e5640 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42860 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4078000c00 tx=0x7f40780058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7681a39c9834228a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f4066ffd640 1 -- 172.21.15.46:0/2417550531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078053070 con 0x55f451c3cb40 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f4066ffd640 1 -- 172.21.15.46:0/2417550531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40780308b0 con 0x55f451c3cb40 2024-09-19T09:20:39.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.687+0000 7f4066ffd640 1 -- 172.21.15.46:0/2417550531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078037040 con 0x55f451c3cb40 2024-09-19T09:20:39.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 -- 172.21.15.46:0/2417550531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 msgr2=0x55f451c42860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42860 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4078000c00 tx=0x7f40780058d0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 -- 172.21.15.46:0/2417550531 shutdown_connections 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c3cb40 0x55f451c42860 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c46370 0x55f451c3e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 --2- 172.21.15.46:0/2417550531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c37e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 -- 172.21.15.46:0/2417550531 >> 172.21.15.46:0/2417550531 conn(0x55f451c04310 msgr2=0x55f451c37700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 -- 172.21.15.46:0/2417550531 shutdown_connections 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 -- 172.21.15.46:0/2417550531 wait complete. 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 -- start start 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.688+0000 7f4085922740 1 Processor -- start 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c58be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c59120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451cbeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1b0c30 con 0x55f451c46370 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1b0560 con 0x55f451c3b5d0 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1ad7a0 con 0x55f451c3cb40 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c59120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4085922740 10 client.0 _ll_register_callbacks cb 0x7f406c011550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4080ae4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c58be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c59120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:55466/0 (socket says 172.21.15.46:55466) 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 -- 172.21.15.46:0/4029983665 learned_addr learned my addr 172.21.15.46:0/4029983665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4080ae4640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451cbeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 -- 172.21.15.46:0/4029983665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 msgr2=0x55f451c58be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c58be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 -- 172.21.15.46:0/4029983665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 msgr2=0x55f451cbeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451cbeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f40812e5640 1 -- 172.21.15.46:0/4029983665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f451cbf0a0 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.689+0000 7f4080ae4640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451cbeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f40812e5640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c59120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4078005e00 tx=0x7f407802a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b0f15dcca8e2f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4064ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4064ff9640 1 -- 172.21.15.46:0/4029983665 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407805c060 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4064ff9640 1 -- 172.21.15.46:0/4029983665 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f407804e400 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40780308b0 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4064ff9640 1 -- 172.21.15.46:0/4029983665 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4078037030 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 10 client.25582 fetch_fsmap learned FSMap version 31 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f451cc03a0 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4064ff9640 1 -- 172.21.15.46:0/4029983665 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40780308b0 con 0x55f451c3cb40 2024-09-19T09:20:39.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4064ff9640 1 -- 172.21.15.46:0/4029983665 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 31) ==== 8374+0+0 (secure 0 0 0) 0x7f4078003d40 con 0x55f451c3cb40 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 10 client.25582 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 10 client.25582 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 20 client.25582 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451cc2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 4 client.25582 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.690+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f451ba8d70 con 0x55f451c56230 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4080ae4640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451cc2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4080ae4640 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451cc2630 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3d163d4089c6781a server_cookie=425ebe632ad0fc4b in_seq=0 out_seq=0 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4064ff9640 10 client.25582 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4064ff9640 1 -- 172.21.15.46:0/4029983665 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f451ba8d70 con 0x55f451c56230 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4064ff9640 10 client.25582 handle_command_reply: tid=0 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 client.25582 shutdown 2024-09-19T09:20:39.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 msgr2=0x55f451c59120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c59120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4078005e00 tx=0x7f407802a340 comp rx=0 tx=0).stop 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 shutdown_connections 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55f451c56230 0x55f451cc2630 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f451c46370 0x55f451cbeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4064ff9640 0 client.25582 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f451c3cb40 0x55f451c59120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 --2- 172.21.15.46:0/4029983665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f451c3b5d0 0x55f451c58be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.691+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 >> 172.21.15.46:0/4029983665 conn(0x55f451c04310 msgr2=0x55f451c44800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 shutdown_connections 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4085922740 1 -- 172.21.15.46:0/4029983665 wait complete. 2024-09-19T09:20:39.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4085922740 20 client.25582 trim_cache size 0 max 16384 2024-09-19T09:20:39.699 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:20:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40680a32c0 msgr2=0x7f40680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4083549640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40680a32c0 0x7f40680a5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f40740986a0 tx=0x7f40740099a0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 msgr2=0x7f407c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.692+0000 7f4083549640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 0x7f407c19ef80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f407400ef30 tx=0x7f407400c800 comp rx=0 tx=0).stop 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 shutdown_connections 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40680a32c0 0x7f40680a5780 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f407c10e480 0x7f407c19ef80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f407c101280 0x7f407c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 --2- 172.21.15.46:0/1867025917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f407c1008d0 0x7f407c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 >> 172.21.15.46:0/1867025917 conn(0x7f407c0fc7a0 msgr2=0x7f407c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 shutdown_connections 2024-09-19T09:20:39.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:39.693+0000 7f4083549640 1 -- 172.21.15.46:0/1867025917 wait complete. 2024-09-19T09:20:40.419 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:20:40.680 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:41.059 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:40 smithi046 ceph-mon[31203]: pgmap v409: 97 pgs: 97 active+clean; 26 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 1008 KiB/s wr, 483 op/s 2024-09-19T09:20:41.059 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:40 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:41.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:40 smithi115 ceph-mon[35055]: pgmap v409: 97 pgs: 97 active+clean; 26 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 1008 KiB/s wr, 483 op/s 2024-09-19T09:20:41.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:40 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:41.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:40 smithi099 ceph-mon[35256]: pgmap v409: 97 pgs: 97 active+clean; 26 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 1008 KiB/s wr, 483 op/s 2024-09-19T09:20:41.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:40 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:41.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 -- 172.21.15.46:0/1406631926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 msgr2=0x7f4df8110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 --2- 172.21.15.46:0/1406631926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df8110900 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009ca0 tx=0x7f4df002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 -- 172.21.15.46:0/1406631926 shutdown_connections 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 --2- 172.21.15.46:0/1406631926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df8110900 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 --2- 172.21.15.46:0/1406631926 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df8101380 0x7f4df810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 --2- 172.21.15.46:0/1406631926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4df81009d0 0x7f4df8100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 -- 172.21.15.46:0/1406631926 >> 172.21.15.46:0/1406631926 conn(0x7f4df80fc7d0 msgr2=0x7f4df80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 -- 172.21.15.46:0/1406631926 shutdown_connections 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.385+0000 7f4dff84c640 1 -- 172.21.15.46:0/1406631926 wait complete. 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 Processor -- start 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 -- start start 2024-09-19T09:20:41.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df81009d0 0x7f4df819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4df8101380 0x7f4df819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4df8114230 con 0x7f4df810e4f0 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81140b0 con 0x7f4df8101380 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dff84c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81143b0 con 0x7f4df81009d0 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dfdde9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dfdde9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55122/0 (socket says 172.21.15.46:55122) 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dfdde9640 1 -- 172.21.15.46:0/4172789389 learned_addr learned my addr 172.21.15.46:0/4172789389 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.386+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4df8101380 0x7f4df819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df81009d0 0x7f4df819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfdde9640 1 -- 172.21.15.46:0/4172789389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df81009d0 msgr2=0x7f4df819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfdde9640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df81009d0 0x7f4df819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfdde9640 1 -- 172.21.15.46:0/4172789389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4df8101380 msgr2=0x7f4df819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfdde9640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4df8101380 0x7f4df819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfdde9640 1 -- 172.21.15.46:0/4172789389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df819f620 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dfdde9640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df819ef40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4df00319f0 tx=0x7f4df0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dee7fc640 1 -- 172.21.15.46:0/4172789389 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0003b70 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df819f8b0 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dee7fc640 1 -- 172.21.15.46:0/4172789389 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df0003d10 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dee7fc640 1 -- 172.21.15.46:0/4172789389 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df002fc40 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.387+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df81a71f0 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.389+0000 7f4dee7fc640 1 -- 172.21.15.46:0/4172789389 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4df0004050 con 0x7f4df810e4f0 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 Processor -- start 2024-09-19T09:20:41.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 -- start start 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d26f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d26fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d27a370 0x56356d27c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56356d1d52f0 con 0x56356d27a370 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56356d17ccf0 con 0x56356d270b40 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4e01c25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56356d1d12b0 con 0x56356d26f5d0 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4dee7fc640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4de40a3240 0x7f4de40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4dfcde7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d26f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4dfcde7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d26f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:57510/0 (socket says 172.21.15.46:57510) 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4dfcde7640 1 -- 172.21.15.46:0/3888368969 learned_addr learned my addr 172.21.15.46:0/3888368969 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d26fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.390+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d27a370 0x56356d27c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfdde9640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4de40a3240 0x7f4de40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dee7fc640 1 -- 172.21.15.46:0/4172789389 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4df00f0a10 con 0x7f4df810e4f0 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfcde7640 1 -- 172.21.15.46:0/3888368969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 msgr2=0x56356d26fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d26fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfcde7640 1 -- 172.21.15.46:0/3888368969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d27a370 msgr2=0x56356d27c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d27a370 0x56356d27c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfcde7640 1 -- 172.21.15.46:0/3888368969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356d1613a0 con 0x56356d270b40 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfdde9640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4de40a3240 0x7f4de40a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005e30 tx=0x7f4df0097040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d26f090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4de8011740 tx=0x7f4de800a6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c0c1b7ecd924e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4de37fe640 1 -- 172.21.15.46:0/3888368969 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8005020 con 0x56356d270b40 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4de37fe640 1 -- 172.21.15.46:0/3888368969 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de80047a0 con 0x56356d270b40 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.391+0000 7f4de37fe640 1 -- 172.21.15.46:0/3888368969 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de800fa20 con 0x56356d270b40 2024-09-19T09:20:41.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 -- 172.21.15.46:0/3888368969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 msgr2=0x56356d26f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d26f090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4de8011740 tx=0x7f4de800a6e0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 -- 172.21.15.46:0/3888368969 shutdown_connections 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d27a370 0x56356d27c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d26fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 --2- 172.21.15.46:0/3888368969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d26f090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 -- 172.21.15.46:0/3888368969 >> 172.21.15.46:0/3888368969 conn(0x56356d238310 msgr2=0x56356d26bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 -- 172.21.15.46:0/3888368969 shutdown_connections 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.392+0000 7f4e01c25740 1 -- 172.21.15.46:0/3888368969 wait complete. 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 -- start start 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 Processor -- start 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d279df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d2770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d2777e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56356d27d070 con 0x56356d26f5d0 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56356d190060 con 0x56356d270b40 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56356d27d1f0 con 0x56356d27a370 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4e01c25740 10 client.0 _ll_register_callbacks cb 0x56356cee38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4dfcde7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d279df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4dfcde7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d279df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55138/0 (socket says 172.21.15.46:55138) 2024-09-19T09:20:41.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.393+0000 7f4dfcde7640 1 -- 172.21.15.46:0/693112430 learned_addr learned my addr 172.21.15.46:0/693112430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d2770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfcde7640 1 -- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 msgr2=0x56356d2777e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d2777e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfcde7640 1 -- 172.21.15.46:0/693112430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 msgr2=0x56356d2770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d2770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfcde7640 1 -- 172.21.15.46:0/693112430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356cf463c0 con 0x56356d26f5d0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d279df0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004db0 tx=0x7f4de800a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5601351efa8996c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4de0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4de0ff9640 1 -- 172.21.15.46:0/693112430 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de8011050 con 0x56356d26f5d0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4de0ff9640 1 -- 172.21.15.46:0/693112430 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4de80111f0 con 0x56356d26f5d0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.394+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de80047a0 con 0x56356d26f5d0 2024-09-19T09:20:41.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4de0ff9640 1 -- 172.21.15.46:0/693112430 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4de800f790 con 0x56356d26f5d0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 10 client.16119 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56356d288ba0 con 0x56356d26f5d0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4de0ff9640 1 -- 172.21.15.46:0/693112430 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de80047a0 con 0x56356d26f5d0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4de0ff9640 1 -- 172.21.15.46:0/693112430 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f4de8025070 con 0x56356d26f5d0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 10 client.16119 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 10 client.16119 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 20 client.16119 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d289ef0 0x56356d28c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 4 client.16119 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.395+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56356d1e2860 con 0x56356d289ef0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.396+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d289ef0 0x56356d28c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.396+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d289ef0 0x56356d28c2e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=112a1dc683698223 server_cookie=e382f56ac7742bca in_seq=0 out_seq=0 2024-09-19T09:20:41.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.396+0000 7f4de0ff9640 10 client.16119 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:20:41.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4de0ff9640 1 -- 172.21.15.46:0/693112430 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56356d1e2860 con 0x56356d289ef0 2024-09-19T09:20:41.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4de0ff9640 10 client.16119 handle_command_reply: tid=0 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 client.16119 shutdown 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 msgr2=0x56356d279df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d279df0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4de8004db0 tx=0x7f4de800a510 comp rx=0 tx=0).stop 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 shutdown_connections 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d289ef0 0x56356d28c2e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d2777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d2770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 --2- 172.21.15.46:0/693112430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d279df0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4de0ff9640 0 client.16119 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.397+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 >> 172.21.15.46:0/693112430 conn(0x56356d238310 msgr2=0x56356d271960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.398+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 shutdown_connections 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.398+0000 7f4e01c25740 1 -- 172.21.15.46:0/693112430 wait complete. 2024-09-19T09:20:41.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.398+0000 7f4e01c25740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T09:20:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 Processor -- start 2024-09-19T09:20:41.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 -- start start 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d286310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d272120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d272660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81af660 con 0x56356d26f5d0 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81b1260 con 0x56356d270b40 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4e01c25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81afd30 con 0x56356d27a370 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4dfcde7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d286310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4dfcde7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d286310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55142/0 (socket says 172.21.15.46:55142) 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4dfcde7640 1 -- 172.21.15.46:0/401760945 learned_addr learned my addr 172.21.15.46:0/401760945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.411+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d272120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d272660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 -- 172.21.15.46:0/401760945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 msgr2=0x56356d272660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d272660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 -- 172.21.15.46:0/401760945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 msgr2=0x56356d272120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d272120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 -- 172.21.15.46:0/401760945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356d277b50 con 0x56356d26f5d0 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d286310 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4de800af10 tx=0x7f4de800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ca7a6f0931eeee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4de2ffd640 1 -- 172.21.15.46:0/401760945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de800a2d0 con 0x56356d26f5d0 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4de2ffd640 1 -- 172.21.15.46:0/401760945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de8015030 con 0x56356d26f5d0 2024-09-19T09:20:41.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.412+0000 7f4de2ffd640 1 -- 172.21.15.46:0/401760945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de800fb90 con 0x56356d26f5d0 2024-09-19T09:20:41.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 -- 172.21.15.46:0/401760945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 msgr2=0x56356d286310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d286310 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4de800af10 tx=0x7f4de800aea0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 -- 172.21.15.46:0/401760945 shutdown_connections 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d27a370 0x56356d272660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d270b40 0x56356d272120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 --2- 172.21.15.46:0/401760945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d26f5d0 0x56356d286310 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 -- 172.21.15.46:0/401760945 >> 172.21.15.46:0/401760945 conn(0x56356d238310 msgr2=0x56356d276190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 -- 172.21.15.46:0/401760945 shutdown_connections 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 -- 172.21.15.46:0/401760945 wait complete. 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 -- start start 2024-09-19T09:20:41.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.413+0000 7f4e01c25740 1 Processor -- start 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d282cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 0x56356d273ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d27a370 0x56356d2744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81b0ad0 con 0x56356d270b40 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81b0400 con 0x56356d27a370 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4df81ad640 con 0x56356d26f5d0 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4e01c25740 10 client.0 _ll_register_callbacks cb 0x7f4de800adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 0x56356d273ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 0x56356d273ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55148/0 (socket says 172.21.15.46:55148) 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 -- 172.21.15.46:0/1580661361 learned_addr learned my addr 172.21.15.46:0/1580661361 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:41.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d27a370 0x56356d2744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d282cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 -- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 msgr2=0x56356d282cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d282cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 -- 172.21.15.46:0/1580661361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d27a370 msgr2=0x56356d2744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d27a370 0x56356d2744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 -- 172.21.15.46:0/1580661361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356d274d10 con 0x56356d270b40 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d282cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4dfd5e8640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 0x56356d273ef0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4df4004700 tx=0x7f4df401f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230b3c60e1257ca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.414+0000 7f4de0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4de0ff9640 1 -- 172.21.15.46:0/1580661361 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df402b060 con 0x56356d270b40 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4de0ff9640 1 -- 172.21.15.46:0/1580661361 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4df40035f0 con 0x56356d270b40 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de8015030 con 0x56356d270b40 2024-09-19T09:20:41.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4de0ff9640 1 -- 172.21.15.46:0/1580661361 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4df4003810 con 0x56356d270b40 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 10 client.16125 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56356d2f4bb0 con 0x56356d270b40 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4de0ff9640 1 -- 172.21.15.46:0/1580661361 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de8015030 con 0x56356d270b40 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4de0ff9640 1 -- 172.21.15.46:0/1580661361 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f4df4025030 con 0x56356d270b40 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 10 client.16125 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 10 client.16125 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 20 client.16125 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d2f5310 0x56356d2f7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 4 client.16125 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.415+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56356d1dcd70 con 0x56356d2f5310 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d2f5310 0x56356d2f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4de0ff9640 10 client.16125 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4dfcde7640 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d2f5310 0x56356d2f7730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a66950887ea9d8d8 server_cookie=b5e1fc7437855eef in_seq=0 out_seq=0 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4de0ff9640 1 -- 172.21.15.46:0/1580661361 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56356d1dcd70 con 0x56356d2f5310 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4de0ff9640 10 client.16125 handle_command_reply: tid=0 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 client.16125 shutdown 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 msgr2=0x56356d273ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 0x56356d273ef0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4df4004700 tx=0x7f4df401f8b0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 shutdown_connections 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x56356d2f5310 0x56356d2f7730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56356d270b40 0x56356d273ef0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56356d27a370 0x56356d2744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 --2- 172.21.15.46:0/1580661361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56356d26f5d0 0x56356d282cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4de0ff9640 0 client.16125 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:20:41.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.416+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 >> 172.21.15.46:0/1580661361 conn(0x56356d238310 msgr2=0x56356d285300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 shutdown_connections 2024-09-19T09:20:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4e01c25740 1 -- 172.21.15.46:0/1580661361 wait complete. 2024-09-19T09:20:41.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4e01c25740 20 client.16125 trim_cache size 0 max 16384 2024-09-19T09:20:41.424 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:20:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4de40a3240 msgr2=0x7f4de40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4de40a3240 0x7f4de40a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005e30 tx=0x7f4df0097040 comp rx=0 tx=0).stop 2024-09-19T09:20:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 msgr2=0x7f4df819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df819ef40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4df00319f0 tx=0x7f4df0031a20 comp rx=0 tx=0).stop 2024-09-19T09:20:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 shutdown_connections 2024-09-19T09:20:41.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4de40a3240 0x7f4de40a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4df810e4f0 0x7f4df819ef40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4df8101380 0x7f4df819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 --2- 172.21.15.46:0/4172789389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4df81009d0 0x7f4df819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 >> 172.21.15.46:0/4172789389 conn(0x7f4df80fc7d0 msgr2=0x7f4df80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.417+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 shutdown_connections 2024-09-19T09:20:41.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:41.418+0000 7f4dff84c640 1 -- 172.21.15.46:0/4172789389 wait complete. 2024-09-19T09:20:42.926 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:20:43.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:42 smithi115 ceph-mon[35055]: pgmap v410: 97 pgs: 97 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 764 op/s 2024-09-19T09:20:43.220 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:43.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:42 smithi046 ceph-mon[31203]: pgmap v410: 97 pgs: 97 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 764 op/s 2024-09-19T09:20:43.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:42 smithi099 ceph-mon[35256]: pgmap v410: 97 pgs: 97 active+clean; 26 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 764 op/s 2024-09-19T09:20:43.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 -- 172.21.15.46:0/2203549965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 msgr2=0x7f3ae01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 --2- 172.21.15.46:0/2203549965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae01029b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad402a480 comp rx=0 tx=0).stop 2024-09-19T09:20:43.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 -- 172.21.15.46:0/2203549965 shutdown_connections 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 --2- 172.21.15.46:0/2203549965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae01029b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 --2- 172.21.15.46:0/2203549965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0102ef0 0x7f3ae010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 --2- 172.21.15.46:0/2203549965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0100e20 0x7f3ae0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 -- 172.21.15.46:0/2203549965 >> 172.21.15.46:0/2203549965 conn(0x7f3ae00fc7d0 msgr2=0x7f3ae00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 -- 172.21.15.46:0/2203549965 shutdown_connections 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 -- 172.21.15.46:0/2203549965 wait complete. 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.707+0000 7f3ae514c640 1 Processor -- start 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 -- start start 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0100e20 0x7f3ae0198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae0198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0102ef0 0x7f3ae019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0110fa0 con 0x7f3ae0102570 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0110e20 con 0x7f3ae0102ef0 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ae514c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0111120 con 0x7f3ae0100e20 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae0198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3aded9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0100e20 0x7f3ae0198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3aded9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0100e20 0x7f3ae0198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:55546/0 (socket says 172.21.15.46:55546) 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3adf59e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0102ef0 0x7f3ae019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3aded9d640 1 -- 172.21.15.46:0/1547532486 learned_addr learned my addr 172.21.15.46:0/1547532486 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae0198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55166/0 (socket says 172.21.15.46:55166) 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3adf59e640 1 -- 172.21.15.46:0/1547532486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0100e20 msgr2=0x7f3ae0198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3adf59e640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0100e20 0x7f3ae0198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3adf59e640 1 -- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 msgr2=0x7f3ae0198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3adf59e640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae0198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.708+0000 7f3adf59e640 1 -- 172.21.15.46:0/1547532486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae019d4f0 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.709+0000 7f3adf59e640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0102ef0 0x7f3ae019ce10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c710 tx=0x7f3ad800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.709+0000 7f3ac7fff640 1 -- 172.21.15.46:0/1547532486 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8004220 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.709+0000 7f3ac7fff640 1 -- 172.21.15.46:0/1547532486 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad800ce20 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.709+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae019d7e0 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.709+0000 7f3ac7fff640 1 -- 172.21.15.46:0/1547532486 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8003e20 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.709+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a50c0 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.711+0000 7f3ac7fff640 1 -- 172.21.15.46:0/1547532486 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ad80079b0 con 0x7f3ae0102ef0 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.711+0000 7f3ae7525740 1 Processor -- start 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 -- start start 2024-09-19T09:20:43.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abe2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abe2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abf3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56474ab482f0 con 0x56474abf1780 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56474aaefcf0 con 0x56474abe25d0 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ae7525740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56474ab442b0 con 0x56474abe3b40 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abf3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abf3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55168/0 (socket says 172.21.15.46:55168) 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 -- 172.21.15.46:0/741654793 learned_addr learned my addr 172.21.15.46:0/741654793 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3aded9d640 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abe2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abe2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ac7fff640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ac80a3240 0x7f3ac80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3adf59e640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ac80a3240 0x7f3ac80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 -- 172.21.15.46:0/741654793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 msgr2=0x56474abe2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abe2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 -- 172.21.15.46:0/741654793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 msgr2=0x56474abe2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abe2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ade59c640 1 -- 172.21.15.46:0/741654793 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474aad43a0 con 0x56474abf1780 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.712+0000 7f3ac7fff640 1 -- 172.21.15.46:0/1547532486 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3ad80cf410 con 0x7f3ae0102ef0 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3ade59c640 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abf3b70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009230 tx=0x7f3ad4005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad042305215e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3ac57fa640 1 -- 172.21.15.46:0/741654793 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4035030 con 0x56474abf1780 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3adf59e640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ac80a3240 0x7f3ac80a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8097f70 tx=0x7f3ad80669f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3ac57fa640 1 -- 172.21.15.46:0/741654793 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad40038c0 con 0x56474abf1780 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3ac57fa640 1 -- 172.21.15.46:0/741654793 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4004920 con 0x56474abf1780 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3ae7525740 1 -- 172.21.15.46:0/741654793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 msgr2=0x56474abf3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.713+0000 7f3ae7525740 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abf3b70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009230 tx=0x7f3ad4005d70 comp rx=0 tx=0).stop 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- 172.21.15.46:0/741654793 shutdown_connections 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abf3b70 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abe2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 --2- 172.21.15.46:0/741654793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abe2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- 172.21.15.46:0/741654793 >> 172.21.15.46:0/741654793 conn(0x56474abab310 msgr2=0x56474abdec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- 172.21.15.46:0/741654793 shutdown_connections 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- 172.21.15.46:0/741654793 wait complete. 2024-09-19T09:20:43.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- start start 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 Processor -- start 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abf1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56474abf4420 con 0x56474abf1780 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56474ab03060 con 0x56474abe25d0 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56474abf45a0 con 0x56474abe3b40 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ae7525740 10 client.0 _ll_register_callbacks cb 0x56474a8568c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.714+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abf1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abf1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:57588/0 (socket says 172.21.15.46:57588) 2024-09-19T09:20:43.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 -- 172.21.15.46:0/2719149066 learned_addr learned my addr 172.21.15.46:0/2719149066 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3aded9d640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 -- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 msgr2=0x56474abee3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abee3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 -- 172.21.15.46:0/2719149066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 msgr2=0x56474abee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abee9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 -- 172.21.15.46:0/2719149066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474a8b93c0 con 0x56474abe25d0 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3aded9d640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abee3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:43.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ade59c640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abf1140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a06110608772cf18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ac2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/2719149066 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4035040 con 0x56474abe25d0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad40038c0 con 0x56474abe25d0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.715+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/2719149066 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3ad4031800 con 0x56474abe25d0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/2719149066 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3ad4031a00 con 0x56474abe25d0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 10 client.25643 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56474abffeb0 con 0x56474abe25d0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/2719149066 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad40038c0 con 0x56474abe25d0 2024-09-19T09:20:43.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/2719149066 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f3ad403dc30 con 0x56474abe25d0 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 10 client.25643 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 10 client.25643 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 20 client.25643 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac01200 0x56474ac035f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 4 client.25643 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56474ab55860 con 0x56474ac01200 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.716+0000 7f3aded9d640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac01200 0x56474ac035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3aded9d640 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac01200 0x56474ac035f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a90e5ceeb7b7a30a server_cookie=18a3dc90793c0e32 in_seq=0 out_seq=0 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ac2ff5640 10 client.25643 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/2719149066 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56474ab55860 con 0x56474ac01200 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ac2ff5640 10 client.25643 handle_command_reply: tid=0 2024-09-19T09:20:43.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ae7525740 1 client.25643 shutdown 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 msgr2=0x56474abf1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ae7525740 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abf1140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad4009260 comp rx=0 tx=0).stop 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 shutdown_connections 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ae7525740 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac01200 0x56474ac035f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.717+0000 7f3ae7525740 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abf1780 0x56474abee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ac2ff5640 0 client.25643 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ae7525740 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe3b40 0x56474abee3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ae7525740 1 --2- 172.21.15.46:0/2719149066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe25d0 0x56474abf1140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 >> 172.21.15.46:0/2719149066 conn(0x56474abab310 msgr2=0x56474abe4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 shutdown_connections 2024-09-19T09:20:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ae7525740 1 -- 172.21.15.46:0/2719149066 wait complete. 2024-09-19T09:20:43.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.718+0000 7f3ae7525740 20 client.25643 trim_cache size 0 max 16384 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.731+0000 7f3ae7525740 1 Processor -- start 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.731+0000 7f3ae7525740 1 -- start start 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe25d0 0x56474abedcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 0x56474abed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abf1780 0x56474ac06610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ae7525740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01ab350 con 0x56474abe3b40 2024-09-19T09:20:43.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ae7525740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01acf50 con 0x56474abf1780 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ae7525740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01aba20 con 0x56474abe25d0 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 0x56474abed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 0x56474abed2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55192/0 (socket says 172.21.15.46:55192) 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 -- 172.21.15.46:0/1765266816 learned_addr learned my addr 172.21.15.46:0/1765266816 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ade59c640 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abf1780 0x56474ac06610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ade59c640 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe25d0 0x56474abedcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 -- 172.21.15.46:0/1765266816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe25d0 msgr2=0x56474abedcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe25d0 0x56474abedcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 -- 172.21.15.46:0/1765266816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abf1780 msgr2=0x56474ac06610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abf1780 0x56474ac06610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 -- 172.21.15.46:0/1765266816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474abf0d60 con 0x56474abe3b40 2024-09-19T09:20:43.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ade59c640 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe25d0 0x56474abedcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3aded9d640 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 0x56474abed2c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000f80 tx=0x7f3ad0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71250632a71a4c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.732+0000 7f3ac4ff9640 1 -- 172.21.15.46:0/1765266816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0003c30 con 0x56474abe3b40 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ac4ff9640 1 -- 172.21.15.46:0/1765266816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad0003dd0 con 0x56474abe3b40 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ac4ff9640 1 -- 172.21.15.46:0/1765266816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad001e420 con 0x56474abe3b40 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 -- 172.21.15.46:0/1765266816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 msgr2=0x56474abed2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 0x56474abed2c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0000f80 tx=0x7f3ad0009500 comp rx=0 tx=0).stop 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 -- 172.21.15.46:0/1765266816 shutdown_connections 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe3b40 0x56474abed2c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abf1780 0x56474ac06610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 --2- 172.21.15.46:0/1765266816 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abe25d0 0x56474abedcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 -- 172.21.15.46:0/1765266816 >> 172.21.15.46:0/1765266816 conn(0x56474abab310 msgr2=0x56474abecbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 -- 172.21.15.46:0/1765266816 shutdown_connections 2024-09-19T09:20:43.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.733+0000 7f3ae7525740 1 -- 172.21.15.46:0/1765266816 wait complete. 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 -- start start 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 Processor -- start 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 0x56474ac03d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe3b40 0x56474ac042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abf1780 0x56474ac63b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01ac7c0 con 0x56474abe25d0 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01ac0f0 con 0x56474abe3b40 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01a9330 con 0x56474abf1780 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ae7525740 10 client.0 _ll_register_callbacks cb 0x7f3ad4004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 0x56474ac03d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3aded9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe3b40 0x56474ac042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ade59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 0x56474ac03d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55194/0 (socket says 172.21.15.46:55194) 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ade59c640 1 -- 172.21.15.46:0/3142697448 learned_addr learned my addr 172.21.15.46:0/3142697448 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3ade59c640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abf1780 0x56474ac63b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3aded9d640 1 -- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abf1780 msgr2=0x56474ac63b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3aded9d640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abf1780 0x56474ac63b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3aded9d640 1 -- 172.21.15.46:0/3142697448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 msgr2=0x56474ac03d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.734+0000 7f3aded9d640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 0x56474ac03d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3aded9d640 1 -- 172.21.15.46:0/3142697448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474ac641a0 con 0x56474abe3b40 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ade59c640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 0x56474ac03d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3aded9d640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe3b40 0x56474ac042d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0010680 tx=0x7f3ad0011820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d3300858a1a6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ac2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/3142697448 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0004860 con 0x56474abe3b40 2024-09-19T09:20:43.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/3142697448 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f3ad0004050 con 0x56474abe3b40 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ad0003dd0 con 0x56474abe3b40 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/3142697448 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f3ad0037050 con 0x56474abe3b40 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ae7525740 10 client.25649 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56474ac6b570 con 0x56474abe3b40 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.735+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/3142697448 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad0003dd0 con 0x56474abe3b40 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/3142697448 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f3ad001e990 con 0x56474abe3b40 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 10 client.25649 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 10 client.25649 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 20 client.25649 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac6bb80 0x56474ac6df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 4 client.25649 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:20:43.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56474ab4fd70 con 0x56474ac6bb80 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ade59c640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac6bb80 0x56474ac6df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ac2ff5640 10 client.25649 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ade59c640 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac6bb80 0x56474ac6df70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0a7e01e5838d4a7 server_cookie=195ca3e03ca39c10 in_seq=0 out_seq=0 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ac2ff5640 1 -- 172.21.15.46:0/3142697448 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56474ab4fd70 con 0x56474ac6bb80 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ac2ff5640 10 client.25649 handle_command_reply: tid=0 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 1 client.25649 shutdown 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe3b40 msgr2=0x56474ac042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.736+0000 7f3ae7525740 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe3b40 0x56474ac042d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0010680 tx=0x7f3ad0011820 comp rx=0 tx=0).stop 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 shutdown_connections 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x56474ac6bb80 0x56474ac6df70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56474abf1780 0x56474ac63b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56474abe3b40 0x56474ac042d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ac2ff5640 0 client.25649 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 --2- 172.21.15.46:0/3142697448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56474abe25d0 0x56474ac03d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 >> 172.21.15.46:0/3142697448 conn(0x56474abab310 msgr2=0x56474abddd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 shutdown_connections 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 1 -- 172.21.15.46:0/3142697448 wait complete. 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae7525740 20 client.25649 trim_cache size 0 max 16384 2024-09-19T09:20:43.751 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ac80a3240 msgr2=0x7f3ac80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ac80a3240 0x7f3ac80a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8097f70 tx=0x7f3ad80669f0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0102ef0 msgr2=0x7f3ae019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0102ef0 0x7f3ae019ce10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800c710 tx=0x7f3ad800cbd0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 shutdown_connections 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3ac80a3240 0x7f3ac80a5700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3ae0102570 0x7f3ae0198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ae0102ef0 0x7f3ae019ce10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 --2- 172.21.15.46:0/1547532486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ae0100e20 0x7f3ae0198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 >> 172.21.15.46:0/1547532486 conn(0x7f3ae00fc7d0 msgr2=0x7f3ae006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 shutdown_connections 2024-09-19T09:20:43.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:43.737+0000 7f3ae514c640 1 -- 172.21.15.46:0/1547532486 wait complete. 2024-09-19T09:20:44.442 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:20:44.704 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:45.084 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:44 smithi046 ceph-mon[31203]: pgmap v411: 97 pgs: 97 active+clean; 37 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 893 op/s 2024-09-19T09:20:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 -- 172.21.15.46:0/1406607303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0868101280 msgr2=0x7f086810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 --2- 172.21.15.46:0/1406607303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0868101280 0x7f086810df40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0858009900 tx=0x7f085802a410 comp rx=0 tx=0).stop 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 -- 172.21.15.46:0/1406607303 shutdown_connections 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 --2- 172.21.15.46:0/1406607303 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0868101280 0x7f086810df40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 --2- 172.21.15.46:0/1406607303 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f086810e480 0x7f0868110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 --2- 172.21.15.46:0/1406607303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08681008d0 0x7f0868100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 -- 172.21.15.46:0/1406607303 >> 172.21.15.46:0/1406607303 conn(0x7f08680fc7a0 msgr2=0x7f08680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 -- 172.21.15.46:0/1406607303 shutdown_connections 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.170+0000 7f086f3e2640 1 -- 172.21.15.46:0/1406607303 wait complete. 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 Processor -- start 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 -- start start 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 0x7f086819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868101280 0x7f086819ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086810e480 0x7f086819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f08681141a0 con 0x7f08681008d0 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0868114020 con 0x7f086810e480 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086f3e2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0868114320 con 0x7f0868101280 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 0x7f086819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 0x7f086819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55220/0 (socket says 172.21.15.46:55220) 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 -- 172.21.15.46:0/740431608 learned_addr learned my addr 172.21.15.46:0/740431608 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d97f640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086810e480 0x7f086819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086c97d640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868101280 0x7f086819ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 -- 172.21.15.46:0/740431608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868101280 msgr2=0x7f086819ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868101280 0x7f086819ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 -- 172.21.15.46:0/740431608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086810e480 msgr2=0x7f086819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086810e480 0x7f086819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 -- 172.21.15.46:0/740431608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086819f6d0 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.171+0000 7f086d17e640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 0x7f086819a720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f086400ea60 tx=0x7f086400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.172+0000 7f085e7fc640 1 -- 172.21.15.46:0/740431608 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f086400cde0 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.172+0000 7f085e7fc640 1 -- 172.21.15.46:0/740431608 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08640035f0 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.172+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f086819f9c0 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.172+0000 7f085e7fc640 1 -- 172.21.15.46:0/740431608 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0864010670 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.172+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08681a72a0 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.174+0000 7f085e7fc640 1 -- 172.21.15.46:0/740431608 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f08640037a0 con 0x7f08681008d0 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.174+0000 7f08717bb740 1 Processor -- start 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.174+0000 7f08717bb740 1 -- start start 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f08717bb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 0x5608c578b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f08717bb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c578ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f08717bb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c5796370 0x5608c5798760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f08717bb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5608c56f12f0 con 0x5608c578cb40 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f08717bb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5608c5698cf0 con 0x5608c5796370 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f08717bb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5608c56ed2b0 con 0x5608c578b5d0 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 0x5608c578b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f085e7fc640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f08540a3240 0x7f08540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 0x5608c578b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55232/0 (socket says 172.21.15.46:55232) 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 -- 172.21.15.46:0/2196234836 learned_addr learned my addr 172.21.15.46:0/2196234836 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086c97d640 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c5796370 0x5608c5798760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d17e640 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c578ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f08540a3240 0x7f08540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f085e7fc640 1 -- 172.21.15.46:0/740431608 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f08640cfb90 con 0x7f08681008d0 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 -- 172.21.15.46:0/2196234836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 msgr2=0x5608c578ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c578ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 -- 172.21.15.46:0/2196234836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c5796370 msgr2=0x5608c5798760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c5796370 0x5608c5798760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.175+0000 7f086d97f640 1 -- 172.21.15.46:0/2196234836 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c567d3a0 con 0x5608c578cb40 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.176+0000 7f086d97f640 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 0x5608c578b090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f08600049d0 tx=0x7f0860014eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a5f670b7162029 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.176+0000 7f086d97f640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f08540a3240 0x7f08540a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0860012760 tx=0x7f0860026000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.176+0000 7f08537fe640 1 -- 172.21.15.46:0/2196234836 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860004b20 con 0x5608c578cb40 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.176+0000 7f08537fe640 1 -- 172.21.15.46:0/2196234836 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860004cc0 con 0x5608c578cb40 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.176+0000 7f08537fe640 1 -- 172.21.15.46:0/2196234836 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860005290 con 0x5608c578cb40 2024-09-19T09:20:45.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 -- 172.21.15.46:0/2196234836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 msgr2=0x5608c578b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 0x5608c578b090 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f08600049d0 tx=0x7f0860014eb0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 -- 172.21.15.46:0/2196234836 shutdown_connections 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c5796370 0x5608c5798760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c578ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 --2- 172.21.15.46:0/2196234836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578cb40 0x5608c578b090 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 -- 172.21.15.46:0/2196234836 >> 172.21.15.46:0/2196234836 conn(0x5608c5754310 msgr2=0x5608c5787c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 -- 172.21.15.46:0/2196234836 shutdown_connections 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 -- 172.21.15.46:0/2196234836 wait complete. 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 -- start start 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.177+0000 7f08717bb740 1 Processor -- start 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c5795d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c5793090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5608c5798fb0 con 0x5608c5796370 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5608c56ac060 con 0x5608c578cb40 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5608c5799130 con 0x5608c578b5d0 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f08717bb740 10 client.0 _ll_register_callbacks cb 0x5608c53ff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086d97f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c5793090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086d97f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55234/0 (socket says 172.21.15.46:55234) 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c5793090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:57638/0 (socket says 172.21.15.46:57638) 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086d97f640 1 -- 172.21.15.46:0/3302091403 learned_addr learned my addr 172.21.15.46:0/3302091403 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086d17e640 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c5795d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 -- 172.21.15.46:0/3302091403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 msgr2=0x5608c5795d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c5795d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 -- 172.21.15.46:0/3302091403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 msgr2=0x5608c57936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 -- 172.21.15.46:0/3302091403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c54623c0 con 0x5608c578cb40 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f086c97d640 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c5793090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0858005940 tx=0x7f0858031850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e64c9effc79e8db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.178+0000 7f0850ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f0850ff9640 1 -- 172.21.15.46:0/3302091403 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858035040 con 0x5608c578cb40 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f0850ff9640 1 -- 172.21.15.46:0/3302091403 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0858004240 con 0x5608c578cb40 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0860004cc0 con 0x5608c578cb40 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f0850ff9640 1 -- 172.21.15.46:0/3302091403 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f085804d070 con 0x5608c578cb40 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 10 client.25661 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5608c57a4ac0 con 0x5608c578cb40 2024-09-19T09:20:45.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f0850ff9640 1 -- 172.21.15.46:0/3302091403 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860004cc0 con 0x5608c578cb40 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f0850ff9640 1 -- 172.21.15.46:0/3302091403 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f08580465a0 con 0x5608c578cb40 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 10 client.25661 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 10 client.25661 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 20 client.25661 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c57a6020 0x5608c57a8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 4 client.25661 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608c56fe860 con 0x5608c57a6020 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.179+0000 7f086d17e640 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c57a6020 0x5608c57a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.180+0000 7f0850ff9640 10 client.25661 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.180+0000 7f086d17e640 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c57a6020 0x5608c57a8430 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47f57ee6ece8342f server_cookie=ff49e8119d222334 in_seq=0 out_seq=0 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f0850ff9640 1 -- 172.21.15.46:0/3302091403 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608c56fe860 con 0x5608c57a6020 2024-09-19T09:20:45.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f0850ff9640 10 client.25661 handle_command_reply: tid=0 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 client.25661 shutdown 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 msgr2=0x5608c5793090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c5793090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0858005940 tx=0x7f0858031850 comp rx=0 tx=0).stop 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 shutdown_connections 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c57a6020 0x5608c57a8430 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c5793090 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 --2- 172.21.15.46:0/3302091403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578b5d0 0x5608c5795d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 >> 172.21.15.46:0/3302091403 conn(0x5608c5754310 msgr2=0x5608c578d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f0850ff9640 0 client.25661 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 shutdown_connections 2024-09-19T09:20:45.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 1 -- 172.21.15.46:0/3302091403 wait complete. 2024-09-19T09:20:45.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.182+0000 7f08717bb740 20 client.25661 trim_cache size 0 max 16384 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 Processor -- start 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 -- start start 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578b5d0 0x5608c57a2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578cb40 0x5608c57add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f08681ab2b0 con 0x5608c5796370 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f08681aceb0 con 0x5608c578b5d0 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f08717bb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08681ab980 con 0x5608c578cb40 2024-09-19T09:20:45.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f086d97f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f086d97f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55248/0 (socket says 172.21.15.46:55248) 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f086d97f640 1 -- 172.21.15.46:0/840909831 learned_addr learned my addr 172.21.15.46:0/840909831 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f086d17e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578b5d0 0x5608c57a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.196+0000 7f086c97d640 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578cb40 0x5608c57add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086d97f640 1 -- 172.21.15.46:0/840909831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578cb40 msgr2=0x5608c57add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086d97f640 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578cb40 0x5608c57add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086d97f640 1 -- 172.21.15.46:0/840909831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578b5d0 msgr2=0x5608c57a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086d97f640 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578b5d0 0x5608c57a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086d97f640 1 -- 172.21.15.46:0/840909831 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c57a8ab0 con 0x5608c5796370 2024-09-19T09:20:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086c97d640 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578cb40 0x5608c57add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f086d97f640 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57ae240 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f086002a040 tx=0x7f0860005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1665734f63555c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f0852ffd640 1 -- 172.21.15.46:0/840909831 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860004a90 con 0x5608c5796370 2024-09-19T09:20:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f0852ffd640 1 -- 172.21.15.46:0/840909831 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860004c30 con 0x5608c5796370 2024-09-19T09:20:45.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.197+0000 7f0852ffd640 1 -- 172.21.15.46:0/840909831 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860031610 con 0x5608c5796370 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 -- 172.21.15.46:0/840909831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 msgr2=0x5608c57ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57ae240 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f086002a040 tx=0x7f0860005fd0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 -- 172.21.15.46:0/840909831 shutdown_connections 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c5796370 0x5608c57ae240 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c578cb40 0x5608c57add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 --2- 172.21.15.46:0/840909831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578b5d0 0x5608c57a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 -- 172.21.15.46:0/840909831 >> 172.21.15.46:0/840909831 conn(0x5608c5754310 msgr2=0x5608c5792180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 -- 172.21.15.46:0/840909831 shutdown_connections 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 -- 172.21.15.46:0/840909831 wait complete. 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 -- start start 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.198+0000 7f08717bb740 1 Processor -- start 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 0x5608c5790190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c57906d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c5796370 0x5608c5790c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f08681ac720 con 0x5608c578b5d0 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f08681ac050 con 0x5608c578cb40 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08681a9290 con 0x5608c5796370 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f08717bb740 10 client.0 _ll_register_callbacks cb 0x7f0858005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:45.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 0x5608c5790190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 0x5608c5790190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55264/0 (socket says 172.21.15.46:55264) 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 -- 172.21.15.46:0/598107049 learned_addr learned my addr 172.21.15.46:0/598107049 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086c97d640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c57906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d97f640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c5796370 0x5608c5790c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 -- 172.21.15.46:0/598107049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c5796370 msgr2=0x5608c5790c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c5796370 0x5608c5790c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 -- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 msgr2=0x5608c57906d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c57906d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 -- 172.21.15.46:0/598107049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c580fdd0 con 0x5608c578b5d0 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086c97d640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c57906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:45.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f086d17e640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 0x5608c5790190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f086409bee0 tx=0x7f086400a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1599a5dfde4bea8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.199+0000 7f0850ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f0850ff9640 1 -- 172.21.15.46:0/598107049 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08640a0590 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f0850ff9640 1 -- 172.21.15.46:0/598107049 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f0864003b30 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0860004c30 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f0850ff9640 1 -- 172.21.15.46:0/598107049 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f08640a4e50 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 10 client.16161 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5608c58110b0 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f0850ff9640 1 -- 172.21.15.46:0/598107049 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0860004c30 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f0850ff9640 1 -- 172.21.15.46:0/598107049 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f08640a0160 con 0x5608c578b5d0 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 10 client.16161 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:45.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 20 client.16161 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c5811760 0x5608c5813b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 4 client.16161 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:20:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5608c56f8d70 con 0x5608c5811760 2024-09-19T09:20:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.200+0000 7f086c97d640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c5811760 0x5608c5813b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.201+0000 7f086c97d640 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c5811760 0x5608c5813b80 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec913c03b3b4e84e server_cookie=c747c85e564b6212 in_seq=0 out_seq=0 2024-09-19T09:20:45.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.201+0000 7f0850ff9640 10 client.16161 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.204+0000 7f0850ff9640 1 -- 172.21.15.46:0/598107049 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5608c56f8d70 con 0x5608c5811760 2024-09-19T09:20:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.204+0000 7f0850ff9640 10 client.16161 handle_command_reply: tid=0 2024-09-19T09:20:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.204+0000 7f08717bb740 1 client.16161 shutdown 2024-09-19T09:20:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 msgr2=0x5608c5790190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 0x5608c5790190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f086409bee0 tx=0x7f086400a5e0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 shutdown_connections 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608c5811760 0x5608c5813b80 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608c5796370 0x5608c5790c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608c578cb40 0x5608c57906d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 --2- 172.21.15.46:0/598107049 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608c578b5d0 0x5608c5790190 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f0850ff9640 0 client.16161 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 >> 172.21.15.46:0/598107049 conn(0x5608c5754310 msgr2=0x5608c57864e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 shutdown_connections 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 1 -- 172.21.15.46:0/598107049 wait complete. 2024-09-19T09:20:45.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f08717bb740 20 client.16161 trim_cache size 0 max 16384 2024-09-19T09:20:45.211 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:20:45.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f08540a3240 msgr2=0x7f08540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f086f3e2640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f08540a3240 0x7f08540a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0860012760 tx=0x7f0860026000 comp rx=0 tx=0).stop 2024-09-19T09:20:45.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 msgr2=0x7f086819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:45.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.205+0000 7f086f3e2640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 0x7f086819a720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f086400ea60 tx=0x7f086400ef20 comp rx=0 tx=0).stop 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 shutdown_connections 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f08540a3240 0x7f08540a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086810e480 0x7f086819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0868101280 0x7f086819ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 --2- 172.21.15.46:0/740431608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08681008d0 0x7f086819a720 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 >> 172.21.15.46:0/740431608 conn(0x7f08680fc7a0 msgr2=0x7f08680feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 shutdown_connections 2024-09-19T09:20:45.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:45.206+0000 7f086f3e2640 1 -- 172.21.15.46:0/740431608 wait complete. 2024-09-19T09:20:45.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:44 smithi115 ceph-mon[35055]: pgmap v411: 97 pgs: 97 active+clean; 37 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 893 op/s 2024-09-19T09:20:45.223 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '0e5c12dfd008efc2848c98108c9237487e91ef35'. 2024-09-19T09:20:45.223 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.224 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-09-19T09:20:45.225 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.225 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:20:45.225 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-19T09:20:45.225 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 0e5c12df xfs/522: use reflink instead of crc as test feature 2024-09-19T09:20:45.233 INFO:tasks.workunit.client.0.smithi046.stderr:+ make -j4 2024-09-19T09:20:45.244 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize -cfi 2024-09-19T09:20:45.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:44 smithi099 ceph-mon[35256]: pgmap v411: 97 pgs: 97 active+clean; 37 MiB data, 491 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 893 op/s 2024-09-19T09:20:46.271 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: putting auxiliary files in '.'. 2024-09-19T09:20:46.272 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './config.guess' 2024-09-19T09:20:46.276 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './config.sub' 2024-09-19T09:20:46.281 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './install-sh' 2024-09-19T09:20:46.287 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file './ltmain.sh' 2024-09-19T09:20:46.316 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-09-19T09:20:46.316 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-09-19T09:20:46.321 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-09-19T09:20:46.327 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-09-19T09:20:46.333 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-09-19T09:20:46.339 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-09-19T09:20:46.345 INFO:tasks.workunit.client.0.smithi046.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-09-19T09:20:46.346 INFO:tasks.workunit.client.0.smithi046.stdout:cp include/install-sh . 2024-09-19T09:20:46.356 INFO:tasks.workunit.client.0.smithi046.stdout:aclocal -I m4 2024-09-19T09:20:47.198 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:20:47.198 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:20:47.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:46 smithi115 ceph-mon[35055]: pgmap v412: 97 pgs: 97 active+clean; 41 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 917 op/s 2024-09-19T09:20:47.221 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:46 smithi046 ceph-mon[31203]: pgmap v412: 97 pgs: 97 active+clean; 41 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 917 op/s 2024-09-19T09:20:47.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:46 smithi099 ceph-mon[35256]: pgmap v412: 97 pgs: 97 active+clean; 41 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 917 op/s 2024-09-19T09:20:47.466 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:47.559 INFO:tasks.workunit.client.0.smithi046.stdout:autoheader 2024-09-19T09:20:47.903 INFO:tasks.workunit.client.0.smithi046.stdout:autoconf 2024-09-19T09:20:48.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1568042705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 msgr2=0x7fcd30103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1568042705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd30103110 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009930 tx=0x7fcd2c02a420 comp rx=0 tx=0).stop 2024-09-19T09:20:48.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1568042705 shutdown_connections 2024-09-19T09:20:48.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1568042705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd301082a0 0x7fcd3010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1568042705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd301036e0 0x7fcd30107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1568042705 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd30103110 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1568042705 >> 172.21.15.46:0/1568042705 conn(0x7fcd300fc7d0 msgr2=0x7fcd300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1568042705 shutdown_connections 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.054+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1568042705 wait complete. 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 Processor -- start 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 -- start start 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd301985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd301036e0 0x7fcd30198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd301082a0 0x7fcd3019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301120a0 con 0x7fcd30102d30 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30111f20 con 0x7fcd301036e0 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd37bf9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcd30112220 con 0x7fcd301082a0 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd35995640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd301985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd35995640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd301985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55288/0 (socket says 172.21.15.46:55288) 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd35995640 1 -- 172.21.15.46:0/1655802711 learned_addr learned my addr 172.21.15.46:0/1655802711 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.055+0000 7fcd35194640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd301036e0 0x7fcd30198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd36196640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd301082a0 0x7fcd3019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd35995640 1 -- 172.21.15.46:0/1655802711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd301082a0 msgr2=0x7fcd3019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd35995640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd301082a0 0x7fcd3019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd35995640 1 -- 172.21.15.46:0/1655802711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd301036e0 msgr2=0x7fcd30198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd35995640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd301036e0 0x7fcd30198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd35995640 1 -- 172.21.15.46:0/1655802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3019d570 con 0x7fcd30102d30 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd35995640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd301985c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009230 tx=0x7fcd2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd26ffd640 1 -- 172.21.15.46:0/1655802711 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c03f030 con 0x7fcd30102d30 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3019d800 con 0x7fcd30102d30 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd26ffd640 1 -- 172.21.15.46:0/1655802711 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2c003ad0 con 0x7fcd30102d30 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd26ffd640 1 -- 172.21.15.46:0/1655802711 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c035070 con 0x7fcd30102d30 2024-09-19T09:20:48.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.056+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd301a5140 con 0x7fcd30102d30 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.059+0000 7fcd26ffd640 1 -- 172.21.15.46:0/1655802711 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcd2c042030 con 0x7fcd30102d30 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.059+0000 7fcd39fd2740 1 Processor -- start 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.059+0000 7fcd39fd2740 1 -- start start 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.059+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d93d9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.059+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.059+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93e9150 0x5651d93eb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5651d933f280 con 0x5651d93da340 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5651d92e6b10 con 0x5651d93e9150 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5651d933b240 con 0x5651d93d9a20 2024-09-19T09:20:48.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35995640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93e9150 0x5651d93eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35995640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55300/0 (socket says 172.21.15.46:55300) 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35995640 1 -- 172.21.15.46:0/784741283 learned_addr learned my addr 172.21.15.46:0/784741283 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd36196640 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d93d9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd26ffd640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcd1c0a3240 0x7fcd1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 -- 172.21.15.46:0/784741283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 msgr2=0x5651d93d9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d93d9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 -- 172.21.15.46:0/784741283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 msgr2=0x5651d93e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 -- 172.21.15.46:0/784741283 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d92f31f0 con 0x5651d93e9150 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd26ffd640 1 -- 172.21.15.46:0/1655802711 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd2c0efa70 con 0x7fcd30102d30 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd36196640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcd1c0a3240 0x7fcd1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.060+0000 7fcd35194640 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93e9150 0x5651d93eb540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd200058c0 tx=0x7fcd2000f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9521a0c9513befd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd1bfff640 1 -- 172.21.15.46:0/784741283 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20004020 con 0x5651d93e9150 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd1bfff640 1 -- 172.21.15.46:0/784741283 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd200041c0 con 0x5651d93e9150 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd1bfff640 1 -- 172.21.15.46:0/784741283 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20018770 con 0x5651d93e9150 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 -- 172.21.15.46:0/784741283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93e9150 msgr2=0x5651d93eb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd36196640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcd1c0a3240 0x7fcd1c0a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005fd0 tx=0x7fcd28004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93e9150 0x5651d93eb540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcd200058c0 tx=0x7fcd2000f3c0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 -- 172.21.15.46:0/784741283 shutdown_connections 2024-09-19T09:20:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93e9150 0x5651d93eb540 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/784741283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d93d9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 -- 172.21.15.46:0/784741283 >> 172.21.15.46:0/784741283 conn(0x5651d93d60f0 msgr2=0x5651d93d64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 -- 172.21.15.46:0/784741283 shutdown_connections 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.061+0000 7fcd39fd2740 1 -- 172.21.15.46:0/784741283 wait complete. 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 -- start start 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 Processor -- start 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d93e6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5651d93ebd20 con 0x5651d93da340 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5651d92f9f10 con 0x5651d93d9a20 2024-09-19T09:20:48.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5651d93ebea0 con 0x5651d93e9150 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd39fd2740 10 client.0 _ll_register_callbacks cb 0x5651d92c2a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.062+0000 7fcd35194640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55312/0 (socket says 172.21.15.46:55312) 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 -- 172.21.15.46:0/960627037 learned_addr learned my addr 172.21.15.46:0/960627037 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35995640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d93e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd36196640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 -- 172.21.15.46:0/960627037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 msgr2=0x5651d93e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 -- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 msgr2=0x5651d93e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d93e6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 -- 172.21.15.46:0/960627037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d90b06a0 con 0x5651d93da340 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd36196640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd35194640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e6590 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcd20003ee0 tx=0x7fcd20005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5b01bf4e3548af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd197fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd197fa640 1 -- 172.21.15.46:0/960627037 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20027020 con 0x5651d93da340 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd197fa640 1 -- 172.21.15.46:0/960627037 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd20004370 con 0x5651d93da340 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd200041c0 con 0x5651d93da340 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd197fa640 1 -- 172.21.15.46:0/960627037 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcd2000fe50 con 0x5651d93da340 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd39fd2740 10 client.16173 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:48.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.063+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5651d93f7990 con 0x5651d93da340 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd197fa640 1 -- 172.21.15.46:0/960627037 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd200041c0 con 0x5651d93da340 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd197fa640 1 -- 172.21.15.46:0/960627037 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fcd20004a50 con 0x5651d93da340 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd39fd2740 10 client.16173 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd39fd2740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd39fd2740 20 client.16173 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d93f8d90 0x5651d93fb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd39fd2740 4 client.16173 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651d934c7f0 con 0x5651d93f8d90 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.064+0000 7fcd35995640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d93f8d90 0x5651d93fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.065+0000 7fcd197fa640 10 client.16173 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.065+0000 7fcd35995640 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d93f8d90 0x5651d93fb180 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a48e5d406afa08c server_cookie=dbd42bea1dd12344 in_seq=0 out_seq=0 2024-09-19T09:20:48.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.065+0000 7fcd197fa640 1 -- 172.21.15.46:0/960627037 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651d934c7f0 con 0x5651d93f8d90 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.065+0000 7fcd197fa640 10 client.16173 handle_command_reply: tid=0 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.065+0000 7fcd39fd2740 1 client.16173 shutdown 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 msgr2=0x5651d93e6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e6590 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fcd20003ee0 tx=0x7fcd20005740 comp rx=0 tx=0).stop 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 shutdown_connections 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d93f8d90 0x5651d93fb180 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d93e6590 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/960627037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d93e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 >> 172.21.15.46:0/960627037 conn(0x5651d93d60f0 msgr2=0x5651d93dbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd197fa640 0 client.16173 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 shutdown_connections 2024-09-19T09:20:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 1 -- 172.21.15.46:0/960627037 wait complete. 2024-09-19T09:20:48.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.066+0000 7fcd39fd2740 20 client.16173 trim_cache size 0 max 16384 2024-09-19T09:20:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.083+0000 7fcd39fd2740 1 Processor -- start 2024-09-19T09:20:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.083+0000 7fcd39fd2740 1 -- start start 2024-09-19T09:20:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d94008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d9400e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301ab2c0 con 0x5651d93da340 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301acec0 con 0x5651d93d9a20 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301ab990 con 0x5651d93e9150 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d9400e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d9400e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55318/0 (socket says 172.21.15.46:55318) 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 -- 172.21.15.46:0/3199721785 learned_addr learned my addr 172.21.15.46:0/3199721785 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:48.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35995640 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d94008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd36196640 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 -- 172.21.15.46:0/3199721785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 msgr2=0x5651d93e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 -- 172.21.15.46:0/3199721785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 msgr2=0x5651d94008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d94008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 -- 172.21.15.46:0/3199721785 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651d93d5f20 con 0x5651d93da340 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd36196640 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd35194640 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d9400e30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcd20018550 tx=0x7fcd2000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9732770288d08f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.084+0000 7fcd1b7fe640 1 -- 172.21.15.46:0/3199721785 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20027040 con 0x5651d93da340 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd1b7fe640 1 -- 172.21.15.46:0/3199721785 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2003c070 con 0x5651d93da340 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd1b7fe640 1 -- 172.21.15.46:0/3199721785 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd20004660 con 0x5651d93da340 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 -- 172.21.15.46:0/3199721785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 msgr2=0x5651d9400e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d9400e30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcd20018550 tx=0x7fcd2000a570 comp rx=0 tx=0).stop 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 -- 172.21.15.46:0/3199721785 shutdown_connections 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93da340 0x5651d9400e30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93e9150 0x5651d93e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/3199721785 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93d9a20 0x5651d94008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 -- 172.21.15.46:0/3199721785 >> 172.21.15.46:0/3199721785 conn(0x5651d93d60f0 msgr2=0x5651d93e7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 -- 172.21.15.46:0/3199721785 shutdown_connections 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.085+0000 7fcd39fd2740 1 -- 172.21.15.46:0/3199721785 wait complete. 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 -- start start 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 Processor -- start 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d945cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93da340 0x5651d945d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 0x5651d93ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301ac730 con 0x5651d93e9150 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301ac060 con 0x5651d93da340 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fcd301a92a0 con 0x5651d93d9a20 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd36196640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 0x5651d93ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd39fd2740 10 client.0 _ll_register_callbacks cb 0x7fcd2c0f3420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd36196640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 0x5651d93ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55330/0 (socket says 172.21.15.46:55330) 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.086+0000 7fcd36196640 1 -- 172.21.15.46:0/2193751759 learned_addr learned my addr 172.21.15.46:0/2193751759 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd35194640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93da340 0x5651d945d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd35995640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d945cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd36196640 1 -- 172.21.15.46:0/2193751759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 msgr2=0x5651d945cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd36196640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d945cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd36196640 1 -- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93da340 msgr2=0x5651d945d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd36196640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93da340 0x5651d945d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd36196640 1 -- 172.21.15.46:0/2193751759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651d93ede10 con 0x5651d93e9150 2024-09-19T09:20:48.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd35194640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93da340 0x5651d945d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd36196640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 0x5651d93ed610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009f10 tx=0x7fcd28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f06c0fc0e024d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd197fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd197fa640 1 -- 172.21.15.46:0/2193751759 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd2801a040 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd197fa640 1 -- 172.21.15.46:0/2193751759 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fcd28022850 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd2003c070 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.087+0000 7fcd197fa640 1 -- 172.21.15.46:0/2193751759 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fcd28031070 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 10 client.16179 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5651d9464390 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd197fa640 1 -- 172.21.15.46:0/2193751759 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd2003c070 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd197fa640 1 -- 172.21.15.46:0/2193751759 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7fcd2800f040 con 0x5651d93e9150 2024-09-19T09:20:48.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 10 client.16179 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 20 client.16179 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d9464c00 0x5651d9467020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 4 client.16179 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5651d9346d00 con 0x5651d9464c00 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.088+0000 7fcd35995640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d9464c00 0x5651d9467020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.089+0000 7fcd197fa640 10 client.16179 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.089+0000 7fcd35995640 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d9464c00 0x5651d9467020 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dedba0ebced8bd4e server_cookie=42ad3b26eb59179e in_seq=0 out_seq=0 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.089+0000 7fcd197fa640 1 -- 172.21.15.46:0/2193751759 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5651d9346d00 con 0x5651d9464c00 2024-09-19T09:20:48.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.089+0000 7fcd197fa640 10 client.16179 handle_command_reply: tid=0 2024-09-19T09:20:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.089+0000 7fcd39fd2740 1 client.16179 shutdown 2024-09-19T09:20:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 msgr2=0x5651d93ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 0x5651d93ed610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009f10 tx=0x7fcd28004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 shutdown_connections 2024-09-19T09:20:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651d9464c00 0x5651d9467020 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651d93e9150 0x5651d93ed610 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651d93da340 0x5651d945d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 --2- 172.21.15.46:0/2193751759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651d93d9a20 0x5651d945cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 >> 172.21.15.46:0/2193751759 conn(0x5651d93d60f0 msgr2=0x5651d93f3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd197fa640 0 client.16179 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 shutdown_connections 2024-09-19T09:20:48.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 1 -- 172.21.15.46:0/2193751759 wait complete. 2024-09-19T09:20:48.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.090+0000 7fcd39fd2740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T09:20:48.112 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "return_code": 0, 2024-09-19T09:20:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_tag": "11a31c3a-25bf-4c64-b464-ac8419fcad65", 2024-09-19T09:20:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": "asynchronous" 2024-09-19T09:20:48.113 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:48.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcd1c0a3240 msgr2=0x7fcd1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcd1c0a3240 0x7fcd1c0a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcd28005fd0 tx=0x7fcd28004ab0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 msgr2=0x7fcd301985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:48.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd301985c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009230 tx=0x7fcd2c004270 comp rx=0 tx=0).stop 2024-09-19T09:20:48.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 shutdown_connections 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fcd1c0a3240 0x7fcd1c0a5700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd301082a0 0x7fcd3019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd301036e0 0x7fcd30198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 --2- 172.21.15.46:0/1655802711 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcd30102d30 0x7fcd301985c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 >> 172.21.15.46:0/1655802711 conn(0x7fcd300fc7d0 msgr2=0x7fcd30105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 shutdown_connections 2024-09-19T09:20:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:48.091+0000 7fcd37bf9640 1 -- 172.21.15.46:0/1655802711 wait complete. 2024-09-19T09:20:48.116 INFO:tasks.workunit.client.0.smithi046.stdout:./configure \ 2024-09-19T09:20:48.116 INFO:tasks.workunit.client.0.smithi046.stdout: --libexecdir=/usr/lib \ 2024-09-19T09:20:48.116 INFO:tasks.workunit.client.0.smithi046.stdout: --exec_prefix=/var/lib 2024-09-19T09:20:48.412 INFO:tasks.workunit.client.0.smithi046.stdout:checking build system type... x86_64-pc-linux-gnu 2024-09-19T09:20:48.412 INFO:tasks.workunit.client.0.smithi046.stdout:checking host system type... x86_64-pc-linux-gnu 2024-09-19T09:20:48.413 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to print strings... printf 2024-09-19T09:20:48.413 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc... gcc 2024-09-19T09:20:48.460 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.144+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000799 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/095.out auth v610 ap=1 s=43 n(v0 rc2024-09-19T09:20:29.572963+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000799:[<0x100000006d6/095.out v318>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000799:[<0x100000006d6/095.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.460 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.144+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/388.out auth v626 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.221956+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009d3:[<0x100000006d6/388.out v452>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009d3:[<0x100000006d6/388.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.460 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.138+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/621.out auth v618 ap=1 s=512 n(v0 rc2024-09-19T09:20:31.068946+0000 b512 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fcd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba5:[<0x100000006d6/621.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ba5:[<0x100000006d6/621.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.460 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.138+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/057.out auth v594 ap=1 s=503 n(v0 rc2024-09-19T09:20:27.465986+0000 b503 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fcdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074d:[<0x100000006d6/057.out v238>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000074d:[<0x100000006d6/057.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.461 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.145+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/510.out auth v616 ap=1 s=116 n(v0 rc2024-09-19T09:20:30.488953+0000 b116 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac7:[<0x100000006d6/510.out v504>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ac7:[<0x100000006d6/510.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.461 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.145+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000751 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/059.out auth v602 ap=1 s=981 n(v0 b981 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000751:[<0x100000006d6/059.out v246>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000751:[<0x100000006d6/059.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.461 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.145+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/383.out auth v622 ap=1 s=266 n(v0 rc2024-09-19T09:20:30.211956+0000 b266 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009c9:[<0x100000006d6/383.out v446>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009c9:[<0x100000006d6/383.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.461 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.138+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/382.out auth v624 ap=1 s=447 n(v0 rc2024-09-19T09:20:30.208956+0000 b447 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009c7:[<0x100000006d6/382.out v434>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009c7:[<0x100000006d6/382.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.461 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.139+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/601.out auth v610 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.011947+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fcf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7d:[<0x100000006d6/601.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b7d:[<0x100000006d6/601.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.461 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.140+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a47 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/446.out auth v606 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.341954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53118a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a47:[<0x100000006d6/446.out v478>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a47:[<0x100000006d6/446.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.462 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.146+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/255.out auth v628 ap=1 s=7817 n(v0 rc2024-09-19T09:20:29.964958+0000 b7817 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d9:[<0x100000006d6/255.out v394>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008d9:[<0x100000006d6/255.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.462 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.146+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c53 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/708.out auth v594 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.319943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c53:[<0x100000006d6/708.out v580>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c53:[<0x100000006d6/708.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.462 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.141+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009cd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/385.out auth v602 ap=1 s=68034 n(v0 rc2024-09-19T09:20:30.215956+0000 b68034 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f8cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009cd:[<0x100000006d6/385.out v438>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009cd:[<0x100000006d6/385.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.462 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.141+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a33 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/436.out auth v608 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.321954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f8c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a33:[<0x100000006d6/436.out v470>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a33:[<0x100000006d6/436.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.463 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.146+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bad [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/625.out auth v614 ap=1 s=140 n(v0 b140 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bad:[<0x100000006d6/625.out v552>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bad:[<0x100000006d6/625.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.463 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.147+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000793 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/092.out auth v618 ap=1 s=193 n(v0 rc2024-09-19T09:20:29.562963+0000 b193 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d40db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000793:[<0x100000006d6/092.out v314>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000793:[<0x100000006d6/092.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.463 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.148+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b45 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/573.out auth v634 ap=1 s=442 n(v0 rc2024-09-19T09:20:30.909948+0000 b442 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d40d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b45:[<0x100000006d6/573.out v528>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b45:[<0x100000006d6/573.out v634>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.463 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.142+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aaf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/498.out auth v626 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.463953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f8e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aaf:[<0x100000006d6/498.out v510>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aaf:[<0x100000006d6/498.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.463 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.142+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a59 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/455.out auth v632 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.360954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f8db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a59:[<0x100000006d6/455.out v484>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a59:[<0x100000006d6/455.out v632>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.463 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.142+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000923 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/292.out auth v606 ap=1 s=496 n(v0 rc2024-09-19T09:20:30.046957+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530edfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000923:[<0x100000006d6/292.out v390>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000923:[<0x100000006d6/292.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.464 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.148+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a21 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/427.out auth v632 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.302955+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d40d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a21:[<0x100000006d6/427.out v472>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a21:[<0x100000006d6/427.out v632>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.464 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.150+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/390.out auth v624 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.225955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d68f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009d7:[<0x100000006d6/390.out v454>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009d7:[<0x100000006d6/390.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.464 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.150+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/417.out auth v632 ap=1 s=340 n(v0 rc2024-09-19T09:20:30.281955+0000 b340 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d68fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0d:[<0x100000006d6/417.out v466>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a0d:[<0x100000006d6/417.out v632>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.464 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.151+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c4d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/705.out auth v618 ap=1 s=147 n(v0 rc2024-09-19T09:20:31.313943+0000 b147 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d691180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c4d:[<0x100000006d6/705.out v580>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c4d:[<0x100000006d6/705.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.464 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.151+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a61 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/459.out auth v626 ap=1 s=33 n(v0 rc2024-09-19T09:20:30.369954+0000 b33 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d691700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a61:[<0x100000006d6/459.out v482>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a61:[<0x100000006d6/459.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.465 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.143+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/509.out auth v590 ap=1 s=120 n(v0 rc2024-09-19T09:20:30.486953+0000 b120 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f8e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac5:[<0x100000006d6/509.out v520>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ac5:[<0x100000006d6/509.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.465 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.143+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b37 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/566.out auth v626 ap=1 s=95 n(v0 b95 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ee0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b37:[<0x100000006d6/566.out v546>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b37:[<0x100000006d6/566.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.465 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.144+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/449.out auth v582 ap=1 s=36 n(v0 rc2024-09-19T09:20:30.348954+0000 b36 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f6c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a4d:[<0x100000006d6/449.out v482>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a4d:[<0x100000006d6/449.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.465 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.151+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/534.out auth v602 ap=1 s=250 n(v0 rc2024-09-19T09:20:30.537952+0000 b250 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af7:[<0x100000006d6/534.out v518>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000af7:[<0x100000006d6/534.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.465 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.152+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a3f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/442.out auth v636 ap=1 s=38 n(v0 rc2024-09-19T09:20:30.333954+0000 b38 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a3f:[<0x100000006d6/442.out v476>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a3f:[<0x100000006d6/442.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.465 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.152+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000acb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/512.out auth v610 ap=1 s=326 n(v0 rc2024-09-19T09:20:30.492953+0000 b326 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000acb:[<0x100000006d6/512.out v506>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000acb:[<0x100000006d6/512.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.466 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.144+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000abb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/504.out auth v592 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.475953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000abb:[<0x100000006d6/504.out v516>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000abb:[<0x100000006d6/504.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.466 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.145+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000adb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/520.out auth v624 ap=1 s=2723 n(v0 rc2024-09-19T09:20:30.508952+0000 b2723 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000adb:[<0x100000006d6/520.out v530>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000adb:[<0x100000006d6/520.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.466 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.153+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/296.out auth v598 ap=1 s=486 n(v0 rc2024-09-19T09:20:30.054957+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092b:[<0x100000006d6/296.out v414>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000092b:[<0x100000006d6/296.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.466 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.153+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000987 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/342.out auth v606 ap=1 s=549 n(v0 b549 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000987:[<0x100000006d6/342.out v438>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000987:[<0x100000006d6/342.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.466 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.153+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000953 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/316.out auth v630 ap=1 s=4405 n(v0 rc2024-09-19T09:20:30.092957+0000 b4405 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000953:[<0x100000006d6/316.out v424>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000953:[<0x100000006d6/316.out v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.466 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.145+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000907 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/278.out auth v602 ap=1 s=320 n(v0 rc2024-09-19T09:20:30.017958+0000 b320 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000907:[<0x100000006d6/278.out v380>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000907:[<0x100000006d6/278.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.467 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.146+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/424.out auth v608 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.295955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a1b:[<0x100000006d6/424.out v464>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a1b:[<0x100000006d6/424.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.467 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.147+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000937 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/302.out auth v630 ap=1 s=315 n(v0 rc2024-09-19T09:20:30.065957+0000 b315 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000937:[<0x100000006d6/302.out v398>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000937:[<0x100000006d6/302.out v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.467 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.153+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/321.out auth v634 ap=1 s=163 n(v0 rc2024-09-19T09:20:30.103957+0000 b163 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d53f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095d:[<0x100000006d6/321.out v426>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000095d:[<0x100000006d6/321.out v634>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.467 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.154+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000905 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/277.out auth v614 ap=1 s=25 n(v0 rc2024-09-19T09:20:30.015958+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d544000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000905:[<0x100000006d6/277.out v406>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000905:[<0x100000006d6/277.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.467 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.155+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b3d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/569.out auth v600 ap=1 s=283 n(v0 rc2024-09-19T09:20:30.901948+0000 b283 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d544b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b3d:[<0x100000006d6/569.out v526>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b3d:[<0x100000006d6/569.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.467 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.155+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000765 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/069.out auth v596 ap=1 s=268 n(v0 rc2024-09-19T09:20:27.487986+0000 b268 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d40f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000765:[<0x100000006d6/069.out v286>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000765:[<0x100000006d6/069.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.468 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.156+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fe [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/020.out auth v600 ap=1 s=2286 n(v0 rc2024-09-19T09:20:27.397987+0000 b2286 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fe:[<0x100000006d6/020.out v80>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006fe:[<0x100000006d6/020.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.468 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.147+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ed [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/401.out auth v596 ap=1 s=58 n(v0 rc2024-09-19T09:20:30.247955+0000 b58 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ed:[<0x100000006d6/401.out v450>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009ed:[<0x100000006d6/401.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.468 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.148+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/645.out auth v626 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.144945+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd5:[<0x100000006d6/645.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bd5:[<0x100000006d6/645.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.468 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.148+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c13 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/676.out auth v606 ap=1 s=42 n(v0 rc2024-09-19T09:20:31.230944+0000 b42 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311e6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c13:[<0x100000006d6/676.out v578>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c13:[<0x100000006d6/676.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.468 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.156+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a13 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/420.out auth v620 ap=1 s=141 n(v0 rc2024-09-19T09:20:30.287955+0000 b141 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a13:[<0x100000006d6/420.out v470>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a13:[<0x100000006d6/420.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.468 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.156+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/338.out auth v604 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.137956+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097f:[<0x100000006d6/338.out v428>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000097f:[<0x100000006d6/338.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.469 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.156+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000917 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/286.out auth v622 ap=1 s=25 n(v0 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000917:[<0x100000006d6/286.out v402>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000917:[<0x100000006d6/286.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.469 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.148+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000805 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/149.out auth v592 ap=1 s=941 n(v0 rc2024-09-19T09:20:29.713961+0000 b941 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311e6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000805:[<0x100000006d6/149.out v330>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000805:[<0x100000006d6/149.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.469 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.150+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a87 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/478.out auth v608 ap=1 s=1695 n(v0 rc2024-09-19T09:20:30.423953+0000 b1695 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a87:[<0x100000006d6/478.out v500>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a87:[<0x100000006d6/478.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.469 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.157+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000839 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/175.out auth v582 ap=1 s=102 n(v0 rc2024-09-19T09:20:29.769961+0000 b102 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000839:[<0x100000006d6/175.out v350>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000839:[<0x100000006d6/175.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.469 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.157+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bbb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/632.out auth v618 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.090946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfb2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bbb:[<0x100000006d6/632.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bbb:[<0x100000006d6/632.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.470 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.150+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c29 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/687.out auth v622 ap=1 s=1088 n(v0 rc2024-09-19T09:20:31.251944+0000 b1088 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c29:[<0x100000006d6/687.out v582>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c29:[<0x100000006d6/687.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.470 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.151+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c8f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/738.out auth v638 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c8f:[<0x100000006d6/738.out v586>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c8f:[<0x100000006d6/738.out v638>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.470 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.151+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000749 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/055.out auth v602 ap=1 s=5457 n(v0 rc2024-09-19T09:20:27.461986+0000 b5457 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000749:[<0x100000006d6/055.out v230>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000749:[<0x100000006d6/055.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.470 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.158+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a27 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/430.out auth v626 ap=1 s=1076 n(v0 rc2024-09-19T09:20:30.308955+0000 b1076 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a27:[<0x100000006d6/430.out v482>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a27:[<0x100000006d6/430.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.470 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.158+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b3f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/570.out auth v606 ap=1 s=231 n(v0 rc2024-09-19T09:20:30.903948+0000 b231 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfb2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b3f:[<0x100000006d6/570.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b3f:[<0x100000006d6/570.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.471 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.159+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a6b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/464.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.384954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfb4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a6b:[<0x100000006d6/464.out v502>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a6b:[<0x100000006d6/464.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.471 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.152+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c05 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/669.out auth v616 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.216945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c05:[<0x100000006d6/669.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c05:[<0x100000006d6/669.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.471 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.152+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/576.out auth v636 ap=1 s=318 n(v0 rc2024-09-19T09:20:30.914948+0000 b318 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4b:[<0x100000006d6/576.out v548>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b4b:[<0x100000006d6/576.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.471 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.153+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/160.out auth v588 ap=1 s=141 n(v0 rc2024-09-19T09:20:29.736961+0000 b141 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081b:[<0x100000006d6/160.out v338>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000081b:[<0x100000006d6/160.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.471 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.159+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/178.out auth v626 ap=1 s=315 n(v0 rc2024-09-19T09:20:29.778960+0000 b315 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf94680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083f:[<0x100000006d6/178.out v354>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000083f:[<0x100000006d6/178.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.471 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.159+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.default auth v600 ap=1 s=865 n(v0 rc2024-09-19T09:20:27.450986+0000 b865 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d04d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073d:[<0x100000006d6/050.out.default v206>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000073d:[<0x100000006d6/050.out.default v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.472 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.153+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000985 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/341.out auth v612 ap=1 s=600 n(v0 rc2024-09-19T09:20:30.142956+0000 b600 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53102c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000985:[<0x100000006d6/341.out v452>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000985:[<0x100000006d6/341.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.472 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.154+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/495.out auth v582 ap=1 s=50 n(v0 rc2024-09-19T09:20:30.457953+0000 b50 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531081700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa9:[<0x100000006d6/495.out v518>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aa9:[<0x100000006d6/495.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.472 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.160+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b61 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/587.out auth v616 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.960947+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfd6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b61:[<0x100000006d6/587.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b61:[<0x100000006d6/587.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.472 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.162+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/102.out auth v590 ap=1 s=1055 n(v0 rc2024-09-19T09:20:29.593962+0000 b1055 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d012000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a7:[<0x100000006d6/102.out v318>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007a7:[<0x100000006d6/102.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.163+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c49 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/703.out auth v610 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.286944+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d014680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c49:[<0x100000006d6/703.out v580>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c49:[<0x100000006d6/703.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.163+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000090b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/280.out auth v614 ap=1 s=25 n(v0 rc2024-09-19T09:20:30.021958+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfcd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000090b:[<0x100000006d6/280.out v398>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000090b:[<0x100000006d6/280.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.164+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000861 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/195.out auth v594 ap=1 s=496 n(v0 rc2024-09-19T09:20:29.826960+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfcb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000861:[<0x100000006d6/195.out v364>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000861:[<0x100000006d6/195.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.164+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/100.out auth v624 ap=1 s=25 n(v0 rc2024-09-19T09:20:29.587963+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfcb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a3:[<0x100000006d6/100.out v314>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007a3:[<0x100000006d6/100.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.154+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000989 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/343.out auth v628 ap=1 s=127 n(v0 rc2024-09-19T09:20:30.146956+0000 b127 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53102cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000989:[<0x100000006d6/343.out v454>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000989:[<0x100000006d6/343.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.154+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000945 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/309.out auth v594 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.079957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53102d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000945:[<0x100000006d6/309.out v436>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000945:[<0x100000006d6/309.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.473 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.155+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/647.out auth v588 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.147945+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53102e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd9:[<0x100000006d6/647.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bd9:[<0x100000006d6/647.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.474 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.165+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008db [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/256.out auth v592 ap=1 s=25 n(v0 rc2024-09-19T09:20:29.967958+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfcc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008db:[<0x100000006d6/256.out v388>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008db:[<0x100000006d6/256.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.474 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.165+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000726 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/039.out auth v600 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf68c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000726:[<0x100000006d6/039.out v160>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000726:[<0x100000006d6/039.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.474 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.156+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000897 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/222.out auth v600 ap=1 s=112 n(v0 rc2024-09-19T09:20:29.889959+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53102ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000897:[<0x100000006d6/222.out v386>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000897:[<0x100000006d6/222.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.474 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.156+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000957 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/318.out auth v586 ap=1 s=847 n(v0 rc2024-09-19T09:20:30.096957+0000 b847 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000957:[<0x100000006d6/318.out v440>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000957:[<0x100000006d6/318.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.475 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.165+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000967 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/326.out auth v622 ap=1 s=376 n(v0 rc2024-09-19T09:20:30.113957+0000 b376 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf69700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000967:[<0x100000006d6/326.out v412>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000967:[<0x100000006d6/326.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.475 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.166+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000724 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/038.out auth v602 ap=1 s=43 n(v0 rc2024-09-19T09:20:27.429986+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf66580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000724:[<0x100000006d6/038.out v156>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000724:[<0x100000006d6/038.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.475 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.166+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aff [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/538.out auth v636 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.546952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aff:[<0x100000006d6/538.out v540>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aff:[<0x100000006d6/538.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.475 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.157+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000975 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/333.out auth v584 ap=1 s=102 n(v0 rc2024-09-19T09:20:30.127957+0000 b102 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000975:[<0x100000006d6/333.out v444>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000975:[<0x100000006d6/333.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.475 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.157+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/312.out auth v622 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.084957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094b:[<0x100000006d6/312.out v438>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000094b:[<0x100000006d6/312.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.475 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.158+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000714 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/031.out auth v572 ap=1 s=739 n(v0 b739 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000714:[<0x100000006d6/031.out v124>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000714:[<0x100000006d6/031.out v572>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.476 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.167+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/247.out auth v604 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.946959+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c9:[<0x100000006d6/247.out v384>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008c9:[<0x100000006d6/247.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.476 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.167+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a41 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/443.out auth v632 ap=1 s=39 n(v0 rc2024-09-19T09:20:30.335954+0000 b39 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a41:[<0x100000006d6/443.out v492>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a41:[<0x100000006d6/443.out v632>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.476 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.168+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000949 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/311.out auth v584 ap=1 s=9633 n(v0 rc2024-09-19T09:20:30.082957+0000 b9633 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d02bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000949:[<0x100000006d6/311.out v406>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000949:[<0x100000006d6/311.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.476 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.158+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000797 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/094.out auth v618 ap=1 s=70 n(v0 rc2024-09-19T09:20:29.569963+0000 b70 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000797:[<0x100000006d6/094.out v314>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000797:[<0x100000006d6/094.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.476 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.159+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/144.out auth v590 ap=1 s=694 n(v0 rc2024-09-19T09:20:29.702961+0000 b694 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fb:[<0x100000006d6/144.out v342>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007fb:[<0x100000006d6/144.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.476 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.159+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/646.out auth v616 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.145945+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fc5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd7:[<0x100000006d6/646.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bd7:[<0x100000006d6/646.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.477 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.169+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009eb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/400.out auth v574 ap=1 s=305 n(v0 rc2024-09-19T09:20:30.245955+0000 b305 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfb5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009eb:[<0x100000006d6/400.out v474>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009eb:[<0x100000006d6/400.out v574>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.477 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.169+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000712 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/030.out auth v620 ap=1 s=1872 n(v0 rc2024-09-19T09:20:27.414987+0000 b1872 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000712:[<0x100000006d6/030.out v120>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000712:[<0x100000006d6/030.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.477 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.159+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/425.out auth v578 ap=1 s=132 n(v0 rc2024-09-19T09:20:30.297955+0000 b132 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f94580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a1d:[<0x100000006d6/425.out v492>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a1d:[<0x100000006d6/425.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.477 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.160+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bab [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/624.out auth v614 ap=1 s=224 n(v0 rc2024-09-19T09:20:31.074946+0000 b224 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c54100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bab:[<0x100000006d6/624.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bab:[<0x100000006d6/624.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.477 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.170+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/271.out auth v612 ap=1 s=312 n(v0 rc2024-09-19T09:20:30.002958+0000 b312 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfb4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f9:[<0x100000006d6/271.out v416>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008f9:[<0x100000006d6/271.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.170+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/494.out auth v598 ap=1 s=157 n(v0 rc2024-09-19T09:20:30.455953+0000 b157 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d236580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa7:[<0x100000006d6/494.out v516>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aa7:[<0x100000006d6/494.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.170+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000901 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/275.out auth v592 ap=1 s=116 n(v0 rc2024-09-19T09:20:30.010958+0000 b116 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d236b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000901:[<0x100000006d6/275.out v420>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000901:[<0x100000006d6/275.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.160+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000927 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/294.out auth v626 ap=1 s=299 n(v0 rc2024-09-19T09:20:30.050957+0000 b299 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f95080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000927:[<0x100000006d6/294.out v430>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000927:[<0x100000006d6/294.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.160+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000973 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/332.out auth v634 ap=1 s=373 n(v0 rc2024-09-19T09:20:30.125957+0000 b373 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c55180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000973:[<0x100000006d6/332.out v442>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000973:[<0x100000006d6/332.out v634>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.161+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/407.out auth v638 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.259955+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ebe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f9:[<0x100000006d6/407.out v482>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009f9:[<0x100000006d6/407.out v638>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.171+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b11 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/547.out auth v618 ap=1 s=28 n(v0 b28 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d237b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b11:[<0x100000006d6/547.out v546>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b11:[<0x100000006d6/547.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.478 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.172+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/261.out auth v610 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.979958+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d238c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e5:[<0x100000006d6/261.out v414>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008e5:[<0x100000006d6/261.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.479 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.172+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b01 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/539.out auth v586 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.548952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d239180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b01:[<0x100000006d6/539.out v540>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b01:[<0x100000006d6/539.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.479 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.161+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000995 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/349.out auth v600 ap=1 s=277 n(v0 rc2024-09-19T09:20:30.158956+0000 b277 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ebe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000995:[<0x100000006d6/349.out v456>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000995:[<0x100000006d6/349.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.479 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.161+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c99 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/743.out auth v618 ap=1 s=86 n(v0 rc2024-09-19T09:20:31.386943+0000 b86 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ebf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c99:[<0x100000006d6/743.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c99:[<0x100000006d6/743.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.479 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.161+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/161.out auth v590 ap=1 s=82 n(v0 rc2024-09-19T09:20:29.737961+0000 b82 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ebeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081d:[<0x100000006d6/161.out v354>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000081d:[<0x100000006d6/161.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.479 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.173+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000710 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/029.out auth v578 ap=1 s=2578 n(v0 rc2024-09-19T09:20:27.412987+0000 b2578 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000710:[<0x100000006d6/029.out v116>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000710:[<0x100000006d6/029.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.479 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.173+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000827 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/166.out auth v608 ap=1 s=102 n(v0 rc2024-09-19T09:20:29.747961+0000 b102 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000827:[<0x100000006d6/166.out v356>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000827:[<0x100000006d6/166.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.480 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.161+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/090.out auth v630 ap=1 s=551 n(v0 rc2024-09-19T09:20:29.558963+0000 b551 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ebf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000078f:[<0x100000006d6/090.out v312>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000078f:[<0x100000006d6/090.out v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.480 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.162+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b55 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/581.out auth v616 ap=1 s=2615 n(v0 rc2024-09-19T09:20:30.949947+0000 b2615 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ec0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b55:[<0x100000006d6/581.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b55:[<0x100000006d6/581.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.480 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.173+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/406.out auth v600 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.257955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f7:[<0x100000006d6/406.out v480>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009f7:[<0x100000006d6/406.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.480 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.173+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a53 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/452.out auth v606 ap=1 s=77 n(v0 rc2024-09-19T09:20:30.354954+0000 b77 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a53:[<0x100000006d6/452.out v496>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a53:[<0x100000006d6/452.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.480 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.174+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000909 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/279.out auth v582 ap=1 s=312 n(v0 rc2024-09-19T09:20:30.019958+0000 b312 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000909:[<0x100000006d6/279.out v424>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000909:[<0x100000006d6/279.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.481 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.174+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000777 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/078.out auth v588 ap=1 s=1933 n(v0 rc2024-09-19T09:20:29.513963+0000 b1933 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000777:[<0x100000006d6/078.out v306>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000777:[<0x100000006d6/078.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.481 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.174+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f8 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/017.out auth v576 ap=1 s=28 n(v0 rc2024-09-19T09:20:27.392987+0000 b28 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d3b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f8:[<0x100000006d6/017.out v68>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006f8:[<0x100000006d6/017.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.481 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.175+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ad [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/105.out auth v580 ap=1 s=57 n(v0 rc2024-09-19T09:20:29.602962+0000 b57 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ad:[<0x100000006d6/105.out v318>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007ad:[<0x100000006d6/105.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.481 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.162+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.cfg auth v594 ap=1 s=40 n(v0 rc2024-09-19T09:20:27.449986+0000 b40 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ec0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073c:[<0x100000006d6/050.cfg v204>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000073c:[<0x100000006d6/050.cfg v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.481 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.163+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/254.out auth v620 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.962958+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d7:[<0x100000006d6/254.out v410>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008d7:[<0x100000006d6/254.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.481 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.164+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000983 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/340.out auth v610 ap=1 s=1102 n(v0 rc2024-09-19T09:20:30.140956+0000 b1102 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000983:[<0x100000006d6/340.out v448>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000983:[<0x100000006d6/340.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.482 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.175+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e8 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/009.out auth v592 ap=1 s=8125 n(v0 b8125 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf72680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e8:[<0x100000006d6/009.out v36>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006e8:[<0x100000006d6/009.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.482 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.175+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/403.out auth v590 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.251955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f1:[<0x100000006d6/403.out v478>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009f1:[<0x100000006d6/403.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.482 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.164+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/653.out auth v586 ap=1 s=112 n(v0 rc2024-09-19T09:20:31.160945+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be5:[<0x100000006d6/653.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000be5:[<0x100000006d6/653.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.482 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.164+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/245.out auth v584 ap=1 s=81 n(v0 rc2024-09-19T09:20:29.942959+0000 b81 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ea4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c5:[<0x100000006d6/245.out v404>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008c5:[<0x100000006d6/245.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.482 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.165+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/249.out auth v624 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.951958+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ea4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cd:[<0x100000006d6/249.out v406>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008cd:[<0x100000006d6/249.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.483 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.176+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.cfg auth v572 ap=1 s=9 n(v0 rc2024-09-19T09:20:27.422986+0000 b9 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf71600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071c:[<0x100000006d6/035.cfg v140>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000071c:[<0x100000006d6/035.cfg v572>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.483 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.176+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/508.out auth v588 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.484953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf70b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac3:[<0x100000006d6/508.out v524>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ac3:[<0x100000006d6/508.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.483 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.177+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/006.out auth v574 ap=1 s=278 n(v0 rc2024-09-19T09:20:27.372987+0000 b278 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d008b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e2:[<0x100000006d6/006.out v24>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006e2:[<0x100000006d6/006.out v574>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.484 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.166+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b17 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/550.out auth v610 ap=1 s=266 n(v0 rc2024-09-19T09:20:30.570952+0000 b266 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f2b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b17:[<0x100000006d6/550.out v534>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b17:[<0x100000006d6/550.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.484 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.166+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000833 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/172.out auth v592 ap=1 s=244 n(v0 rc2024-09-19T09:20:29.760961+0000 b244 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d86000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000833:[<0x100000006d6/172.out v372>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000833:[<0x100000006d6/172.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.484 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.177+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b79 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/599.out auth v612 ap=1 s=28 n(v0 rc2024-09-19T09:20:31.007947+0000 b28 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d008580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b79:[<0x100000006d6/599.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b79:[<0x100000006d6/599.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.484 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.177+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c25 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/685.out auth v578 ap=1 s=1048 n(v0 rc2024-09-19T09:20:31.247944+0000 b1048 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d00ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c25:[<0x100000006d6/685.out v570>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c25:[<0x100000006d6/685.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.484 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.166+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b1b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/552.out auth v624 ap=1 s=215 n(v0 rc2024-09-19T09:20:30.574952+0000 b215 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f2a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b1b:[<0x100000006d6/552.out v538>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b1b:[<0x100000006d6/552.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.485 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.167+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000813 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/156.out auth v604 ap=1 s=427 n(v0 rc2024-09-19T09:20:29.727961+0000 b427 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f2b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000813:[<0x100000006d6/156.out v360>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000813:[<0x100000006d6/156.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.485 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.167+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a15 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/421.out auth v578 ap=1 s=39 n(v0 rc2024-09-19T09:20:30.289955+0000 b39 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a15:[<0x100000006d6/421.out v484>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a15:[<0x100000006d6/421.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.485 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.178+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009df [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/394.out auth v618 ap=1 s=50 n(v0 rc2024-09-19T09:20:30.233955+0000 b50 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d034680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009df:[<0x100000006d6/394.out v472>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009df:[<0x100000006d6/394.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.485 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.179+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000090d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/281.out auth v614 ap=1 s=313 n(v0 rc2024-09-19T09:20:30.023958+0000 b313 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d032b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000090d:[<0x100000006d6/281.out v426>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000090d:[<0x100000006d6/281.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.485 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.179+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000adf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/522.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.512952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d021700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000adf:[<0x100000006d6/522.out v532>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000adf:[<0x100000006d6/522.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.485 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.167+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c1b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/680.out auth v618 ap=1 s=239 n(v0 rc2024-09-19T09:20:31.238944+0000 b239 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c1b:[<0x100000006d6/680.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c1b:[<0x100000006d6/680.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.486 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.168+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/101.out auth v586 ap=1 s=673 n(v0 rc2024-09-19T09:20:29.590962+0000 b673 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d88680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a5:[<0x100000006d6/101.out v330>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007a5:[<0x100000006d6/101.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.486 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.180+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/532.out auth v626 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.533952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d020c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af3:[<0x100000006d6/532.out v538>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000af3:[<0x100000006d6/532.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.486 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.180+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b9d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/617.out auth v602 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.060946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d020100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b9d:[<0x100000006d6/617.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b9d:[<0x100000006d6/617.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.486 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.180+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b03 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/540.out auth v614 ap=1 s=622 n(v0 rc2024-09-19T09:20:30.550952+0000 b622 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d181080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b03:[<0x100000006d6/540.out v528>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b03:[<0x100000006d6/540.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.486 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.181+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a35 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/437.out auth v612 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d180b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a35:[<0x100000006d6/437.out v488>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a35:[<0x100000006d6/437.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.486 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.181+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000823 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/164.out auth v594 ap=1 s=109 n(v0 rc2024-09-19T09:20:29.743961+0000 b109 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d182680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000823:[<0x100000006d6/164.out v366>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000823:[<0x100000006d6/164.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.487 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.169+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000979 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/335.out auth v576 ap=1 s=224 n(v0 rc2024-09-19T09:20:30.131957+0000 b224 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53117e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000979:[<0x100000006d6/335.out v446>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000979:[<0x100000006d6/335.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.487 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.169+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b47 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/574.out auth v614 ap=1 s=224 n(v0 b224 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53117eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b47:[<0x100000006d6/574.out v554>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b47:[<0x100000006d6/574.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.487 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.169+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/143.out auth v602 ap=1 s=298 n(v0 rc2024-09-19T09:20:29.699961+0000 b298 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53117fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f9:[<0x100000006d6/143.out v356>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007f9:[<0x100000006d6/143.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.487 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.181+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a9b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/488.out auth v598 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.442953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d183180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a9b:[<0x100000006d6/488.out v504>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a9b:[<0x100000006d6/488.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.487 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.186+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007df [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/130.out auth v576 ap=1 s=16291 n(v0 rc2024-09-19T09:20:29.672962+0000 b16291 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d182c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007df:[<0x100000006d6/130.out v344>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007df:[<0x100000006d6/130.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.487 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.188+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c89 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/735.out auth v604 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.371943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d093080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c89:[<0x100000006d6/735.out v570>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c89:[<0x100000006d6/735.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.488 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.170+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/231.out auth v594 ap=1 s=529 n(v0 rc2024-09-19T09:20:29.909959+0000 b529 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531180680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a9:[<0x100000006d6/231.out v396>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008a9:[<0x100000006d6/231.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.488 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.170+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000857 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/190.out auth v582 ap=1 s=505 n(v0 rc2024-09-19T09:20:29.814960+0000 b505 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531181180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000857:[<0x100000006d6/190.out v382>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000857:[<0x100000006d6/190.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.488 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.170+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/344.out auth v628 ap=1 s=1467 n(v0 rc2024-09-19T09:20:30.148956+0000 b1467 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531180100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000098b:[<0x100000006d6/344.out v450>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000098b:[<0x100000006d6/344.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.488 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.189+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/120.out auth v592 ap=1 s=245 n(v0 rc2024-09-19T09:20:29.646962+0000 b245 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d093600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cb:[<0x100000006d6/120.out v340>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007cb:[<0x100000006d6/120.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.488 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.189+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/066.out auth v588 ap=1 s=242 n(v0 rc2024-09-19T09:20:27.481986+0000 b242 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d094100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075f:[<0x100000006d6/066.out v274>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000075f:[<0x100000006d6/066.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.489 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.189+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000098d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/345.out auth v610 ap=1 s=1491 n(v0 rc2024-09-19T09:20:30.150956+0000 b1491 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d094680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000098d:[<0x100000006d6/345.out v452>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000098d:[<0x100000006d6/345.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.490 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.171+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000720 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/036.out auth v622 ap=1 s=47 n(v0 b47 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531180c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000720:[<0x100000006d6/036.out v148>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000720:[<0x100000006d6/036.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.490 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.172+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/176.out auth v612 ap=1 s=88 n(v0 rc2024-09-19T09:20:29.772960+0000 b88 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531181700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083b:[<0x100000006d6/176.out v376>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000083b:[<0x100000006d6/176.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.490 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.190+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a05 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/413.out auth v580 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.272955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a05:[<0x100000006d6/413.out v478>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a05:[<0x100000006d6/413.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.490 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.191+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b51 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/579.out auth v608 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.945948+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b51:[<0x100000006d6/579.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b51:[<0x100000006d6/579.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.490 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.173+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/380.out auth v602 ap=1 s=1198 n(v0 rc2024-09-19T09:20:30.204956+0000 b1198 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531193180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009c3:[<0x100000006d6/380.out v462>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009c3:[<0x100000006d6/380.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.173+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/268.out auth v616 ap=1 s=320 n(v0 rc2024-09-19T09:20:29.995958+0000 b320 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531192680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f3:[<0x100000006d6/268.out v412>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008f3:[<0x100000006d6/268.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.174+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/080.out auth v590 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.520963+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000077b:[<0x100000006d6/080.out v308>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000077b:[<0x100000006d6/080.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.191+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000825 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/165.out auth v596 ap=1 s=113 n(v0 rc2024-09-19T09:20:29.745961+0000 b113 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d552000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000825:[<0x100000006d6/165.out v368>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000825:[<0x100000006d6/165.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.192+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/336.out auth v582 ap=1 s=216 n(v0 rc2024-09-19T09:20:30.133956+0000 b216 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d552b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097b:[<0x100000006d6/336.out v448>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000097b:[<0x100000006d6/336.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.193+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e4 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/007.out auth v570 ap=1 s=1359 n(v0 rc2024-09-19T09:20:27.374987+0000 b1359 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d554100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e4:[<0x100000006d6/007.out v28>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006e4:[<0x100000006d6/007.out v570>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.193+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/082.out auth v586 ap=1 s=118 n(v0 rc2024-09-19T09:20:29.525963+0000 b118 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d554680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000077f:[<0x100000006d6/082.out v310>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000077f:[<0x100000006d6/082.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.491 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.193+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/248.out auth v608 ap=1 s=52 n(v0 rc2024-09-19T09:20:29.949959+0000 b52 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d555180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cb:[<0x100000006d6/248.out v404>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008cb:[<0x100000006d6/248.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.492 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.193+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/121.out auth v604 ap=1 s=334 n(v0 rc2024-09-19T09:20:29.649962+0000 b334 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d69e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cd:[<0x100000006d6/121.out v342>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007cd:[<0x100000006d6/121.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.492 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.174+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b77 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/598.out auth v586 ap=1 s=744 n(v0 rc2024-09-19T09:20:31.005947+0000 b744 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310e3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b77:[<0x100000006d6/598.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b77:[<0x100000006d6/598.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.492 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.175+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/622.out auth v618 ap=1 s=1168 n(v0 rc2024-09-19T09:20:31.070946+0000 b1168 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310e5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba7:[<0x100000006d6/622.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ba7:[<0x100000006d6/622.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.492 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.175+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/519.out auth v594 ap=1 s=80 n(v0 rc2024-09-19T09:20:30.505952+0000 b80 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310e5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad9:[<0x100000006d6/519.out v514>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ad9:[<0x100000006d6/519.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.492 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.194+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000757 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/062.out auth v574 ap=1 s=16262 n(v0 rc2024-09-19T09:20:27.474986+0000 b16262 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d69f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000757:[<0x100000006d6/062.out v258>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000757:[<0x100000006d6/062.out v574>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.493 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.194+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000763 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/068.out auth v580 ap=1 s=738 n(v0 rc2024-09-19T09:20:27.485986+0000 b738 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d69e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000763:[<0x100000006d6/068.out v282>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000763:[<0x100000006d6/068.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.493 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.176+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/578.out auth v580 ap=1 s=1572 n(v0 rc2024-09-19T09:20:30.919948+0000 b1572 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53107e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4f:[<0x100000006d6/578.out v556>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b4f:[<0x100000006d6/578.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.493 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.176+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/131.out auth v604 ap=1 s=34 n(v0 rc2024-09-19T09:20:29.674962+0000 b34 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53107fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e1:[<0x100000006d6/131.out v346>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007e1:[<0x100000006d6/131.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.493 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.195+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b33 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/564.out auth v600 ap=1 s=1010 n(v0 rc2024-09-19T09:20:30.890948+0000 b1010 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b33:[<0x100000006d6/564.out v550>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b33:[<0x100000006d6/564.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.493 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.195+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/525.out auth v614 ap=1 s=50 n(v0 rc2024-09-19T09:20:30.518952+0000 b50 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae5:[<0x100000006d6/525.out v520>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ae5:[<0x100000006d6/525.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.494 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.196+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b53 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/580.out auth v590 ap=1 s=3320 n(v0 rc2024-09-19T09:20:30.947947+0000 b3320 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d188b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b53:[<0x100000006d6/580.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b53:[<0x100000006d6/580.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.494 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.197+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bbd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/633.out auth v602 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.091946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d189600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bbd:[<0x100000006d6/633.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bbd:[<0x100000006d6/633.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.494 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.197+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ef [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/266.out auth v594 ap=1 s=313 n(v0 rc2024-09-19T09:20:29.991958+0000 b313 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d189080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ef:[<0x100000006d6/266.out v410>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008ef:[<0x100000006d6/266.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.495 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.177+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c1f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/682.out auth v584 ap=1 s=108 n(v0 b108 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53107f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c1f:[<0x100000006d6/682.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c1f:[<0x100000006d6/682.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.495 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.178+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/049.out auth v614 ap=1 s=25 n(v0 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ea6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073a:[<0x100000006d6/049.out v200>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000073a:[<0x100000006d6/049.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.495 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.179+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b71 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/595.out auth v624 ap=1 s=358 n(v0 rc2024-09-19T09:20:30.975947+0000 b358 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b71:[<0x100000006d6/595.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b71:[<0x100000006d6/595.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.495 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether the C compiler works... yes 2024-09-19T09:20:48.496 INFO:tasks.workunit.client.0.smithi046.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:20:48.496 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.197+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a9d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/489.out auth v606 ap=1 s=240 n(v0 rc2024-09-19T09:20:30.445953+0000 b240 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d189b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a9d:[<0x100000006d6/489.out v506>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a9d:[<0x100000006d6/489.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.496 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.197+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b19 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/551.out auth v616 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.572952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d18a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b19:[<0x100000006d6/551.out v536>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b19:[<0x100000006d6/551.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.496 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.198+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000078b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/088.out auth v604 ap=1 s=397 n(v0 rc2024-09-19T09:20:29.552963+0000 b397 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000078b:[<0x100000006d6/088.out v312>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000078b:[<0x100000006d6/088.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.497 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.179+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a7d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/473.out auth v618 ap=1 s=4362 n(v0 rc2024-09-19T09:20:30.411953+0000 b4362 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d5c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a7d:[<0x100000006d6/473.out v498>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a7d:[<0x100000006d6/473.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.497 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.179+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b2b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/560.out auth v590 ap=1 s=99 n(v0 rc2024-09-19T09:20:30.589951+0000 b99 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d5d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b2b:[<0x100000006d6/560.out v548>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b2b:[<0x100000006d6/560.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.497 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.180+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a8f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/482.out auth v586 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.431953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d5d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a8f:[<0x100000006d6/482.out v500>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a8f:[<0x100000006d6/482.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.497 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.180+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000903 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/276.out auth v610 ap=1 s=312 n(v0 rc2024-09-19T09:20:30.012958+0000 b312 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d5f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000903:[<0x100000006d6/276.out v416>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000903:[<0x100000006d6/276.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.497 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.181+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/659.out auth v602 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.171945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530d5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf1:[<0x100000006d6/659.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bf1:[<0x100000006d6/659.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.497 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.198+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/642.out auth v618 ap=1 s=44 n(v0 rc2024-09-19T09:20:31.112946+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcf:[<0x100000006d6/642.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bcf:[<0x100000006d6/642.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.198+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/225.out auth v596 ap=1 s=110 n(v0 rc2024-09-19T09:20:29.896959+0000 b110 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089d:[<0x100000006d6/225.out v388>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000089d:[<0x100000006d6/225.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.198+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/132.out auth v566 ap=1 s=36183 n(v0 rc2024-09-19T09:20:29.676962+0000 b36183 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e3:[<0x100000006d6/132.out v338>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007e3:[<0x100000006d6/132.out v566>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.198+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/014.out auth v578 ap=1 s=67 n(v0 rc2024-09-19T09:20:27.386987+0000 b67 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f2:[<0x100000006d6/014.out v56>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006f2:[<0x100000006d6/014.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.200+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c03 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/668.out auth v602 ap=1 s=505 n(v0 rc2024-09-19T09:20:31.214945+0000 b505 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c03:[<0x100000006d6/668.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c03:[<0x100000006d6/668.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.181+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000785 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/085.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:29.535963+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531216000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000785:[<0x100000006d6/085.out v314>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000785:[<0x100000006d6/085.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.182+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000747 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/054.out auth v598 ap=1 s=18057 n(v0 rc2024-09-19T09:20:27.459986+0000 b18057 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531217600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000747:[<0x100000006d6/054.out v226>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000747:[<0x100000006d6/054.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.498 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.182+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.out.default auth v600 ap=1 s=74 n(v0 rc2024-09-19T09:20:27.423986+0000 b74 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531217b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071d:[<0x100000006d6/035.out.default v142>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000071d:[<0x100000006d6/035.out.default v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.499 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.200+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000706 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/024.out auth v610 ap=1 s=1857 n(v0 rc2024-09-19T09:20:27.404987+0000 b1857 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000706:[<0x100000006d6/024.out v96>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000706:[<0x100000006d6/024.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.499 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.201+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000803 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/148.out auth v612 ap=1 s=704 n(v0 rc2024-09-19T09:20:29.710961+0000 b704 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000803:[<0x100000006d6/148.out v356>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000803:[<0x100000006d6/148.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.499 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.201+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000704 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/023.out auth v580 ap=1 s=1933 n(v0 rc2024-09-19T09:20:27.402987+0000 b1933 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4f0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000704:[<0x100000006d6/023.out v92>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000704:[<0x100000006d6/023.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.499 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.185+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/133.out auth v612 ap=1 s=149 n(v0 rc2024-09-19T09:20:29.678962+0000 b149 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531218100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e5:[<0x100000006d6/133.out v348>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007e5:[<0x100000006d6/133.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.499 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.185+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000991 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/347.out auth v620 ap=1 s=39 n(v0 b39 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531218680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000991:[<0x100000006d6/347.out v454>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000991:[<0x100000006d6/347.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.499 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.188+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/153.out auth v580 ap=1 s=294 n(v0 rc2024-09-19T09:20:29.721961+0000 b294 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531219180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080d:[<0x100000006d6/153.out v358>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000080d:[<0x100000006d6/153.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.500 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.203+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/108.out auth v572 ap=1 s=51 n(v0 rc2024-09-19T09:20:29.610962+0000 b51 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b3:[<0x100000006d6/108.out v324>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007b3:[<0x100000006d6/108.out v572>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.500 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.203+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/236.out auth v606 ap=1 s=36 n(v0 rc2024-09-19T09:20:29.921959+0000 b36 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4f2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b3:[<0x100000006d6/236.out v402>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008b3:[<0x100000006d6/236.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.500 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.203+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000767 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/070.out auth v582 ap=1 s=25 n(v0 rc2024-09-19T09:20:27.489986+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000767:[<0x100000006d6/070.out v290>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000767:[<0x100000006d6/070.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.500 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.204+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/239.out auth v594 ap=1 s=43 n(v0 rc2024-09-19T09:20:29.928959+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b9:[<0x100000006d6/239.out v404>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008b9:[<0x100000006d6/239.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.500 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.204+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000abf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/506.out auth v592 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.479953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d6bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000abf:[<0x100000006d6/506.out v532>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000abf:[<0x100000006d6/506.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.500 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.188+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b87 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/606.out auth v620 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.039946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b87:[<0x100000006d6/606.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b87:[<0x100000006d6/606.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.501 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.188+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/230.out auth v618 ap=1 s=844 n(v0 rc2024-09-19T09:20:29.907959+0000 b844 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a7:[<0x100000006d6/230.out v396>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008a7:[<0x100000006d6/230.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.501 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.205+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/651.out auth v636 ap=1 s=112 n(v0 rc2024-09-19T09:20:31.156945+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be1:[<0x100000006d6/651.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000be1:[<0x100000006d6/651.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.501 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.205+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c33 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/692.out auth v604 ap=1 s=275 n(v0 rc2024-09-19T09:20:31.262944+0000 b275 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c33:[<0x100000006d6/692.out v578>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c33:[<0x100000006d6/692.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.501 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.206+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c7f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/730.out auth v594 ap=1 s=52 n(v0 rc2024-09-19T09:20:31.362943+0000 b52 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c7f:[<0x100000006d6/730.out v582>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c7f:[<0x100000006d6/730.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.501 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.189+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/139.out auth v604 ap=1 s=807 n(v0 rc2024-09-19T09:20:29.691961+0000 b807 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53108a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f1:[<0x100000006d6/139.out v348>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007f1:[<0x100000006d6/139.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.502 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.191+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/251.out auth v586 ap=1 s=49 n(v0 rc2024-09-19T09:20:29.955958+0000 b49 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53108bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d1:[<0x100000006d6/251.out v408>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008d1:[<0x100000006d6/251.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.502 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.192+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a9f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/490.out auth v616 ap=1 s=25 n(v0 rc2024-09-19T09:20:30.447953+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53108c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a9f:[<0x100000006d6/490.out v528>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a9f:[<0x100000006d6/490.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.502 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.206+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ed [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/137.out auth v614 ap=1 s=255 n(v0 rc2024-09-19T09:20:29.687961+0000 b255 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ed:[<0x100000006d6/137.out v346>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007ed:[<0x100000006d6/137.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.504 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.206+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b5d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/585.out auth v642 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d18b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b5d:[<0x100000006d6/585.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b5d:[<0x100000006d6/585.out v642>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.504 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.207+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aab [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/496.out auth v618 ap=1 s=51 n(v0 rc2024-09-19T09:20:30.459953+0000 b51 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aab:[<0x100000006d6/496.out v530>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aab:[<0x100000006d6/496.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.504 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.192+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c31 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/691.out auth v608 ap=1 s=850 n(v0 rc2024-09-19T09:20:31.260944+0000 b850 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53108cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c31:[<0x100000006d6/691.out v570>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c31:[<0x100000006d6/691.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.505 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.192+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b21 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/555.out auth v598 ap=1 s=339 n(v0 b339 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53108d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b21:[<0x100000006d6/555.out v550>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b21:[<0x100000006d6/555.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.505 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.193+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/099.out auth v602 ap=1 s=6887 n(v0 rc2024-09-19T09:20:29.584963+0000 b6887 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531024000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a1:[<0x100000006d6/099.out v320>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007a1:[<0x100000006d6/099.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.505 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.208+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000893 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/220.out auth v624 ap=1 s=112 n(v0 rc2024-09-19T09:20:29.884959+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d18b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000893:[<0x100000006d6/220.out v386>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000893:[<0x100000006d6/220.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.505 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.208+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/358.out auth v598 ap=1 s=4176 n(v0 rc2024-09-19T09:20:30.176956+0000 b4176 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a7:[<0x100000006d6/358.out v468>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009a7:[<0x100000006d6/358.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.505 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.193+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000911 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/283.out auth v626 ap=1 s=320 n(v0 rc2024-09-19T09:20:30.027958+0000 b320 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531025b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000911:[<0x100000006d6/283.out v422>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000911:[<0x100000006d6/283.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.506 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.194+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b43 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/572.out auth v606 ap=1 s=2136 n(v0 rc2024-09-19T09:20:30.907948+0000 b2136 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531026100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b43:[<0x100000006d6/572.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b43:[<0x100000006d6/572.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.506 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.209+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/129.out auth v628 ap=1 s=25 n(v0 rc2024-09-19T09:20:29.670962+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007dd:[<0x100000006d6/129.out v336>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007dd:[<0x100000006d6/129.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.506 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.209+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a67 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/462.out auth v588 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.378954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d4b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a67:[<0x100000006d6/462.out v512>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a67:[<0x100000006d6/462.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.506 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.209+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/639.out auth v592 ap=1 s=157 n(v0 rc2024-09-19T09:20:31.105946+0000 b157 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d278580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc9:[<0x100000006d6/639.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bc9:[<0x100000006d6/639.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.506 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.194+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c83 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/732.out auth v610 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.366943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531026c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c83:[<0x100000006d6/732.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c83:[<0x100000006d6/732.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.507 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.194+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b31 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/563.out auth v592 ap=1 s=250 n(v0 rc2024-09-19T09:20:30.888948+0000 b250 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531026680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b31:[<0x100000006d6/563.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b31:[<0x100000006d6/563.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.507 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.194+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/177.out auth v590 ap=1 s=451 n(v0 rc2024-09-19T09:20:29.775960+0000 b451 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c531027180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083d:[<0x100000006d6/177.out v364>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000083d:[<0x100000006d6/177.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.507 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.209+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a37 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/438.out auth v606 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.324954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d278b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a37:[<0x100000006d6/438.out v498>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a37:[<0x100000006d6/438.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.507 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.210+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/135.out auth v596 ap=1 s=257 n(v0 rc2024-09-19T09:20:29.683961+0000 b257 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d279b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e9:[<0x100000006d6/135.out v340>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007e9:[<0x100000006d6/135.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.508 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.211+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b5f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/586.out auth v608 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.958947+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d27a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b5f:[<0x100000006d6/586.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b5f:[<0x100000006d6/586.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.508 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.212+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a5f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/458.out auth v600 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.367954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d27b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a5f:[<0x100000006d6/458.out v508>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a5f:[<0x100000006d6/458.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.508 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.212+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/602.out auth v644 ap=1 s=175 n(v0 rc2024-09-19T09:20:31.014947+0000 b175 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d518000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7f:[<0x100000006d6/602.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b7f:[<0x100000006d6/602.out v644>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.508 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.196+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c39 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/695.out auth v636 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.268944+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c39:[<0x100000006d6/695.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c39:[<0x100000006d6/695.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.508 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.196+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/145.out auth v582 ap=1 s=945 n(v0 rc2024-09-19T09:20:29.704961+0000 b945 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fd:[<0x100000006d6/145.out v352>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007fd:[<0x100000006d6/145.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.509 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.212+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000939 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/303.out auth v590 ap=1 s=605 n(v0 rc2024-09-19T09:20:30.067957+0000 b605 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d518580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000939:[<0x100000006d6/303.out v438>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000939:[<0x100000006d6/303.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.509 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.212+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000753 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/060.out auth v616 ap=1 s=1839 n(v0 rc2024-09-19T09:20:27.470986+0000 b1839 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d27b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000753:[<0x100000006d6/060.out v250>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000753:[<0x100000006d6/060.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.509 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.213+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b73 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/596.out auth v646 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.978947+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d519080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b73:[<0x100000006d6/596.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b73:[<0x100000006d6/596.out v646>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.509 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.196+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a77 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/470.out auth v622 ap=1 s=47 n(v0 rc2024-09-19T09:20:30.402954+0000 b47 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53116c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a77:[<0x100000006d6/470.out v496>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a77:[<0x100000006d6/470.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.509 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.197+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f6 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/016.out auth v602 ap=1 s=1216 n(v0 rc2024-09-19T09:20:27.390987+0000 b1216 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53116d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f6:[<0x100000006d6/016.out v64>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006f6:[<0x100000006d6/016.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.509 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.198+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000881 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/211.out auth v628 ap=1 s=69 n(v0 rc2024-09-19T09:20:29.864959+0000 b69 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53116ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000881:[<0x100000006d6/211.out v356>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000881:[<0x100000006d6/211.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.510 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.213+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000afb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/536.out auth v590 ap=1 s=39 n(v0 rc2024-09-19T09:20:30.542952+0000 b39 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d519600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000afb:[<0x100000006d6/536.out v544>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000afb:[<0x100000006d6/536.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.510 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.213+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/660.out auth v626 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.173945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d51a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf3:[<0x100000006d6/660.out v572>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bf3:[<0x100000006d6/660.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.510 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.198+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008af [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/234.out auth v590 ap=1 s=81 n(v0 rc2024-09-19T09:20:29.916959+0000 b81 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008af:[<0x100000006d6/234.out v370>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008af:[<0x100000006d6/234.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.510 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.198+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/152.out auth v588 ap=1 s=275 n(v0 rc2024-09-19T09:20:29.719961+0000 b275 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080b:[<0x100000006d6/152.out v330>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000080b:[<0x100000006d6/152.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.510 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.198+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b75 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/597.out auth v596 ap=1 s=516 n(v0 b516 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b75:[<0x100000006d6/597.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b75:[<0x100000006d6/597.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.511 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.214+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/398.out auth v612 ap=1 s=1054 n(v0 rc2024-09-19T09:20:30.241955+0000 b1054 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e7:[<0x100000006d6/398.out v480>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009e7:[<0x100000006d6/398.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.511 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.214+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008eb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/264.out auth v596 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.987958+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008eb:[<0x100000006d6/264.out v414>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008eb:[<0x100000006d6/264.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.511 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.214+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000769 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/071.out auth v584 ap=1 s=274 n(v0 rc2024-09-19T09:20:27.491986+0000 b274 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d51b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000769:[<0x100000006d6/071.out v294>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000769:[<0x100000006d6/071.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.511 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.200+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007db [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/128.out auth v598 ap=1 s=25 n(v0 rc2024-09-19T09:20:29.668962+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007db:[<0x100000006d6/128.out v326>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007db:[<0x100000006d6/128.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.511 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.200+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c19 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/679.out auth v632 ap=1 s=731 n(v0 rc2024-09-19T09:20:31.235944+0000 b731 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c19:[<0x100000006d6/679.out v572>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c19:[<0x100000006d6/679.out v632>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.512 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.215+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000732 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/045.out auth v580 ap=1 s=25 n(v0 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000732:[<0x100000006d6/045.out v184>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000732:[<0x100000006d6/045.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.512 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.215+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/592.out auth v620 ap=1 s=175 n(v0 b175 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b6b:[<0x100000006d6/592.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b6b:[<0x100000006d6/592.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.512 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.215+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000738 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/048.out auth v594 ap=1 s=25 n(v0 rc2024-09-19T09:20:27.446986+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000738:[<0x100000006d6/048.out v196>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000738:[<0x100000006d6/048.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.512 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.215+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/142.out auth v582 ap=1 s=298 n(v0 rc2024-09-19T09:20:29.697961+0000 b298 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f7:[<0x100000006d6/142.out v350>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007f7:[<0x100000006d6/142.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.512 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.216+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000089f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/226.out auth v598 ap=1 s=202 n(v0 rc2024-09-19T09:20:29.898959+0000 b202 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000089f:[<0x100000006d6/226.out v390>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000089f:[<0x100000006d6/226.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.513 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.200+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/389.out auth v630 ap=1 s=214 n(v0 rc2024-09-19T09:20:30.223955+0000 b214 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009d5:[<0x100000006d6/389.out v452>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009d5:[<0x100000006d6/389.out v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.513 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.202+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/426.out auth v592 ap=1 s=174 n(v0 rc2024-09-19T09:20:30.299955+0000 b174 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c53112d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a1f:[<0x100000006d6/426.out v472>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a1f:[<0x100000006d6/426.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.513 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.202+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/252.out auth v586 ap=1 s=291 n(v0 rc2024-09-19T09:20:29.957958+0000 b291 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d3:[<0x100000006d6/252.out v380>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008d3:[<0x100000006d6/252.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.513 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.216+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/638.out auth v628 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.103946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc7:[<0x100000006d6/638.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bc7:[<0x100000006d6/638.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.513 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.217+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ea [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/010.out auth v592 ap=1 s=795 n(v0 rc2024-09-19T09:20:27.379987+0000 b795 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ea:[<0x100000006d6/010.out v40>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006ea:[<0x100000006d6/010.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.513 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.217+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000781 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/083.out auth v610 ap=1 s=105 n(v0 rc2024-09-19T09:20:29.528963+0000 b105 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000781:[<0x100000006d6/083.out v308>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000781:[<0x100000006d6/083.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.514 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.203+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/690.out auth v638 ap=1 s=66 n(v0 b66 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5310c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2f:[<0x100000006d6/690.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c2f:[<0x100000006d6/690.out v638>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.514 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.203+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/533.out auth v614 ap=1 s=1930 n(v0 rc2024-09-19T09:20:30.535952+0000 b1930 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f95b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af5:[<0x100000006d6/533.out v510>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000af5:[<0x100000006d6/533.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.514 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.203+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000921 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/291.out auth v586 ap=1 s=496 n(v0 rc2024-09-19T09:20:30.043957+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f96680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000921:[<0x100000006d6/291.out v402>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000921:[<0x100000006d6/291.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.514 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.217+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/649.out auth v616 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d64d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdd:[<0x100000006d6/649.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bdd:[<0x100000006d6/649.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.514 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.218+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/330.out auth v624 ap=1 s=373 n(v0 rc2024-09-19T09:20:30.120957+0000 b373 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096f:[<0x100000006d6/330.out v458>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000096f:[<0x100000006d6/330.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.514 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.218+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/608.out auth v614 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.043946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8b:[<0x100000006d6/608.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b8b:[<0x100000006d6/608.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.515 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.204+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b57 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/582.out auth v602 ap=1 s=160 n(v0 rc2024-09-19T09:20:30.950947+0000 b160 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f5e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b57:[<0x100000006d6/582.out v530>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b57:[<0x100000006d6/582.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.515 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.204+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c69 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/719.out auth v638 ap=1 s=1593 n(v0 rc2024-09-19T09:20:31.341943+0000 b1593 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c69:[<0x100000006d6/719.out v578>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c69:[<0x100000006d6/719.out v638>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.515 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.218+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ee [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/012.out auth v588 ap=1 s=1216 n(v0 b1216 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ee:[<0x100000006d6/012.out v48>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006ee:[<0x100000006d6/012.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.515 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.219+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006dc [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/003.out auth v592 ap=1 s=43 n(v0 rc2024-09-19T09:20:27.367987+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d264680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006dc:[<0x100000006d6/003.out v12>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006dc:[<0x100000006d6/003.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.516 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.204+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a2f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/434.out auth v634 ap=1 s=499 n(v0 rc2024-09-19T09:20:30.317954+0000 b499 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f5eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a2f:[<0x100000006d6/434.out v456>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a2f:[<0x100000006d6/434.out v634>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.516 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.205+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000969 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/327.out auth v616 ap=1 s=317 n(v0 rc2024-09-19T09:20:30.115957+0000 b317 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f60680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000969:[<0x100000006d6/327.out v418>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000969:[<0x100000006d6/327.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.517 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.205+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b95 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/613.out auth v618 ap=1 s=426 n(v0 rc2024-09-19T09:20:31.052946+0000 b426 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f60c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b95:[<0x100000006d6/613.out v546>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b95:[<0x100000006d6/613.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.517 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.219+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ad5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/517.out auth v594 ap=1 s=1591 n(v0 rc2024-09-19T09:20:30.502952+0000 b1591 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d264c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ad5:[<0x100000006d6/517.out v522>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ad5:[<0x100000006d6/517.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.518 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.219+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ed [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/265.out auth v602 ap=1 s=312 n(v0 rc2024-09-19T09:20:29.989958+0000 b312 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d263600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ed:[<0x100000006d6/265.out v392>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008ed:[<0x100000006d6/265.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.518 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.220+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a57 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454.out auth v618 ap=1 s=123 n(v0 rc2024-09-19T09:20:30.358954+0000 b123 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d042000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a57:[<0x100000006d6/454.out v486>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a57:[<0x100000006d6/454.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.518 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.220+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a85 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/477.out auth v628 ap=1 s=185 n(v0 b185 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d042b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a85:[<0x100000006d6/477.out v504>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a85:[<0x100000006d6/477.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.518 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.220+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/314.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.088957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d056000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094f:[<0x100000006d6/314.out v418>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000094f:[<0x100000006d6/314.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.518 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.220+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b07 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/542.out auth v636 ap=1 s=622 n(v0 rc2024-09-19T09:20:30.554952+0000 b622 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d043b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b07:[<0x100000006d6/542.out v544>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b07:[<0x100000006d6/542.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.518 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.205+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/395.out auth v630 ap=1 s=1829 n(v0 rc2024-09-19T09:20:30.235955+0000 b1829 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e1:[<0x100000006d6/395.out v440>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009e1:[<0x100000006d6/395.out v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.519 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.206+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a43 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/444.out auth v624 ap=1 s=47 n(v0 rc2024-09-19T09:20:30.337954+0000 b47 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311d0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a43:[<0x100000006d6/444.out v462>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a43:[<0x100000006d6/444.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.519 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.207+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a07 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/414.out auth v590 ap=1 s=397 n(v0 rc2024-09-19T09:20:30.274955+0000 b397 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a07:[<0x100000006d6/414.out v450>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a07:[<0x100000006d6/414.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.520 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.221+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000815 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/157.out auth v626 ap=1 s=725 n(v0 rc2024-09-19T09:20:29.730961+0000 b725 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000815:[<0x100000006d6/157.out v332>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000815:[<0x100000006d6/157.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.520 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.221+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b6f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/594.out auth v652 ap=1 s=2008 n(v0 rc2024-09-19T09:20:30.973947+0000 b2008 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d057600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b6f:[<0x100000006d6/594.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b6f:[<0x100000006d6/594.out v652>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.521 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.208+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b9f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/618.out auth v600 ap=1 s=670 n(v0 rc2024-09-19T09:20:31.062946+0000 b670 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b9f:[<0x100000006d6/618.out v548>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b9f:[<0x100000006d6/618.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.521 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.208+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b35 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/565.out auth v592 ap=1 s=158 n(v0 rc2024-09-19T09:20:30.893948+0000 b158 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b35:[<0x100000006d6/565.out v516>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b35:[<0x100000006d6/565.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.522 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.222+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b1f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/554.out auth v650 ap=1 s=79 n(v0 rc2024-09-19T09:20:30.578952+0000 b79 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b1f:[<0x100000006d6/554.out v550>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b1f:[<0x100000006d6/554.out v650>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.522 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.222+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b05 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/541.out auth v634 ap=1 s=752 n(v0 rc2024-09-19T09:20:30.552952+0000 b752 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b05:[<0x100000006d6/541.out v540>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b05:[<0x100000006d6/541.out v634>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.522 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.222+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a39 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/439.out auth v620 ap=1 s=1145 n(v0 rc2024-09-19T09:20:30.327954+0000 b1145 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a39:[<0x100000006d6/439.out v476>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a39:[<0x100000006d6/439.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.523 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.209+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a89 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/479.out auth v598 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.425953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a89:[<0x100000006d6/479.out v482>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a89:[<0x100000006d6/479.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.523 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.210+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/511.out auth v628 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.490953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c5311d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac9:[<0x100000006d6/511.out v498>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ac9:[<0x100000006d6/511.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.523 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.211+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a25 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/429.out auth v622 ap=1 s=1186 n(v0 rc2024-09-19T09:20:30.306955+0000 b1186 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a25:[<0x100000006d6/429.out v454>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a25:[<0x100000006d6/429.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.524 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.222+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/652.out auth v644 ap=1 s=112 n(v0 rc2024-09-19T09:20:31.158945+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be3:[<0x100000006d6/652.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000be3:[<0x100000006d6/652.out v644>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.524 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.223+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c37 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/694.out auth v610 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.266944+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c37:[<0x100000006d6/694.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c37:[<0x100000006d6/694.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.524 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.223+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a5d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/457.out auth v632 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.364954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a5d:[<0x100000006d6/457.out v490>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a5d:[<0x100000006d6/457.out v632>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.524 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.223+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/399.out auth v606 ap=1 s=76 n(v0 rc2024-09-19T09:20:30.243955+0000 b76 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e9:[<0x100000006d6/399.out v458>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009e9:[<0x100000006d6/399.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.525 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.224+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/126.out auth v582 ap=1 s=1066 n(v0 rc2024-09-19T09:20:29.663962+0000 b1066 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d20d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d7:[<0x100000006d6/126.out v324>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007d7:[<0x100000006d6/126.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.525 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.212+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/039.out auth v772 ap=1 s=25 n(v0 b25 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530b98680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f5:[<0x100000003a7/039.out v156>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003f5:[<0x100000003a7/039.out v772>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.525 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.212+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/038.out auth v742 ap=1 s=424 n(v0 rc2024-09-19T09:20:04.475240+0000 b424 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530b99180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f3:[<0x100000003a7/038.out v152>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003f3:[<0x100000003a7/038.out v742>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.525 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.214+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/030.out auth v814 ap=1 s=25 n(v0 b25 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530c47600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e3:[<0x100000003a7/030.out v120>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003e3:[<0x100000003a7/030.out v814>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.526 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.224+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008dd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/257.out auth v616 ap=1 s=34 n(v0 rc2024-09-19T09:20:29.970958+0000 b34 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008dd:[<0x100000006d6/257.out v384>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008dd:[<0x100000006d6/257.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.526 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.224+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000845 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/181.out auth v608 ap=1 s=257 n(v0 rc2024-09-19T09:20:29.787960+0000 b257 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000845:[<0x100000006d6/181.out v342>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000845:[<0x100000006d6/181.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.526 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.225+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/689.out auth v646 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.255944+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2d:[<0x100000006d6/689.out v572>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c2d:[<0x100000006d6/689.out v646>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.527 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.221+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000431 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/069.out auth v764 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.522240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530c7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000431:[<0x100000003a7/069.out v276>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000431:[<0x100000003a7/069.out v764>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.527 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.221+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/020.out auth v758 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.436241+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530c80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cf:[<0x100000003a7/020.out v80>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003cf:[<0x100000003a7/020.out v758>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.528 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.225+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ab3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/500.out auth v640 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.467953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ab3:[<0x100000006d6/500.out v514>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ab3:[<0x100000006d6/500.out v640>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.528 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.225+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/064.out auth v638 ap=1 s=64 n(v0 rc2024-09-19T09:20:27.478986+0000 b64 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075b:[<0x100000006d6/064.out v266>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000075b:[<0x100000006d6/064.out v638>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.528 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.223+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000043b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/074.out auth v800 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.530240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530c8b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000043b:[<0x100000003a7/074.out v296>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000043b:[<0x100000003a7/074.out v800>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.528 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.224+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000040d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/051.out auth v836 ap=1 s=25 n(v0 rc2024-09-19T09:20:04.495240+0000 b25 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530c97080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000040d:[<0x100000003a7/051.out v204>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000040d:[<0x100000003a7/051.out v836>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.529 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.225+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/007.out auth v870 ap=1 s=58 n(v0 rc2024-09-19T09:20:04.414241+0000 b58 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530c99180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b5:[<0x100000003a7/007.out v28>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003b5:[<0x100000003a7/007.out v870>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.530 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.227+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b3b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/568.out auth v642 ap=1 s=148 n(v0 rc2024-09-19T09:20:30.899948+0000 b148 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b3b:[<0x100000006d6/568.out v554>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b3b:[<0x100000006d6/568.out v642>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.530 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.227+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/655.out auth v600 ap=1 s=1170 n(v0 rc2024-09-19T09:20:31.163945+0000 b1170 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d59f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be9:[<0x100000006d6/655.out v570>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000be9:[<0x100000006d6/655.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.530 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.227+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a83 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/476.out auth v592 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.419953+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d003080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a83:[<0x100000006d6/476.out v478>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a83:[<0x100000006d6/476.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.530 INFO:tasks.workunit.client.0.smithi046.stdout:checking for suffix of executables... 2024-09-19T09:20:48.531 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.226+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/068.out auth v658 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.521240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042f:[<0x100000003a7/068.out v272>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000042f:[<0x100000003a7/068.out v658>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.531 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.227+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000423 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/062.out auth v718 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000423:[<0x100000003a7/062.out v248>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000423:[<0x100000003a7/062.out v718>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.531 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.229+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000042b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/066.out auth v630 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.518240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cb8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000042b:[<0x100000003a7/066.out v264>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000042b:[<0x100000003a7/066.out v630>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.532 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.228+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000961 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/323.out auth v612 ap=1 s=288 n(v0 rc2024-09-19T09:20:30.107957+0000 b288 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf89700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000961:[<0x100000006d6/323.out v416>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000961:[<0x100000006d6/323.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.532 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.228+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/636.out auth v600 ap=1 s=50 n(v0 rc2024-09-19T09:20:31.098946+0000 b50 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf88c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc3:[<0x100000006d6/636.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bc3:[<0x100000006d6/636.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.532 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.229+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000841 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/179.out auth v614 ap=1 s=462 n(v0 rc2024-09-19T09:20:29.781960+0000 b462 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000841:[<0x100000006d6/179.out v352>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000841:[<0x100000006d6/179.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.532 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.230+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000409 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/049.out auth v902 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.492240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cb8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000409:[<0x100000003a7/049.out v196>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000409:[<0x100000003a7/049.out v902>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.532 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.231+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000413 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/054.out auth v700 ap=1 s=25 n(v0 b25 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cc4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000413:[<0x100000003a7/054.out v216>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000413:[<0x100000003a7/054.out v700>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.533 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.230+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c23 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/684.out auth v608 ap=1 s=1058 n(v0 rc2024-09-19T09:20:31.245944+0000 b1058 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cfa6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c23:[<0x100000006d6/684.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c23:[<0x100000006d6/684.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.534 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.230+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/162.out auth v590 ap=1 s=107 n(v0 rc2024-09-19T09:20:29.739961+0000 b107 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081f:[<0x100000006d6/162.out v342>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000081f:[<0x100000006d6/162.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.534 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.231+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a31 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/435.out auth v606 ap=1 s=104 n(v0 rc2024-09-19T09:20:30.319954+0000 b104 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a31:[<0x100000006d6/435.out v458>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a31:[<0x100000006d6/435.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.534 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.231+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ad [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/233.out auth v624 ap=1 s=96 n(v0 rc2024-09-19T09:20:29.914959+0000 b96 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20cf7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ad:[<0x100000006d6/233.out v364>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008ad:[<0x100000006d6/233.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.534 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.232+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c91 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/739.out auth v602 ap=1 s=324 n(v0 rc2024-09-19T09:20:31.378943+0000 b324 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d546c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c91:[<0x100000006d6/739.out v578>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c91:[<0x100000006d6/739.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.534 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.233+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000411 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/053.out auth v756 ap=1 s=25 n(v0 rc2024-09-19T09:20:04.498240+0000 b25 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000411:[<0x100000003a7/053.out v212>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000411:[<0x100000003a7/053.out v756>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.534 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.235+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000421 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/061.out auth v614 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.510240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cd4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000421:[<0x100000003a7/061.out v244>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000421:[<0x100000003a7/061.out v614>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.535 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.240+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ab [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/002.out auth v702 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.405241+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ab:[<0x100000003a7/002.out v8>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003ab:[<0x100000003a7/002.out v702>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.536 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.233+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c1d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/681.out auth v642 ap=1 s=118 n(v0 b118 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d547180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c1d:[<0x100000006d6/681.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c1d:[<0x100000006d6/681.out v642>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.536 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.233+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ff [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/274.out auth v590 ap=1 s=111 n(v0 rc2024-09-19T09:20:30.008958+0000 b111 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d546100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ff:[<0x100000006d6/274.out v398>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008ff:[<0x100000006d6/274.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.536 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.233+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000993 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/348.out auth v616 ap=1 s=94 n(v0 rc2024-09-19T09:20:30.156956+0000 b94 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000993:[<0x100000006d6/348.out v426>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000993:[<0x100000006d6/348.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.536 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.243+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ef [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/036.out auth v832 ap=1 s=54 n(v0 rc2024-09-19T09:20:04.472240+0000 b54 1=1+0) caps={24851=pAsLsXsFscr/-@1} | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55c530cf7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ef:[<0x100000003a7/036.out v144>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003ef:[<0x100000003a7/036.out v832>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.537 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.244+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/009.out auth v346 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.437942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c48100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccd:[<0x10000000cbb/009.out v36>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ccd:[<0x10000000cbb/009.out v346>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.537 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.245+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/022.out auth v336 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c89600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce7:[<0x10000000cbb/022.out v88>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ce7:[<0x10000000cbb/022.out v336>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.537 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.234+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b65 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/589.out auth v604 ap=1 s=7191 n(v0 rc2024-09-19T09:20:30.964947+0000 b7191 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b65:[<0x100000006d6/589.out v534>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b65:[<0x100000006d6/589.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.538 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.234+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bfd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/665.out auth v592 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.183945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bfd:[<0x100000006d6/665.out v572>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bfd:[<0x100000006d6/665.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.538 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.245+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d73 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/105.out auth v338 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.470931+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c49180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d73:[<0x10000000cbb/105.out v314>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d73:[<0x10000000cbb/105.out v338>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.538 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.245+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/111.out auth v370 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.481931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ccc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7f:[<0x10000000cbb/111.out v320>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d7f:[<0x10000000cbb/111.out v370>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.539 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.234+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/041.out auth v622 ap=1 s=54 n(v0 rc2024-09-19T09:20:27.434986+0000 b54 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072a:[<0x100000006d6/041.out v168>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000072a:[<0x100000006d6/041.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.539 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.235+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/240.out auth v594 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.930959+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bb:[<0x100000006d6/240.out v372>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008bb:[<0x100000006d6/240.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.540 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.235+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/492.out auth v636 ap=1 s=276 n(v0 rc2024-09-19T09:20:30.451953+0000 b276 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa3:[<0x100000006d6/492.out v490>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aa3:[<0x100000006d6/492.out v636>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.540 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.235+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000071a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/034.out auth v640 ap=1 s=43 n(v0 rc2024-09-19T09:20:27.421986+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000071a:[<0x100000006d6/034.out v136>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000071a:[<0x100000006d6/034.out v640>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.540 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.235+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008b1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/235.out auth v608 ap=1 s=1591 n(v0 rc2024-09-19T09:20:29.919959+0000 b1591 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008b1:[<0x100000006d6/235.out v366>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008b1:[<0x100000006d6/235.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.540 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.236+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008fb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/272.out auth v588 ap=1 s=313 n(v0 rc2024-09-19T09:20:30.004958+0000 b313 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008fb:[<0x100000006d6/272.out v392>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008fb:[<0x100000006d6/272.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.540 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.246+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/006.out auth v326 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.431942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c47b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc7:[<0x10000000cbb/006.out v24>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cc7:[<0x10000000cbb/006.out v326>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.540 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.247+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d89 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/116.out auth v378 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.491930+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ccd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d89:[<0x10000000cbb/116.out v322>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d89:[<0x10000000cbb/116.out v378>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.541 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.247+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/029.out auth v344 ap=1 s=41 n(v0 rc2024-09-19T09:20:31.474942+0000 b41 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530caec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf5:[<0x10000000cbb/029.out v116>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cf5:[<0x10000000cbb/029.out v344>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.541 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.236+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000734 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/046.out auth v620 ap=1 s=25 n(v0 rc2024-09-19T09:20:27.442986+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d5f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000734:[<0x100000006d6/046.out v188>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000734:[<0x100000006d6/046.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.541 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.236+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a56 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454 auth v630 ap=1 s=8412 n(v0 rc2024-09-19T09:20:30.357954+0000 b8412 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d166000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a56:[<0x100000006d6/454 v466>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a56:[<0x100000006d6/454 v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.542 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.248+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cdd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/017.out auth v350 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.452942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cdd:[<0x10000000cbb/017.out v68>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cdd:[<0x10000000cbb/017.out v350>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.542 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.248+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d57 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/078.out auth v330 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.443931+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d57:[<0x10000000cbb/078.out v306>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d57:[<0x10000000cbb/078.out v330>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.543 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.236+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a69 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/463.out auth v618 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.381954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d166580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a69:[<0x100000006d6/463.out v470>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a69:[<0x100000006d6/463.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.543 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.237+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fa [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/018.out auth v584 ap=1 s=405 n(v0 rc2024-09-19T09:20:27.394987+0000 b405 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d166b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fa:[<0x100000006d6/018.out v72>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006fa:[<0x100000006d6/018.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.543 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.237+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/043.out auth v634 ap=1 s=25 n(v0 rc2024-09-19T09:20:27.437986+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d167080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072e:[<0x100000006d6/043.out v176>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000072e:[<0x100000006d6/043.out v634>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.543 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.248+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d2f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/058.out auth v352 ap=1 s=505 n(v0 rc2024-09-19T09:20:31.527941+0000 b505 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ae5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d2f:[<0x10000000cbb/058.out v232>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d2f:[<0x10000000cbb/058.out v352>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.543 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.249+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d19 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/047.out auth v388 ap=1 s=182 n(v0 rc2024-09-19T09:20:31.506941+0000 b182 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d19:[<0x10000000cbb/047.out v188>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d19:[<0x10000000cbb/047.out v388>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.544 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.250+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/031.out auth v382 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.477942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c96580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf9:[<0x10000000cbb/031.out v124>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cf9:[<0x10000000cbb/031.out v382>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.545 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.237+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c4f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/706.out auth v614 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.315943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d167b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c4f:[<0x100000006d6/706.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c4f:[<0x100000006d6/706.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.545 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.238+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b41 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/571.out auth v626 ap=1 s=34 n(v0 rc2024-09-19T09:20:30.905948+0000 b34 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d168c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b41:[<0x100000006d6/571.out v522>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b41:[<0x100000006d6/571.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.545 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.250+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d3d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/065.out auth v340 ap=1 s=884 n(v0 rc2024-09-19T09:20:31.539941+0000 b884 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c54c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d3d:[<0x10000000cbb/065.out v260>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d3d:[<0x10000000cbb/065.out v340>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.545 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.250+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/021.out auth v334 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.459942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c52000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce5:[<0x10000000cbb/021.out v84>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ce5:[<0x10000000cbb/021.out v334>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.545 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.251+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/015.out auth v360 ap=1 s=110 n(v0 rc2024-09-19T09:20:31.448942+0000 b110 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c52580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd9:[<0x10000000cbb/015.out v60>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cd9:[<0x10000000cbb/015.out v360>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.546 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.238+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c95 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/741.out auth v624 ap=1 s=175 n(v0 rc2024-09-19T09:20:31.382943+0000 b175 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d169700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c95:[<0x100000006d6/741.out v580>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c95:[<0x100000006d6/741.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.546 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.272+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/050.out auth v328 ap=1 s=1423 n(v0 rc2024-09-19T09:20:31.512941+0000 b1423 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1f:[<0x10000000cbb/050.out v200>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d1f:[<0x10000000cbb/050.out v328>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.546 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.272+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/001.out auth v330 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.423942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbd:[<0x10000000cbb/001.out v4>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cbd:[<0x10000000cbb/001.out v330>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.547 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.251+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d43 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/068.out auth v354 ap=1 s=2711 n(v0 rc2024-09-19T09:20:31.544941+0000 b2711 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c5c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d43:[<0x10000000cbb/068.out v272>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d43:[<0x10000000cbb/068.out v354>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.547 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.251+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/007.out auth v372 ap=1 s=38 n(v0 b38 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c5f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc9:[<0x10000000cbb/007.out v28>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cc9:[<0x10000000cbb/007.out v372>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.551 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.273+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d85 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/114.out auth v336 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.486930+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d85:[<0x10000000cbb/114.out v316>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d85:[<0x10000000cbb/114.out v336>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.551 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.273+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/032.out auth v356 ap=1 s=125 n(v0 rc2024-09-19T09:20:31.479942+0000 b125 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfb:[<0x10000000cbb/032.out v128>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cfb:[<0x10000000cbb/032.out v356>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.551 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.273+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d67 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/086.out auth v322 ap=1 s=43 n(v0 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d67:[<0x10000000cbb/086.out v308>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d67:[<0x10000000cbb/086.out v322>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.551 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.273+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d71 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/104.out auth v352 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.468931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d09d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d71:[<0x10000000cbb/104.out v312>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d71:[<0x10000000cbb/104.out v352>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.551 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.273+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/033.out auth v360 ap=1 s=1377 n(v0 rc2024-09-19T09:20:31.480942+0000 b1377 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d55e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfd:[<0x10000000cbb/033.out v132>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cfd:[<0x10000000cbb/033.out v360>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.552 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.252+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/082.out auth v376 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.452931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5f:[<0x10000000cbb/082.out v310>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d5f:[<0x10000000cbb/082.out v376>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.552 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.252+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d37 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/062.out auth v334 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.534941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d37:[<0x10000000cbb/062.out v248>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d37:[<0x10000000cbb/062.out v334>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.552 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.252+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d3f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/066.out auth v342 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cc3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d3f:[<0x10000000cbb/066.out v264>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d3f:[<0x10000000cbb/066.out v342>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.553 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.274+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d51 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/075.out auth v324 ap=1 s=342 n(v0 rc2024-09-19T09:20:31.558941+0000 b342 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d560100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d51:[<0x10000000cbb/075.out v300>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d51:[<0x10000000cbb/075.out v324>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.553 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.274+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/028.out auth v326 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.472942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d560c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf3:[<0x10000000cbb/028.out v112>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cf3:[<0x10000000cbb/028.out v326>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.553 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:20:48.274+0000 7ff061afe640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d31 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/059.out auth v348 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.529941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f20d561700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d31:[<0x10000000cbb/059.out v236>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d31:[<0x10000000cbb/059.out v348>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v78>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.558 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.253+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/049.out auth v348 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.510941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cc4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1d:[<0x10000000cbb/049.out v196>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d1d:[<0x10000000cbb/049.out v348>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.558 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.253+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d65 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/085.out auth v394 ap=1 s=1385 n(v0 rc2024-09-19T09:20:32.458931+0000 b1385 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cc2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d65:[<0x10000000cbb/085.out v314>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d65:[<0x10000000cbb/085.out v394>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.558 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.253+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d27 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/054.out auth v390 ap=1 s=671 n(v0 b671 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d27:[<0x10000000cbb/054.out v216>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d27:[<0x10000000cbb/054.out v390>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.558 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.254+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d25 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/053.out auth v384 ap=1 s=1304 n(v0 rc2024-09-19T09:20:31.518941+0000 b1304 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d25:[<0x10000000cbb/053.out v212>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d25:[<0x10000000cbb/053.out v384>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.558 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.254+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d59 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/079.out auth v352 ap=1 s=1385 n(v0 rc2024-09-19T09:20:32.445931+0000 b1385 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c7eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d59:[<0x10000000cbb/079.out v304>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d59:[<0x10000000cbb/079.out v352>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.255+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d63 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/084.out auth v336 ap=1 s=1699 n(v0 rc2024-09-19T09:20:32.456931+0000 b1699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c80100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d63:[<0x10000000cbb/084.out v312>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d63:[<0x10000000cbb/084.out v336>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.255+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d35 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/061.out auth v346 ap=1 s=198 n(v0 rc2024-09-19T09:20:31.532941+0000 b198 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d35:[<0x10000000cbb/061.out v244>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d35:[<0x10000000cbb/061.out v346>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.255+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/080.out auth v396 ap=1 s=118 n(v0 rc2024-09-19T09:20:32.447931+0000 b118 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530c81700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5b:[<0x10000000cbb/080.out v308>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d5b:[<0x10000000cbb/080.out v396>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.257+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/Makefile auth v364 ap=1 s=513 n(v0 rc2024-09-19T09:20:32.494930+0000 b513 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cb9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8c:[<0x10000000cbb/Makefile v328>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d8c:[<0x10000000cbb/Makefile v364>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.257+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/002.out auth v340 ap=1 s=120 n(v0 b120 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530b97b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbf:[<0x10000000cbb/002.out v8>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cbf:[<0x10000000cbb/002.out v340>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.257+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d6b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/101.out auth v382 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.463931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530b97600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d6b:[<0x10000000cbb/101.out v318>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d6b:[<0x10000000cbb/101.out v382>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.257+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d03 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/036.out auth v358 ap=1 s=125 n(v0 rc2024-09-19T09:20:31.486942+0000 b125 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530cd5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d03:[<0x10000000cbb/036.out v144>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d03:[<0x10000000cbb/036.out v358>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.258+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d49 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/071.out auth v354 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.551941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f8f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d49:[<0x10000000cbb/071.out v284>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d49:[<0x10000000cbb/071.out v354>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.559 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.258+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d1b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/048.out auth v318 ap=1 s=372 n(v0 rc2024-09-19T09:20:31.508941+0000 b372 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d1b:[<0x10000000cbb/048.out v192>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d1b:[<0x10000000cbb/048.out v318>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.259+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d15 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/045.out auth v336 ap=1 s=204 n(v0 b204 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d15:[<0x10000000cbb/045.out v180>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d15:[<0x10000000cbb/045.out v336>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.259+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/010.out auth v350 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.439942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccf:[<0x10000000cbb/010.out v40>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ccf:[<0x10000000cbb/010.out v350>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.259+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cef [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/026.out auth v324 ap=1 s=77 n(v0 rc2024-09-19T09:20:31.468942+0000 b77 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cef:[<0x10000000cbb/026.out v104>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cef:[<0x10000000cbb/026.out v324>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.259+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d61 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/083.out auth v370 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.454931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d61:[<0x10000000cbb/083.out v306>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d61:[<0x10000000cbb/083.out v370>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.260+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d33 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/060.out auth v348 ap=1 s=1945 n(v0 b1945 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d33:[<0x10000000cbb/060.out v240>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d33:[<0x10000000cbb/060.out v348>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.261+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ced [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/025.out auth v332 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.466942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530f3c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ced:[<0x10000000cbb/025.out v100>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ced:[<0x10000000cbb/025.out v332>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.262+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d23 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/052.out auth v360 ap=1 s=1304 n(v0 rc2024-09-19T09:20:31.516941+0000 b1304 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d23:[<0x10000000cbb/052.out v208>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d23:[<0x10000000cbb/052.out v360>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.262+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d53 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/076.out auth v368 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.439931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d53:[<0x10000000cbb/076.out v304>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d53:[<0x10000000cbb/076.out v368>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.262+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d6f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/103.out auth v358 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.467931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d6f:[<0x10000000cbb/103.out v308>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d6f:[<0x10000000cbb/103.out v358>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.560 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.262+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/014.out auth v364 ap=1 s=48 n(v0 b48 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd7:[<0x10000000cbb/014.out v56>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cd7:[<0x10000000cbb/014.out v364>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.262+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/042.out auth v340 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.496941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0f:[<0x10000000cbb/042.out v168>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d0f:[<0x10000000cbb/042.out v340>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.262+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ceb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/024.out auth v362 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.464942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ceb:[<0x10000000cbb/024.out v96>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ceb:[<0x10000000cbb/024.out v362>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.263+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/023.out auth v328 ap=1 s=114 n(v0 b114 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ed7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce9:[<0x10000000cbb/023.out v92>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ce9:[<0x10000000cbb/023.out v328>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.263+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d79 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/108.out auth v346 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ede000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d79:[<0x10000000cbb/108.out v310>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d79:[<0x10000000cbb/108.out v346>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.263+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d47 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/070.out auth v326 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.549941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530edf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d47:[<0x10000000cbb/070.out v280>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d47:[<0x10000000cbb/070.out v326>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.264+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d05 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/037.out auth v338 ap=1 s=75 n(v0 rc2024-09-19T09:20:31.487942+0000 b75 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d05:[<0x10000000cbb/037.out v148>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d05:[<0x10000000cbb/037.out v338>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.265+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d41 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/067.out auth v350 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.542941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d41:[<0x10000000cbb/067.out v268>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d41:[<0x10000000cbb/067.out v350>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.265+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d83 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/113.out auth v330 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.484930+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d83:[<0x10000000cbb/113.out v318>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d83:[<0x10000000cbb/113.out v330>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.265+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cff [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/034.out auth v362 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.482942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cff:[<0x10000000cbb/034.out v136>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cff:[<0x10000000cbb/034.out v362>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.561 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.266+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/041.out auth v334 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530ff7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0d:[<0x10000000cbb/041.out v164>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d0d:[<0x10000000cbb/041.out v334>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.266+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d17 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/046.out auth v356 ap=1 s=233 n(v0 rc2024-09-19T09:20:31.504941+0000 b233 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fd6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d17:[<0x10000000cbb/046.out v184>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d17:[<0x10000000cbb/046.out v356>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.266+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cdf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/018.out auth v372 ap=1 s=186 n(v0 rc2024-09-19T09:20:31.453942+0000 b186 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fd6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cdf:[<0x10000000cbb/018.out v72>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cdf:[<0x10000000cbb/018.out v372>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.267+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d11 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/043.out auth v366 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.498941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fd6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d11:[<0x10000000cbb/043.out v172>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d11:[<0x10000000cbb/043.out v366>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.267+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d01 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/035.out auth v340 ap=1 s=267 n(v0 rc2024-09-19T09:20:31.484942+0000 b267 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fd7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d01:[<0x10000000cbb/035.out v140>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d01:[<0x10000000cbb/035.out v340>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.267+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d75 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/106.out auth v368 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.472931+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fd8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d75:[<0x10000000cbb/106.out v312>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d75:[<0x10000000cbb/106.out v368>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.268+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/110.out auth v324 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.479931+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fb4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7d:[<0x10000000cbb/110.out v316>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d7d:[<0x10000000cbb/110.out v324>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.268+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d0b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/040.out auth v342 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.493941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fb4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d0b:[<0x10000000cbb/040.out v160>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d0b:[<0x10000000cbb/040.out v342>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.562 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:20:48.269+0000 7f9761782640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d87 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/115.out auth v328 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.488930+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55c530fb5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d87:[<0x10000000cbb/115.out v320>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d87:[<0x10000000cbb/115.out v328>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.567 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.098+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032c [...2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/ auth v476 ap=1 f(v0 m2024-09-19T09:20:02.283264+0000 5=5+0) n(v0 rc2024-09-19T09:20:02.283264+0000 b25519 6=5+1) (inest lock) (ifile excl) caps={24851=pAsLsXsFsx/pAsLsXsFsx@1},l=24851 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000032c:[<0x100000002d9/log-writes v176>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x1000000032c:[<0x100000002d9/log-writes v476>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T09:20:02.283264+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T09:20:02.283264+0000 b25519 6=5+1)","memory_value.dirstat":"f(v0 m2024-09-19T09:20:02.283264+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-09-19T09:20:02.283264+0000 b25519 6=5+1)","error_str":""},"return_code":0} 2024-09-19T09:20:48.567 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.098+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/append_writer.c auth v428 ap=1 s=704 n(v0 b704 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f3:[<0x100000002d9/append_writer.c v372>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000002f3:[<0x100000002d9/append_writer.c v428>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.567 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.099+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/allocstale.c auth v432 ap=1 s=2334 n(v0 rc2024-09-19T09:20:02.232265+0000 b2334 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f1:[<0x100000002d9/allocstale.c v376>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000002f1:[<0x100000002d9/allocstale.c v432>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.567 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.099+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ftrunc.c auth v430 ap=1 s=1327 n(v0 b1327 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031f:[<0x100000002d9/ftrunc.c v374>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000031f:[<0x100000002d9/ftrunc.c v430>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.567 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.099+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/unwritten_mmap.c auth v426 ap=1 s=1275 n(v0 b1275 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d391700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038e:[<0x100000002d9/unwritten_mmap.c v370>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000038e:[<0x100000002d9/unwritten_mmap.c v426>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.099+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000334 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/lstat64.c auth v438 ap=1 s=3750 n(v0 rc2024-09-19T09:20:02.286264+0000 b3750 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000334:[<0x100000002d9/lstat64.c v382>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000334:[<0x100000002d9/lstat64.c v438>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.099+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000030b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/e4compact.c auth v434 ap=1 s=6752 n(v0 rc2024-09-19T09:20:02.252265+0000 b6752 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000030b:[<0x100000002d9/e4compact.c v378>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000030b:[<0x100000002d9/e4compact.c v434>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.100+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/popattr.py auth v442 ap=1 s=1657 n(v0 rc2024-09-19T09:20:02.306264+0000 b1657 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034d:[<0x100000002d9/popattr.py v386>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000034d:[<0x100000002d9/popattr.py v442>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.100+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000379 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_fallocate.c auth v444 ap=1 s=1404 n(v0 rc2024-09-19T09:20:02.341264+0000 b1404 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000379:[<0x100000002d9/t_mmap_fallocate.c v388>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000379:[<0x100000002d9/t_mmap_fallocate.c v444>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.100+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/soak_duration.awk auth v436 ap=1 s=415 n(v0 rc2024-09-19T09:20:02.320264+0000 b415 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035e:[<0x100000002d9/soak_duration.awk v380>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000035e:[<0x100000002d9/soak_duration.awk v436>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.100+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000368 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_create_short_dirs.c auth v446 ap=1 s=3131 n(v0 rc2024-09-19T09:20:02.328264+0000 b3131 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000368:[<0x100000002d9/t_create_short_dirs.c v390>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000368:[<0x100000002d9/t_create_short_dirs.c v446>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.101+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000370 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_futimens.c auth v440 ap=1 s=570 n(v0 rc2024-09-19T09:20:02.334264+0000 b570 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000370:[<0x100000002d9/t_futimens.c v384>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000370:[<0x100000002d9/t_futimens.c v440>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.101+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000030d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ext4_resize.c auth v448 ap=1 s=1391 n(v0 rc2024-09-19T09:20:02.254265+0000 b1391 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000030d:[<0x100000002d9/ext4_resize.c v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000030d:[<0x100000002d9/ext4_resize.c v448>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.568 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.101+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000372 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_getcwd.c auth v450 ap=1 s=1618 n(v0 rc2024-09-19T09:20:02.336264+0000 b1618 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000372:[<0x100000002d9/t_getcwd.c v394>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000372:[<0x100000002d9/t_getcwd.c v450>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.101+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000366 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_attr_corruption.c auth v454 ap=1 s=3272 n(v0 b3272 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000366:[<0x100000002d9/t_attr_corruption.c v398>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000366:[<0x100000002d9/t_attr_corruption.c v454>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.101+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000324 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/godown.c auth v456 ap=1 s=2084 n(v0 rc2024-09-19T09:20:02.272265+0000 b2084 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000324:[<0x100000002d9/godown.c v400>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000324:[<0x100000002d9/godown.c v456>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.101+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000390 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/uring_read_fault.c auth v479 ap=1 s=3692 n(v0 rc2024-09-19T09:20:04.366241+0000 b3692 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000390:[<0x100000002d9/uring_read_fault.c v402>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000390:[<0x100000002d9/uring_read_fault.c v479>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.102+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000378 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_dio.c auth v460 ap=1 s=2261 n(v0 b2261 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000378:[<0x100000002d9/t_mmap_dio.c v406>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000378:[<0x100000002d9/t_mmap_dio.c v460>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.102+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f8 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/bulkstat_null_ocount.c auth v458 ap=1 s=1119 n(v0 rc2024-09-19T09:20:02.237265+0000 b1119 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f8:[<0x100000002d9/bulkstat_null_ocount.c v404>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000002f8:[<0x100000002d9/bulkstat_null_ocount.c v458>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.102+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000358 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/rewinddir-test.c auth v462 ap=1 s=3700 n(v0 rc2024-09-19T09:20:02.315264+0000 b3700 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000358:[<0x100000002d9/rewinddir-test.c v408>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000358:[<0x100000002d9/rewinddir-test.c v462>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.102+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000320 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/genhashnames.c auth v464 ap=1 s=4037 n(v0 rc2024-09-19T09:20:02.269265+0000 b4037 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000320:[<0x100000002d9/genhashnames.c v410>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000320:[<0x100000002d9/genhashnames.c v464>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.102+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000376 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_cow_memory_failure.c auth v466 ap=1 s=3495 n(v0 rc2024-09-19T09:20:02.339264+0000 b3495 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000376:[<0x100000002d9/t_mmap_cow_memory_failure.c v412>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000376:[<0x100000002d9/t_mmap_cow_memory_failure.c v466>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.569 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.103+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/writemod.c auth v481 ap=1 s=1061 n(v0 rc2024-09-19T09:20:04.392241+0000 b1061 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d3c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a1:[<0x100000002d9/writemod.c v414>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003a1:[<0x100000002d9/writemod.c v481>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.103+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/attr_replace_test.c auth v464 ap=1 s=1978 n(v0 rc2024-09-19T09:20:02.235265+0000 b1978 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f5:[<0x100000002d9/attr_replace_test.c v396>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000002f5:[<0x100000002d9/attr_replace_test.c v464>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.103+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000362 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/stat_test.c auth v466 ap=1 s=21149 n(v0 rc2024-09-19T09:20:02.323264+0000 b21149 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000362:[<0x100000002d9/stat_test.c v398>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000362:[<0x100000002d9/stat_test.c v466>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.103+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000327 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/holetest.c auth v468 ap=1 s=9160 n(v0 b9160 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000327:[<0x100000002d9/holetest.c v400>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000327:[<0x100000002d9/holetest.c v468>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.103+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000300 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/detached_mounts_propagation.c auth v470 ap=1 s=4905 n(v0 b4905 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000300:[<0x100000002d9/detached_mounts_propagation.c v402>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000300:[<0x100000002d9/detached_mounts_propagation.c v470>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.104+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/multi_open_unlink.c auth v472 ap=1 s=2751 n(v0 rc2024-09-19T09:20:02.294264+0000 b2751 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033e:[<0x100000002d9/multi_open_unlink.c v404>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000033e:[<0x100000002d9/multi_open_unlink.c v472>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.104+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmapcat.c auth v474 ap=1 s=559 n(v0 rc2024-09-19T09:20:02.293264+0000 b559 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033d:[<0x100000002d9/mmapcat.c v406>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000033d:[<0x100000002d9/mmapcat.c v474>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.104+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000354 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/readdir-while-renames.c auth v476 ap=1 s=3763 n(v0 rc2024-09-19T09:20:02.312264+0000 b3763 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000354:[<0x100000002d9/readdir-while-renames.c v408>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000354:[<0x100000002d9/readdir-while-renames.c v476>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.105+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000328 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/iopat.c auth v480 ap=1 s=870 n(v0 rc2024-09-19T09:20:02.275265+0000 b870 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000328:[<0x100000002d9/iopat.c v412>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000328:[<0x100000002d9/iopat.c v480>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.570 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.105+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000030a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/dumpfile auth v482 ap=1 s=27200 n(v0 b27200 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000030a:[<0x100000002d9/dumpfile v414>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000030a:[<0x100000002d9/dumpfile v482>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.105+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/permname.c auth v478 ap=1 s=4501 n(v0 rc2024-09-19T09:20:02.305264+0000 b4501 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034c:[<0x100000002d9/permname.c v410>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000034c:[<0x100000002d9/permname.c v478>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.105+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000393 [...2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/ auth{0=1} v543 ap=1 f(v0 m2024-09-19T09:20:37.007880+0000 13=13+0) n(v0 rc2024-09-19T09:20:37.008880+0000 b462889 14=13+1) (inest lock) (ifile excl) caps={24851=pAsLsXsFsx/pAsLsXsFsx@1},l=24851 | importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d2bcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000393:[<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(2)0x10000000393:[<0x100000002d9/vfs v543>,<0x10000000007/src v2423>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T09:20:37.007880+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T09:20:37.008880+0000 b462889 14=13+1)","memory_value.dirstat":"f(v0 m2024-09-19T09:20:37.007880+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-09-19T09:20:37.008880+0000 b462889 14=13+1)","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.106+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000315 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill2.c auth v484 ap=1 s=8932 n(v0 rc2024-09-19T09:20:02.260265+0000 b8932 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000315:[<0x100000002d9/fill2.c v418>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000315:[<0x100000002d9/fill2.c v484>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.106+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000314 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill.c auth v486 ap=1 s=1481 n(v0 rc2024-09-19T09:20:02.259265+0000 b1481 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000314:[<0x100000002d9/fill.c v420>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000314:[<0x100000002d9/fill.c v486>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.106+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/locktest.c auth v488 ap=1 s=46475 n(v0 rc2024-09-19T09:20:02.278265+0000 b46475 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2be100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032b:[<0x100000002d9/locktest.c v422>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000032b:[<0x100000002d9/locktest.c v488>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.107+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mkswap.c auth v490 ap=1 s=1460 n(v0 rc2024-09-19T09:20:02.291264+0000 b1460 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2be680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033a:[<0x100000002d9/mkswap.c v424>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000033a:[<0x100000002d9/mkswap.c v490>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.107+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ff [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/deduperace.c auth v492 ap=1 s=7666 n(v0 rc2024-09-19T09:20:02.243265+0000 b7666 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ff:[<0x100000002d9/deduperace.c v426>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000002ff:[<0x100000002d9/deduperace.c v492>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.571 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.107+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_writev_overlap.c auth v494 ap=1 s=3243 n(v0 rc2024-09-19T09:20:02.344264+0000 b3243 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037d:[<0x100000002d9/t_mmap_writev_overlap.c v428>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000037d:[<0x100000002d9/t_mmap_writev_overlap.c v494>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.107+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000373 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_holes.c auth v496 ap=1 s=650 n(v0 b650 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2bf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000373:[<0x100000002d9/t_holes.c v430>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000373:[<0x100000002d9/t_holes.c v496>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.108+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_type.c auth v498 ap=1 s=1906 n(v0 b1906 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036b:[<0x100000002d9/t_dir_type.c v432>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000036b:[<0x100000002d9/t_dir_type.c v498>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.108+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000369 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_offset.c auth v500 ap=1 s=1104 n(v0 rc2024-09-19T09:20:02.329264+0000 b1104 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000369:[<0x100000002d9/t_dir_offset.c v434>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000369:[<0x100000002d9/t_dir_offset.c v500>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.108+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmap-rw-fault.c auth v502 ap=1 s=4652 n(v0 b4652 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033b:[<0x100000002d9/mmap-rw-fault.c v436>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000033b:[<0x100000002d9/mmap-rw-fault.c v502>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.108+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000331 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/replay-log.c auth v22 ap=1 s=9766 n(v0 b9766 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d344000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000331:[<0x1000000032c/replay-log.c v10>,<0x100000002d9/log-writes v176>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000331:[<0x1000000032c/replay-log.c v22>,<0x100000002d9/log-writes v476>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.109+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/Makefile auth v24 ap=1 s=475 n(v0 rc2024-09-19T09:20:02.280265+0000 b475 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d344580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032d:[<0x1000000032c/Makefile v2>,<0x100000002d9/log-writes v176>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000032d:[<0x1000000032c/Makefile v24>,<0x100000002d9/log-writes v476>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.109+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.c auth v28 ap=1 s=13070 n(v0 rc2024-09-19T09:20:02.282264+0000 b13070 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d345080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032f:[<0x1000000032c/log-writes.c v6>,<0x100000002d9/log-writes v176>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000032f:[<0x1000000032c/log-writes.c v28>,<0x100000002d9/log-writes v476>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.109+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000330 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.h auth v26 ap=1 s=2024 n(v0 rc2024-09-19T09:20:02.283264+0000 b2024 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d344b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000330:[<0x1000000032c/log-writes.h v8>,<0x100000002d9/log-writes v176>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000330:[<0x1000000032c/log-writes.h v26>,<0x100000002d9/log-writes v476>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.572 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.109+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/SOURCE auth v30 ap=1 s=184 n(v0 rc2024-09-19T09:20:02.281265+0000 b184 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d345600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032e:[<0x1000000032c/SOURCE v4>,<0x100000002d9/log-writes v176>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000032e:[<0x1000000032c/SOURCE v30>,<0x100000002d9/log-writes v476>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.109+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.c auth v78 ap=1 s=66253 n(v0 rc2024-09-19T09:20:04.389241+0000 b66253 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039f:[<0x10000000393/vfstest.c v24>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000039f:[<0x10000000393/vfstest.c v78>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.110+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.c auth v74 ap=1 s=13890 n(v0 rc2024-09-19T09:20:04.383241+0000 b13890 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039b:[<0x10000000393/tmpfs-idmapped-mounts.c v16>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000039b:[<0x10000000393/tmpfs-idmapped-mounts.c v74>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.110+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/mount-idmapped.c auth v62 ap=1 s=5163 n(v0 rc2024-09-19T09:20:04.381241+0000 b5163 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039a:[<0x10000000393/mount-idmapped.c v14>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000039a:[<0x10000000393/mount-idmapped.c v62>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.110+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a0 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.h auth v58 ap=1 s=198 n(v0 rc2024-09-19T09:20:04.391241+0000 b198 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a0:[<0x10000000393/vfstest.h v26>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003a0:[<0x10000000393/vfstest.h v58>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.111+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000399 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/missing.h auth v68 ap=1 s=3677 n(v0 rc2024-09-19T09:20:04.380241+0000 b3677 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000399:[<0x10000000393/missing.h v12>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000399:[<0x10000000393/missing.h v68>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.111+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000397 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.c auth v76 ap=1 s=240071 n(v0 rc2024-09-19T09:20:04.377241+0000 b240071 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000397:[<0x10000000393/idmapped-mounts.c v8>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000397:[<0x10000000393/idmapped-mounts.c v76>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.111+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000398 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.h auth v56 ap=1 s=3211 n(v0 rc2024-09-19T09:20:04.379241+0000 b3211 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000398:[<0x10000000393/idmapped-mounts.h v10>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000398:[<0x10000000393/idmapped-mounts.h v56>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.111+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.h auth v54 ap=1 s=273 n(v0 rc2024-09-19T09:20:04.384241+0000 b273 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039c:[<0x10000000393/tmpfs-idmapped-mounts.h v18>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000039c:[<0x10000000393/tmpfs-idmapped-mounts.h v54>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.573 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.111+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.c auth v64 ap=1 s=22310 n(v0 rc2024-09-19T09:20:04.385241+0000 b22310 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039d:[<0x10000000393/utils.c v20>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000039d:[<0x10000000393/utils.c v64>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.111+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000395 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.c auth v60 ap=1 s=96274 n(v0 rc2024-09-19T09:20:04.374241+0000 b96274 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000395:[<0x10000000393/btrfs-idmapped-mounts.c v4>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000395:[<0x10000000393/btrfs-idmapped-mounts.c v60>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.112+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000396 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.h auth v70 ap=1 s=274 n(v0 rc2024-09-19T09:20:04.375241+0000 b274 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000396:[<0x10000000393/btrfs-idmapped-mounts.h v6>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000396:[<0x10000000393/btrfs-idmapped-mounts.h v70>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.112+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.h auth v72 ap=1 s=10243 n(v0 rc2024-09-19T09:20:04.387241+0000 b10243 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039e:[<0x10000000393/utils.h v22>,<0x100000002d9/vfs v392>,<0x10000000007/src v1159>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000039e:[<0x10000000393/utils.h v72>,<0x100000002d9/vfs v543>,<0x10000000007/src v2425>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.116+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000281 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/repair auth v202 ap=1 s=4565 n(v0 b4565 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d334100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000281:[<0x10000000257/repair v102>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000281:[<0x10000000257/repair v202>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.116+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000282 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/report auth v206 ap=1 s=8402 n(v0 rc2024-09-19T09:20:02.132266+0000 b8402 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d334c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000282:[<0x10000000257/report v106>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000282:[<0x10000000257/report v206>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.116+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000265 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmlogwrites auth v208 ap=1 s=5995 n(v0 rc2024-09-19T09:20:02.107266+0000 b5995 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d335180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000265:[<0x10000000257/dmlogwrites v108>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000265:[<0x10000000257/dmlogwrites v208>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.117+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/casefold auth v210 ap=1 s=2067 n(v0 rc2024-09-19T09:20:02.099267+0000 b2067 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d335700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025b:[<0x10000000257/casefold v110>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000025b:[<0x10000000257/casefold v210>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.574 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.117+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000279 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/perf auth v212 ap=1 s=937 n(v0 rc2024-09-19T09:20:02.124266+0000 b937 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d0a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000279:[<0x10000000257/perf v112>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000279:[<0x10000000257/perf v212>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.117+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/fail_make_request auth v214 ap=1 s=1907 n(v0 b1907 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d370000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026b:[<0x10000000257/fail_make_request v114>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000026b:[<0x10000000257/fail_make_request v214>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.117+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000262 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmerror auth v216 ap=1 s=10761 n(v0 rc2024-09-19T09:20:02.105266+0000 b10761 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d370580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000262:[<0x10000000257/dmerror v116>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000262:[<0x10000000257/dmerror v216>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.117+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000283 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/scsi_debug auth v220 ap=1 s=2176 n(v0 rc2024-09-19T09:20:02.133266+0000 b2176 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d370b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000283:[<0x10000000257/scsi_debug v120>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000283:[<0x10000000257/scsi_debug v220>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.118+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000270 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/gcov auth v222 ap=1 s=2881 n(v0 rc2024-09-19T09:20:02.117266+0000 b2881 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d371080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000270:[<0x10000000257/gcov v122>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000270:[<0x10000000257/gcov v222>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.118+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000264 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmhugedisk auth v224 ap=1 s=1098 n(v0 b1098 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d371600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000264:[<0x10000000257/dmhugedisk v124>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000264:[<0x10000000257/dmhugedisk v224>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.119+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000272 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/locktest auth v230 ap=1 s=1856 n(v0 rc2024-09-19T09:20:02.118266+0000 b1856 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d372680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000272:[<0x10000000257/locktest v130>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000272:[<0x10000000257/locktest v230>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.120+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000268 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/encrypt auth v236 ap=1 s=31115 n(v0 rc2024-09-19T09:20:02.110266+0000 b31115 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d373700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000268:[<0x10000000257/encrypt v136>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000268:[<0x10000000257/encrypt v236>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.120+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/preamble auth v238 ap=1 s=1327 n(v0 rc2024-09-19T09:20:02.126266+0000 b1327 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027b:[<0x10000000257/preamble v72>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000027b:[<0x10000000257/preamble v238>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.575 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.120+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000267 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dump auth v242 ap=1 s=36169 n(v0 rc2024-09-19T09:20:02.109266+0000 b36169 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000267:[<0x10000000257/dump v32>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000267:[<0x10000000257/dump v242>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.121+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/cgroup2 auth v246 ap=1 s=493 n(v0 rc2024-09-19T09:20:02.101266+0000 b493 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025d:[<0x10000000257/cgroup2 v12>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000025d:[<0x10000000257/cgroup2 v246>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.121+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000289 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/zoned auth v248 ap=1 s=1090 n(v0 rc2024-09-19T09:20:02.138266+0000 b1090 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000289:[<0x10000000257/zoned v100>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000289:[<0x10000000257/zoned v248>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.121+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000280 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/renameat2 auth v254 ap=1 s=2520 n(v0 rc2024-09-19T09:20:02.131266+0000 b2520 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000280:[<0x10000000257/renameat2 v82>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000280:[<0x10000000257/renameat2 v254>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.121+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000258 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/Makefile auth v262 ap=1 s=305 n(v0 rc2024-09-19T09:20:02.097267+0000 b305 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000258:[<0x10000000257/Makefile v2>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000258:[<0x10000000257/Makefile v262>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.121+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000274 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/metadump auth v250 ap=1 s=4321 n(v0 rc2024-09-19T09:20:02.120266+0000 b4321 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000274:[<0x10000000257/metadump v58>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000274:[<0x10000000257/metadump v250>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.122+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ceph auth v264 ap=1 s=986 n(v0 rc2024-09-19T09:20:02.100267+0000 b986 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d37d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025c:[<0x10000000257/ceph v10>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000025c:[<0x10000000257/ceph v264>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.122+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000276 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/nfs auth v256 ap=1 s=794 n(v0 b794 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d382000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000276:[<0x10000000257/nfs v62>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000276:[<0x10000000257/nfs v256>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.122+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000286 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ubifs auth v266 ap=1 s=145 n(v0 b145 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d382580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000286:[<0x10000000257/ubifs v94>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000286:[<0x10000000257/ubifs v266>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.576 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.122+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000263 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmflakey auth v258 ap=1 s=6034 n(v0 rc2024-09-19T09:20:02.106266+0000 b6034 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d382b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000263:[<0x10000000257/dmflakey v24>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000263:[<0x10000000257/dmflakey v258>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.122+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/filter auth v260 ap=1 s=18600 n(v0 rc2024-09-19T09:20:02.114266+0000 b18600 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d383080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026d:[<0x10000000257/filter v44>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000026d:[<0x10000000257/filter v260>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.123+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000260 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdelay auth v268 ap=1 s=1776 n(v0 rc2024-09-19T09:20:02.103266+0000 b1776 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d383600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000260:[<0x10000000257/dmdelay v18>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000260:[<0x10000000257/dmdelay v268>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.123+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000275 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/module auth v270 ap=1 s=6439 n(v0 rc2024-09-19T09:20:02.121266+0000 b6439 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d383b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000275:[<0x10000000257/module v60>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000275:[<0x10000000257/module v270>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.123+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/reflink auth v274 ap=1 s=14649 n(v0 rc2024-09-19T09:20:02.130266+0000 b14649 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d384680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027f:[<0x10000000257/reflink v80>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000027f:[<0x10000000257/reflink v274>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.123+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000284 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/test_names auth v278 ap=1 s=312 n(v0 rc2024-09-19T09:20:02.134266+0000 b312 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d385180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000284:[<0x10000000257/test_names v90>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000284:[<0x10000000257/test_names v278>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.124+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000261 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdust auth v280 ap=1 s=839 n(v0 rc2024-09-19T09:20:02.104266+0000 b839 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d385700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000261:[<0x10000000257/dmdust v20>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000261:[<0x10000000257/dmdust v280>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.124+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000266 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmthin auth v286 ap=1 s=7964 n(v0 rc2024-09-19T09:20:02.108266+0000 b7964 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d38eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000266:[<0x10000000257/dmthin v30>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000266:[<0x10000000257/dmthin v286>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.124+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000271 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/inject auth v292 ap=1 s=2962 n(v0 b2962 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d38fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000271:[<0x10000000257/inject v52>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000271:[<0x10000000257/inject v292>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.577 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.125+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/f2fs auth v296 ap=1 s=812 n(v0 b812 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d390680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026a:[<0x10000000257/f2fs v38>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x1000000026a:[<0x10000000257/f2fs v296>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.125+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000277 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/overlay auth v288 ap=1 s=13439 n(v0 rc2024-09-19T09:20:02.122266+0000 b13439 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d38f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000277:[<0x10000000257/overlay v64>,<0x10000000007/common v1327>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000277:[<0x10000000257/overlay v288>,<0x10000000007/common v2397>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.143+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/289.out auth v582 ap=1 s=496 n(v0 rc2024-09-19T09:20:30.039958+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091d:[<0x100000006d6/289.out v410>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000091d:[<0x100000006d6/289.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.148+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ef [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/402.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.249955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ef:[<0x100000006d6/402.out v458>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009ef:[<0x100000006d6/402.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.148+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bfb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/664.out auth v606 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.181945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bfb:[<0x100000006d6/664.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bfb:[<0x100000006d6/664.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.149+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000867 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/198.out auth v596 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.833960+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000867:[<0x100000006d6/198.out v362>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000867:[<0x100000006d6/198.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.149+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000865 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/197.out auth v602 ap=1 s=496 n(v0 rc2024-09-19T09:20:29.831960+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000865:[<0x100000006d6/197.out v360>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000865:[<0x100000006d6/197.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.149+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000abd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/505.out auth v598 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.476953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000abd:[<0x100000006d6/505.out v500>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000abd:[<0x100000006d6/505.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.150+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000771 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/075.out auth v592 ap=1 s=563 n(v0 rc2024-09-19T09:20:29.507963+0000 b563 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000771:[<0x100000006d6/075.out v306>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000771:[<0x100000006d6/075.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.150+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c73 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/724.out auth v606 ap=1 s=222 n(v0 b222 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d691600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c73:[<0x100000006d6/724.out v582>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c73:[<0x100000006d6/724.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.578 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.150+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008df [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/258.out auth v612 ap=1 s=177 n(v0 rc2024-09-19T09:20:29.972958+0000 b177 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d691b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008df:[<0x100000006d6/258.out v396>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008df:[<0x100000006d6/258.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.151+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/650.out auth v608 ap=1 s=44 n(v0 rc2024-09-19T09:20:31.153945+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d692680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdf:[<0x100000006d6/650.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bdf:[<0x100000006d6/650.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.151+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000af9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/535.out auth v602 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.540952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000af9:[<0x100000006d6/535.out v520>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000af9:[<0x100000006d6/535.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.152+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000873 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/204.out auth v592 ap=1 s=34 n(v0 rc2024-09-19T09:20:29.847960+0000 b34 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d692100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000873:[<0x100000006d6/204.out v370>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000873:[<0x100000006d6/204.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.152+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/141.out auth v600 ap=1 s=25 n(v0 rc2024-09-19T09:20:29.695961+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f5:[<0x100000006d6/141.out v338>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007f5:[<0x100000006d6/141.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.152+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000801 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/147.out auth v610 ap=1 s=943 n(v0 rc2024-09-19T09:20:29.708961+0000 b943 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000801:[<0x100000006d6/147.out v340>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000801:[<0x100000006d6/147.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.153+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/114.out auth v600 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.628962+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bf:[<0x100000006d6/114.out v326>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007bf:[<0x100000006d6/114.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.153+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/328.out auth v608 ap=1 s=510 n(v0 rc2024-09-19T09:20:30.117957+0000 b510 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096b:[<0x100000006d6/328.out v432>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000096b:[<0x100000006d6/328.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.579 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.153+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/409.out auth v610 ap=1 s=5922 n(v0 rc2024-09-19T09:20:30.264955+0000 b5922 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fd:[<0x100000006d6/409.out v460>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009fd:[<0x100000006d6/409.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.580 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.153+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/397.out auth v586 ap=1 s=749 n(v0 rc2024-09-19T09:20:30.239955+0000 b749 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e5:[<0x100000006d6/397.out v456>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009e5:[<0x100000006d6/397.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.580 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.154+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000787 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/086.out auth v584 ap=1 s=494 n(v0 rc2024-09-19T09:20:29.541963+0000 b494 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000787:[<0x100000006d6/086.out v312>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000787:[<0x100000006d6/086.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.580 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.154+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/228.out auth v622 ap=1 s=209 n(v0 rc2024-09-19T09:20:29.903959+0000 b209 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a3:[<0x100000006d6/228.out v388>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008a3:[<0x100000006d6/228.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.581 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.154+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ab [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/104.out auth v620 ap=1 s=79 n(v0 rc2024-09-19T09:20:29.599962+0000 b79 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ab:[<0x100000006d6/104.out v322>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007ab:[<0x100000006d6/104.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.581 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.155+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000887 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/214.out auth v614 ap=1 s=2272 n(v0 rc2024-09-19T09:20:29.870959+0000 b2272 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000887:[<0x100000006d6/214.out v380>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000887:[<0x100000006d6/214.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.581 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.155+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a7f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/474.out auth v582 ap=1 s=28 n(v0 rc2024-09-19T09:20:30.414953+0000 b28 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a7f:[<0x100000006d6/474.out v488>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a7f:[<0x100000006d6/474.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.581 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.155+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/357.out auth v594 ap=1 s=140 n(v0 rc2024-09-19T09:20:30.174956+0000 b140 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a5:[<0x100000006d6/357.out v444>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009a5:[<0x100000006d6/357.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.581 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.155+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b89 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/607.out auth v618 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.041946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b89:[<0x100000006d6/607.out v544>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b89:[<0x100000006d6/607.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.581 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.156+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a2b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/432.out auth v616 ap=1 s=751 n(v0 rc2024-09-19T09:20:30.313954+0000 b751 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a2b:[<0x100000006d6/432.out v474>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a2b:[<0x100000006d6/432.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.156+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000875 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/205.out auth v602 ap=1 s=112 n(v0 rc2024-09-19T09:20:29.849960+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d567600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000875:[<0x100000006d6/205.out v372>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000875:[<0x100000006d6/205.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.157+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/644.out auth v604 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.142945+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d569180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd3:[<0x100000006d6/644.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bd3:[<0x100000006d6/644.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.157+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006d8 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/001.out auth v588 ap=1 s=384 n(v0 rc2024-09-19T09:20:27.364987+0000 b384 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d569700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006d8:[<0x100000006d6/001.out v4>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006d8:[<0x100000006d6/001.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.157+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000885 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/213.out auth v580 ap=1 s=184 n(v0 rc2024-09-19T09:20:29.868959+0000 b184 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d53eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000885:[<0x100000006d6/213.out v378>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000885:[<0x100000006d6/213.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.158+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000716 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/032.out auth v606 ap=1 s=124 n(v0 rc2024-09-19T09:20:27.417987+0000 b124 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d540100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000716:[<0x100000006d6/032.out v128>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000716:[<0x100000006d6/032.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.158+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000933 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/300.out auth v582 ap=1 s=63 n(v0 rc2024-09-19T09:20:30.061957+0000 b63 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d540c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000933:[<0x100000006d6/300.out v416>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000933:[<0x100000006d6/300.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.158+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b4d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/577.out auth v584 ap=1 s=1345 n(v0 rc2024-09-19T09:20:30.916948+0000 b1345 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d541180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b4d:[<0x100000006d6/577.out v532>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b4d:[<0x100000006d6/577.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.158+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/027.out auth v580 ap=1 s=43 n(v0 rc2024-09-19T09:20:27.409987+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070c:[<0x100000006d6/027.out v108>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000070c:[<0x100000006d6/027.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.582 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.159+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/491.out auth v608 ap=1 s=32 n(v0 rc2024-09-19T09:20:30.449953+0000 b32 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa1:[<0x100000006d6/491.out v506>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aa1:[<0x100000006d6/491.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.159+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/322.out auth v588 ap=1 s=261 n(v0 rc2024-09-19T09:20:30.105957+0000 b261 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095f:[<0x100000006d6/322.out v410>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000095f:[<0x100000006d6/322.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.159+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/186.out auth v582 ap=1 s=619 n(v0 rc2024-09-19T09:20:29.802960+0000 b619 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084f:[<0x100000006d6/186.out v346>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000084f:[<0x100000006d6/186.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.159+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c47 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/702.out auth v614 ap=1 s=898 n(v0 rc2024-09-19T09:20:31.284944+0000 b898 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c47:[<0x100000006d6/702.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c47:[<0x100000006d6/702.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.161+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/056.out auth v602 ap=1 s=291 n(v0 rc2024-09-19T09:20:27.463986+0000 b291 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074b:[<0x100000006d6/056.out v234>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000074b:[<0x100000006d6/056.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.161+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000759 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/063.out auth v596 ap=1 s=1889 n(v0 rc2024-09-19T09:20:27.476986+0000 b1889 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000759:[<0x100000006d6/063.out v262>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000759:[<0x100000006d6/063.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.162+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/620.out auth v604 ap=1 s=124 n(v0 rc2024-09-19T09:20:31.066946+0000 b124 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba3:[<0x100000006d6/620.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ba3:[<0x100000006d6/620.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.583 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.162+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000829 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/167.out auth v618 ap=1 s=102 n(v0 rc2024-09-19T09:20:29.748961+0000 b102 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000829:[<0x100000006d6/167.out v342>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000829:[<0x100000006d6/167.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.584 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.162+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/202.out auth v584 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.842960+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4e2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086f:[<0x100000006d6/202.out v354>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000086f:[<0x100000006d6/202.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.584 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.163+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b63 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/588.out auth v616 ap=1 s=545 n(v0 rc2024-09-19T09:20:30.962947+0000 b545 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b63:[<0x100000006d6/588.out v554>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b63:[<0x100000006d6/588.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.584 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.163+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000077d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/081.out auth v614 ap=1 s=43 n(v0 rc2024-09-19T09:20:29.521963+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d51c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000077d:[<0x100000006d6/081.out v306>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000077d:[<0x100000006d6/081.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.584 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.163+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/662.out auth v590 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.176945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d51d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf7:[<0x100000006d6/662.out v582>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bf7:[<0x100000006d6/662.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.584 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.164+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a03 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/412.out auth v618 ap=1 s=414 n(v0 rc2024-09-19T09:20:30.270955+0000 b414 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d51c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a03:[<0x100000006d6/412.out v466>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a03:[<0x100000006d6/412.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.164+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000099d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/353.out auth v588 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.166956+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d51cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000099d:[<0x100000006d6/353.out v434>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000099d:[<0x100000006d6/353.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.164+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/641.out auth v624 ap=1 s=50 n(v0 rc2024-09-19T09:20:31.110946+0000 b50 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d529080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcd:[<0x100000006d6/641.out v580>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bcd:[<0x100000006d6/641.out v624>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.164+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000099f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/354.out auth v626 ap=1 s=1479 n(v0 rc2024-09-19T09:20:30.168956+0000 b1479 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d528b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000099f:[<0x100000006d6/354.out v436>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000099f:[<0x100000006d6/354.out v626>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.165+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/074.out auth v586 ap=1 s=769 n(v0 rc2024-09-19T09:20:29.496964+0000 b769 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d52a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000076f:[<0x100000006d6/074.out v304>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000076f:[<0x100000006d6/074.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.165+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b23 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/556.out auth v616 ap=1 s=543 n(v0 rc2024-09-19T09:20:30.582952+0000 b543 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d52a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b23:[<0x100000006d6/556.out v552>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b23:[<0x100000006d6/556.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.165+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b85 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/605.out auth v622 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.037946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d52b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b85:[<0x100000006d6/605.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b85:[<0x100000006d6/605.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.165+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b09 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/543.out auth v628 ap=1 s=752 n(v0 rc2024-09-19T09:20:30.556952+0000 b752 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d52b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b09:[<0x100000006d6/543.out v542>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b09:[<0x100000006d6/543.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.166+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b91 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/611.out auth v596 ap=1 s=32 n(v0 rc2024-09-19T09:20:31.048946+0000 b32 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d536000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b91:[<0x100000006d6/611.out v578>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b91:[<0x100000006d6/611.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.585 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.167+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000741 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/051.out auth v604 ap=1 s=63 n(v0 b63 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d537080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000741:[<0x100000006d6/051.out v214>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000741:[<0x100000006d6/051.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.167+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000899 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/223.out auth v620 ap=1 s=11501 n(v0 rc2024-09-19T09:20:29.892959+0000 b11501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d536b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000899:[<0x100000006d6/223.out v378>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000899:[<0x100000006d6/223.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.167+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b15 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/549.out auth v600 ap=1 s=153 n(v0 rc2024-09-19T09:20:30.568952+0000 b153 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d537b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b15:[<0x100000006d6/549.out v548>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b15:[<0x100000006d6/549.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.168+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000837 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/174.out auth v598 ap=1 s=244 n(v0 rc2024-09-19T09:20:29.766961+0000 b244 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d506580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000837:[<0x100000006d6/174.out v348>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000837:[<0x100000006d6/174.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.168+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c6f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/722.out auth v600 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.347943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d507080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c6f:[<0x100000006d6/722.out v582>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c6f:[<0x100000006d6/722.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.168+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b59 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/583.out auth v606 ap=1 s=166 n(v0 rc2024-09-19T09:20:30.952947+0000 b166 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d508100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b59:[<0x100000006d6/583.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b59:[<0x100000006d6/583.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.169+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/629.out auth v610 ap=1 s=348 n(v0 rc2024-09-19T09:20:31.084946+0000 b348 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d508c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb5:[<0x100000006d6/629.out v578>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bb5:[<0x100000006d6/629.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.169+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009cb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/384.out auth v584 ap=1 s=117 n(v0 rc2024-09-19T09:20:30.213956+0000 b117 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d509700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009cb:[<0x100000006d6/384.out v454>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009cb:[<0x100000006d6/384.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.170+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/112.out auth v608 ap=1 s=575 n(v0 rc2024-09-19T09:20:29.622962+0000 b575 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d51b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bb:[<0x100000006d6/112.out v324>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007bb:[<0x100000006d6/112.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.586 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.171+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008d5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/253.out auth v582 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.960958+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008d5:[<0x100000006d6/253.out v408>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008d5:[<0x100000006d6/253.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.171+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c27 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/686.out auth v584 ap=1 s=1068 n(v0 rc2024-09-19T09:20:31.249944+0000 b1068 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c27:[<0x100000006d6/686.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c27:[<0x100000006d6/686.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.172+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000087d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/209.out auth v568 ap=1 s=63 n(v0 rc2024-09-19T09:20:29.859960+0000 b63 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000087d:[<0x100000006d6/209.out v382>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000087d:[<0x100000006d6/209.out v568>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.173+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/640.out auth v604 ap=1 s=52 n(v0 rc2024-09-19T09:20:31.108946+0000 b52 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcb:[<0x100000006d6/640.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bcb:[<0x100000006d6/640.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.173+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/627.out auth v602 ap=1 s=63 n(v0 rc2024-09-19T09:20:31.079946+0000 b63 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb1:[<0x100000006d6/627.out v558>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bb1:[<0x100000006d6/627.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.173+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c35 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/693.out auth v590 ap=1 s=454 n(v0 rc2024-09-19T09:20:31.264944+0000 b454 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c35:[<0x100000006d6/693.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c35:[<0x100000006d6/693.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.173+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/168.out auth v574 ap=1 s=88 n(v0 rc2024-09-19T09:20:29.751961+0000 b88 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082b:[<0x100000006d6/168.out v358>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000082b:[<0x100000006d6/168.out v574>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.173+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/194.out auth v600 ap=1 s=505 n(v0 rc2024-09-19T09:20:29.824960+0000 b505 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085f:[<0x100000006d6/194.out v374>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000085f:[<0x100000006d6/194.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.174+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000700 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/021.out auth v576 ap=1 s=1216 n(v0 rc2024-09-19T09:20:27.399987+0000 b1216 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000700:[<0x100000006d6/021.out v84>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000700:[<0x100000006d6/021.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.587 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.174+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f4 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/015.out auth v578 ap=1 s=143 n(v0 rc2024-09-19T09:20:27.388987+0000 b143 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f4:[<0x100000006d6/015.out v60>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006f4:[<0x100000006d6/015.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.588 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.174+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000981 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/339.out auth v570 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.139956+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000981:[<0x100000006d6/339.out v446>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000981:[<0x100000006d6/339.out v570>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.588 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.174+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/065.out auth v580 ap=1 s=463 n(v0 b463 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075d:[<0x100000006d6/065.out v270>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000075d:[<0x100000006d6/065.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.588 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.175+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a65 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/461.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.375954+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d613700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a65:[<0x100000006d6/461.out v504>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a65:[<0x100000006d6/461.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.588 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.175+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c0f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/674.out auth v572 ap=1 s=1531 n(v0 rc2024-09-19T09:20:31.226944+0000 b1531 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d624b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c0f:[<0x100000006d6/674.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c0f:[<0x100000006d6/674.out v572>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.588 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.175+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000871 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/203.out auth v568 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.844960+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d625b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000871:[<0x100000006d6/203.out v376>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000871:[<0x100000006d6/203.out v568>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.588 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.176+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000943 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/308.out auth v600 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.077957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d626100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000943:[<0x100000006d6/308.out v434>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000943:[<0x100000006d6/308.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.176+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c71 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/723.out auth v594 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.349943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d626680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c71:[<0x100000006d6/723.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c71:[<0x100000006d6/723.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.176+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/111.out auth v598 ap=1 s=1469 n(v0 rc2024-09-19T09:20:29.619962+0000 b1469 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d627700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b9:[<0x100000006d6/111.out v324>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007b9:[<0x100000006d6/111.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.176+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008bf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/242.out auth v582 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.935959+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d626c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008bf:[<0x100000006d6/242.out v402>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008bf:[<0x100000006d6/242.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.177+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c07 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/670.out auth v604 ap=1 s=114 n(v0 rc2024-09-19T09:20:31.218944+0000 b114 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d62cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c07:[<0x100000006d6/670.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c07:[<0x100000006d6/670.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.177+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000859 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/191.out auth v578 ap=1 s=496 n(v0 rc2024-09-19T09:20:29.816960+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d62d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000859:[<0x100000006d6/191.out v370>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000859:[<0x100000006d6/191.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.177+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/116.out auth v580 ap=1 s=335 n(v0 rc2024-09-19T09:20:29.634962+0000 b335 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d62db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c3:[<0x100000006d6/116.out v326>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007c3:[<0x100000006d6/116.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.589 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.178+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/408.out auth v602 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.262955+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d554c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fb:[<0x100000006d6/408.out v476>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009fb:[<0x100000006d6/408.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.178+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/Makefile auth v584 ap=1 s=528 n(v0 rc2024-09-19T09:20:31.411942+0000 b528 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d55cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb2:[<0x100000006d6/Makefile v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cb2:[<0x100000006d6/Makefile v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.178+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c85 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/733.out auth v598 ap=1 s=127 n(v0 rc2024-09-19T09:20:31.368943+0000 b127 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d55d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c85:[<0x100000006d6/733.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c85:[<0x100000006d6/733.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.179+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000789 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/087.out auth v576 ap=1 s=371 n(v0 rc2024-09-19T09:20:29.550963+0000 b371 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d55db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000789:[<0x100000006d6/087.out v316>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000789:[<0x100000006d6/087.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.179+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/134.out auth v604 ap=1 s=747 n(v0 rc2024-09-19T09:20:29.681961+0000 b747 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d55d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e7:[<0x100000006d6/134.out v352>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007e7:[<0x100000006d6/134.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.179+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000073f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota auth v588 ap=1 s=794 n(v0 rc2024-09-19T09:20:27.452986+0000 b794 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d55e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000073f:[<0x100000006d6/050.out.xfsquota v210>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000073f:[<0x100000006d6/050.out.xfsquota v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.179+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006da [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/002.out auth v574 ap=1 s=49 n(v0 rc2024-09-19T09:20:27.366987+0000 b49 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d55ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006da:[<0x100000006d6/002.out v8>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006da:[<0x100000006d6/002.out v574>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.180+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c75 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/725.out auth v600 ap=1 s=128 n(v0 b128 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d566b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c75:[<0x100000006d6/725.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c75:[<0x100000006d6/725.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.180+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c7b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/728.out auth v596 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.359943+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c7b:[<0x100000006d6/728.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c7b:[<0x100000006d6/728.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.590 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.180+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000779 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/079.out auth v574 ap=1 s=189 n(v0 rc2024-09-19T09:20:29.517963+0000 b189 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000779:[<0x100000006d6/079.out v304>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000779:[<0x100000006d6/079.out v574>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.181+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000755 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/061.out auth v588 ap=1 s=1889 n(v0 rc2024-09-19T09:20:27.472986+0000 b1889 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000755:[<0x100000006d6/061.out v254>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000755:[<0x100000006d6/061.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.181+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000088d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/217.out auth v584 ap=1 s=112 n(v0 rc2024-09-19T09:20:29.877959+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000088d:[<0x100000006d6/217.out v390>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000088d:[<0x100000006d6/217.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.181+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000895 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/221.out auth v576 ap=1 s=44 n(v0 rc2024-09-19T09:20:29.886959+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000895:[<0x100000006d6/221.out v392>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000895:[<0x100000006d6/221.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.182+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/375.out auth v590 ap=1 s=436 n(v0 rc2024-09-19T09:20:30.194956+0000 b436 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b9:[<0x100000006d6/375.out v460>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009b9:[<0x100000006d6/375.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.182+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b0d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/545.out auth v602 ap=1 s=318 n(v0 rc2024-09-19T09:20:30.560952+0000 b318 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b0d:[<0x100000006d6/545.out v530>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b0d:[<0x100000006d6/545.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.182+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000783 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/084.out auth v592 ap=1 s=43 n(v0 rc2024-09-19T09:20:29.531963+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000783:[<0x100000006d6/084.out v312>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000783:[<0x100000006d6/084.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.183+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/288.out auth v594 ap=1 s=238 n(v0 rc2024-09-19T09:20:30.037958+0000 b238 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091b:[<0x100000006d6/288.out v424>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000091b:[<0x100000006d6/288.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.184+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a11 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/419.out auth v580 ap=1 s=159 n(v0 rc2024-09-19T09:20:30.285955+0000 b159 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a11:[<0x100000006d6/419.out v482>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a11:[<0x100000006d6/419.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.184+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000935 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/301.out auth v598 ap=1 s=315 n(v0 rc2024-09-19T09:20:30.063957+0000 b315 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000935:[<0x100000006d6/301.out v428>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000935:[<0x100000006d6/301.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.591 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.184+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/227.out auth v578 ap=1 s=112 n(v0 rc2024-09-19T09:20:29.900959+0000 b112 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a1:[<0x100000006d6/227.out v394>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008a1:[<0x100000006d6/227.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.184+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009dd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/393.out auth v570 ap=1 s=1867 n(v0 rc2024-09-19T09:20:30.231955+0000 b1867 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009dd:[<0x100000006d6/393.out v468>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009dd:[<0x100000006d6/393.out v570>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.185+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c63 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/716.out auth v594 ap=1 s=1872 n(v0 rc2024-09-19T09:20:31.336943+0000 b1872 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d453700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c63:[<0x100000006d6/716.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c63:[<0x100000006d6/716.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.185+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000745 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/053.out auth v582 ap=1 s=911 n(v0 rc2024-09-19T09:20:27.458986+0000 b911 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d314100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000745:[<0x100000006d6/053.out v222>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000745:[<0x100000006d6/053.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.185+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000835 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/173.out auth v600 ap=1 s=185 n(v0 rc2024-09-19T09:20:29.763961+0000 b185 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d328000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000835:[<0x100000006d6/173.out v374>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000835:[<0x100000006d6/173.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.186+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/313.out auth v578 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.086957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094d:[<0x100000006d6/313.out v436>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000094d:[<0x100000006d6/313.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.186+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a3d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/441.out auth v604 ap=1 s=55 n(v0 rc2024-09-19T09:20:30.331954+0000 b55 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a3d:[<0x100000006d6/441.out v490>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a3d:[<0x100000006d6/441.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.186+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ab [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/232.out auth v576 ap=1 s=96 n(v0 rc2024-09-19T09:20:29.912959+0000 b96 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ab:[<0x100000006d6/232.out v398>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008ab:[<0x100000006d6/232.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.187+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/387.out auth v570 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.219956+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009d1:[<0x100000006d6/387.out v466>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009d1:[<0x100000006d6/387.out v570>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.592 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.187+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008cf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/250.out auth v580 ap=1 s=253 n(v0 rc2024-09-19T09:20:29.953958+0000 b253 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008cf:[<0x100000006d6/250.out v406>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008cf:[<0x100000006d6/250.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.187+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a49 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/447.out auth v588 ap=1 s=108 n(v0 rc2024-09-19T09:20:30.343954+0000 b108 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a49:[<0x100000006d6/447.out v492>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a49:[<0x100000006d6/447.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.188+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/260.out auth v592 ap=1 s=655 n(v0 rc2024-09-19T09:20:29.977958+0000 b655 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d4cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e3:[<0x100000006d6/260.out v408>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008e3:[<0x100000006d6/260.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.189+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/623.out auth v588 ap=1 s=144 n(v0 rc2024-09-19T09:20:31.072946+0000 b144 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d672b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba9:[<0x100000006d6/623.out v562>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ba9:[<0x100000006d6/623.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.189+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a97 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/486.out auth v594 ap=1 s=87 n(v0 rc2024-09-19T09:20:30.439953+0000 b87 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d673b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a97:[<0x100000006d6/486.out v526>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a97:[<0x100000006d6/486.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.189+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000919 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/287.out auth v582 ap=1 s=496 n(v0 rc2024-09-19T09:20:30.035958+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d674100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000919:[<0x100000006d6/287.out v426>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000919:[<0x100000006d6/287.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.190+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/697.out auth v614 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.273944+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d674680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3d:[<0x100000006d6/697.out v564>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c3d:[<0x100000006d6/697.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.190+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a93 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/484.out auth v610 ap=1 s=198 n(v0 rc2024-09-19T09:20:30.434953+0000 b198 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d674c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a93:[<0x100000006d6/484.out v524>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a93:[<0x100000006d6/484.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.593 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.191+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009bd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/377.out auth v584 ap=1 s=287 n(v0 rc2024-09-19T09:20:30.197956+0000 b287 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d675180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009bd:[<0x100000006d6/377.out v476>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009bd:[<0x100000006d6/377.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.192+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b25 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/557.out auth v576 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.584952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d686580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b25:[<0x100000006d6/557.out v554>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b25:[<0x100000006d6/557.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.192+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/371.out auth v608 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.186956+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d675700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b1:[<0x100000006d6/371.out v470>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009b1:[<0x100000006d6/371.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.192+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/098.out auth v604 ap=1 s=723 n(v0 rc2024-09-19T09:20:29.581963+0000 b723 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d686b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079f:[<0x100000006d6/098.out v318>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000079f:[<0x100000006d6/098.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.192+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000889 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/215.out auth v600 ap=1 s=109 n(v0 rc2024-09-19T09:20:29.872959+0000 b109 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d687080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000889:[<0x100000006d6/215.out v380>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000889:[<0x100000006d6/215.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.194+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ff [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/146.out auth v598 ap=1 s=942 n(v0 rc2024-09-19T09:20:29.706961+0000 b942 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d688680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ff:[<0x100000006d6/146.out v354>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007ff:[<0x100000006d6/146.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.194+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000941 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/307.out auth v602 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.075957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d688c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000941:[<0x100000006d6/307.out v444>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000941:[<0x100000006d6/307.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.194+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b7b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/600.out auth v586 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.009947+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d690000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b7b:[<0x100000006d6/600.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b7b:[<0x100000006d6/600.out v586>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.195+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/200.out auth v572 ap=1 s=505 n(v0 rc2024-09-19T09:20:29.837960+0000 b505 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d689700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086b:[<0x100000006d6/200.out v376>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000086b:[<0x100000006d6/200.out v572>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.594 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.195+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/263.out auth v596 ap=1 s=149 n(v0 rc2024-09-19T09:20:29.985958+0000 b149 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d690b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e9:[<0x100000006d6/263.out v412>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008e9:[<0x100000006d6/263.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.195+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/631.out auth v606 ap=1 s=44 n(v0 rc2024-09-19T09:20:31.088946+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d62e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb9:[<0x100000006d6/631.out v570>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bb9:[<0x100000006d6/631.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.196+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/359.out auth v592 ap=1 s=963 n(v0 rc2024-09-19T09:20:30.178956+0000 b963 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a9:[<0x100000006d6/359.out v442>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009a9:[<0x100000006d6/359.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.197+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/524.out auth v594 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.516952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae3:[<0x100000006d6/524.out v528>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ae3:[<0x100000006d6/524.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.197+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/320.out auth v588 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.100957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095b:[<0x100000006d6/320.out v420>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000095b:[<0x100000006d6/320.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.197+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000855 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/189.out auth v602 ap=1 s=496 n(v0 rc2024-09-19T09:20:29.812960+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000855:[<0x100000006d6/189.out v348>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000855:[<0x100000006d6/189.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.198+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/527.out auth v600 ap=1 s=309 n(v0 rc2024-09-19T09:20:30.523952+0000 b309 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae9:[<0x100000006d6/527.out v530>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ae9:[<0x100000006d6/527.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.198+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b9b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/616.out auth v598 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.058946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b9b:[<0x100000006d6/616.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b9b:[<0x100000006d6/616.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.198+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000791 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/091.out auth v596 ap=1 s=420 n(v0 rc2024-09-19T09:20:29.560963+0000 b420 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000791:[<0x100000006d6/091.out v306>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000791:[<0x100000006d6/091.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.198+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000831 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/171.out auth v604 ap=1 s=244 n(v0 rc2024-09-19T09:20:29.757961+0000 b244 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000831:[<0x100000006d6/171.out v336>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000831:[<0x100000006d6/171.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.595 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.198+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/628.out auth v584 ap=1 s=613 n(v0 rc2024-09-19T09:20:31.082946+0000 b613 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d63f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb3:[<0x100000006d6/628.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bb3:[<0x100000006d6/628.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.198+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/243.out auth v590 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.937959+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d64a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c1:[<0x100000006d6/243.out v372>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008c1:[<0x100000006d6/243.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.199+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bbf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/634.out auth v620 ap=1 s=44 n(v0 rc2024-09-19T09:20:31.094946+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d64a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bbf:[<0x100000006d6/634.out v572>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bbf:[<0x100000006d6/634.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.199+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ab7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/502.out auth v614 ap=1 s=202 n(v0 rc2024-09-19T09:20:30.471953+0000 b202 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d64b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ab7:[<0x100000006d6/502.out v516>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ab7:[<0x100000006d6/502.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.200+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a79 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/471.out auth v616 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.405953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d538c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a79:[<0x100000006d6/471.out v498>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a79:[<0x100000006d6/471.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.200+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000076d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/073.out auth v610 ap=1 s=369 n(v0 rc2024-09-19T09:20:27.494986+0000 b369 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d539180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000076d:[<0x100000006d6/073.out v302>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000076d:[<0x100000006d6/073.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.201+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000879 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/207.out auth v596 ap=1 s=84 n(v0 rc2024-09-19T09:20:29.854960+0000 b84 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d546580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000879:[<0x100000006d6/207.out v350>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000879:[<0x100000006d6/207.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.201+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ae1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/523.out auth v598 ap=1 s=94 n(v0 rc2024-09-19T09:20:30.514952+0000 b94 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d546b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ae1:[<0x100000006d6/523.out v526>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ae1:[<0x100000006d6/523.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.596 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.201+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/119.out auth v582 ap=1 s=1409 n(v0 rc2024-09-19T09:20:29.643962+0000 b1409 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d548100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c9:[<0x100000006d6/119.out v316>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007c9:[<0x100000006d6/119.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.201+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000849 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/183.out auth v590 ap=1 s=627 n(v0 rc2024-09-19T09:20:29.793960+0000 b627 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d548680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000849:[<0x100000006d6/183.out v344>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000849:[<0x100000006d6/183.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.202+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a81 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/475.out auth v580 ap=1 s=44 n(v0 rc2024-09-19T09:20:30.417953+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d548c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a81:[<0x100000006d6/475.out v502>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a81:[<0x100000006d6/475.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.203+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a73 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/468.out auth v608 ap=1 s=543 n(v0 rc2024-09-19T09:20:30.396954+0000 b543 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d552580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a73:[<0x100000006d6/468.out v494>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a73:[<0x100000006d6/468.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.203+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009d9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/391.out auth v604 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.227955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d553080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009d9:[<0x100000006d6/391.out v456>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009d9:[<0x100000006d6/391.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.203+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/124.out auth v588 ap=1 s=25 n(v0 rc2024-09-19T09:20:29.658962+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d553600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d3:[<0x100000006d6/124.out v320>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007d3:[<0x100000006d6/124.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.203+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b2d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/561.out auth v600 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.591951+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d552b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b2d:[<0x100000006d6/561.out v552>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b2d:[<0x100000006d6/561.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.203+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c01 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/667.out auth v614 ap=1 s=496 n(v0 rc2024-09-19T09:20:31.212945+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d549700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c01:[<0x100000006d6/667.out v566>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c01:[<0x100000006d6/667.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.597 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.204+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000730 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/044.out auth v576 ap=1 s=25 n(v0 rc2024-09-19T09:20:27.439986+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d554100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000730:[<0x100000006d6/044.out v180>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000730:[<0x100000006d6/044.out v576>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.204+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008e1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/259.out auth v618 ap=1 s=486 n(v0 rc2024-09-19T09:20:29.975958+0000 b486 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d541700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008e1:[<0x100000006d6/259.out v388>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008e1:[<0x100000006d6/259.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.204+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cf [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/122.out auth v590 ap=1 s=555 n(v0 rc2024-09-19T09:20:29.652962+0000 b555 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d580580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cf:[<0x100000006d6/122.out v318>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007cf:[<0x100000006d6/122.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.204+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a8d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/481.out auth v580 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.429953+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d581080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a8d:[<0x100000006d6/481.out v506>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a8d:[<0x100000006d6/481.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.205+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/097.out auth v602 ap=1 s=1196 n(v0 rc2024-09-19T09:20:29.578963+0000 b1196 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d581b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079d:[<0x100000006d6/097.out v312>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000079d:[<0x100000006d6/097.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.205+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006e0 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/005.out auth v582 ap=1 s=126 n(v0 b126 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d581600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006e0:[<0x100000006d6/005.out v20>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006e0:[<0x100000006d6/005.out v582>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.206+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a95 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/485.out auth v608 ap=1 s=88 n(v0 rc2024-09-19T09:20:30.437953+0000 b88 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d582680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a95:[<0x100000006d6/485.out v508>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a95:[<0x100000006d6/485.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.206+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006fc [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/019.out auth v594 ap=1 s=209 n(v0 b209 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d583700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006fc:[<0x100000006d6/019.out v76>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000006fc:[<0x100000006d6/019.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.206+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aa5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/493.out auth v598 ap=1 s=167 n(v0 rc2024-09-19T09:20:30.453953+0000 b167 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d583180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aa5:[<0x100000006d6/493.out v510>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aa5:[<0x100000006d6/493.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.598 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.206+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000775 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/077.out auth v584 ap=1 s=158 n(v0 rc2024-09-19T09:20:29.511963+0000 b158 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000775:[<0x100000006d6/077.out v304>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000775:[<0x100000006d6/077.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.206+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/117.out auth v596 ap=1 s=295 n(v0 rc2024-09-19T09:20:29.637962+0000 b295 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c5:[<0x100000006d6/117.out v314>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007c5:[<0x100000006d6/117.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.207+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/379.out auth v606 ap=1 s=2567 n(v0 rc2024-09-19T09:20:30.202956+0000 b2567 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009c1:[<0x100000006d6/379.out v450>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009c1:[<0x100000006d6/379.out v606>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.207+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b93 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/612.out auth v600 ap=1 s=570 n(v0 rc2024-09-19T09:20:31.050946+0000 b570 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b93:[<0x100000006d6/612.out v568>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b93:[<0x100000006d6/612.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.208+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/696.out auth v622 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.271944+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3b:[<0x100000006d6/696.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c3b:[<0x100000006d6/696.out v622>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.208+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/355.out auth v620 ap=1 s=331 n(v0 rc2024-09-19T09:20:30.170956+0000 b331 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a1:[<0x100000006d6/355.out v434>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009a1:[<0x100000006d6/355.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.208+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008a5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/229.out auth v578 ap=1 s=1546 n(v0 rc2024-09-19T09:20:29.905959+0000 b1546 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d58f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008a5:[<0x100000006d6/229.out v366>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008a5:[<0x100000006d6/229.out v578>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.209+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a75 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/469.out auth v618 ap=1 s=245 n(v0 rc2024-09-19T09:20:30.399954+0000 b245 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a75:[<0x100000006d6/469.out v474>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a75:[<0x100000006d6/469.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.209+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/637.out auth v598 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.101946+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc5:[<0x100000006d6/637.out v560>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bc5:[<0x100000006d6/637.out v598>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.599 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.209+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c79 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/727.out auth v616 ap=1 s=472 n(v0 rc2024-09-19T09:20:31.357943+0000 b472 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c79:[<0x100000006d6/727.out v582>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c79:[<0x100000006d6/727.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.209+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b13 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/548.out auth v620 ap=1 s=147 n(v0 rc2024-09-19T09:20:30.565952+0000 b147 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3d4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b13:[<0x100000006d6/548.out v514>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b13:[<0x100000006d6/548.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.210+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000728 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/040.out auth v596 ap=1 s=109 n(v0 rc2024-09-19T09:20:27.432986+0000 b109 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000728:[<0x100000006d6/040.out v164>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000728:[<0x100000006d6/040.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.210+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/698.out auth v610 ap=1 s=178 n(v0 rc2024-09-19T09:20:31.275944+0000 b178 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3f:[<0x100000006d6/698.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c3f:[<0x100000006d6/698.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.210+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/115.out auth v594 ap=1 s=378 n(v0 rc2024-09-19T09:20:29.631962+0000 b378 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c1:[<0x100000006d6/115.out v322>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007c1:[<0x100000006d6/115.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.211+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c8d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/737.out auth v630 ap=1 s=665 n(v0 rc2024-09-19T09:20:31.375943+0000 b665 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c8d:[<0x100000006d6/737.out v586>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c8d:[<0x100000006d6/737.out v630>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.212+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000929 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/295.out auth v628 ap=1 s=496 n(v0 rc2024-09-19T09:20:30.052957+0000 b496 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000929:[<0x100000006d6/295.out v406>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000929:[<0x100000006d6/295.out v628>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.600 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.212+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c77 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/726.out auth v614 ap=1 s=1527 n(v0 rc2024-09-19T09:20:31.355943+0000 b1527 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c77:[<0x100000006d6/726.out v580>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c77:[<0x100000006d6/726.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.213+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c97 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/742.out auth v604 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3f8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c97:[<0x100000006d6/742.out v588>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c97:[<0x100000006d6/742.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.213+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/635.out auth v592 ap=1 s=25 n(v0 rc2024-09-19T09:20:31.096946+0000 b25 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d605080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc1:[<0x100000006d6/635.out v556>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bc1:[<0x100000006d6/635.out v592>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.213+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/609.out auth v590 ap=1 s=120 n(v0 rc2024-09-19T09:20:31.044946+0000 b120 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d604b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8d:[<0x100000006d6/609.out v540>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b8d:[<0x100000006d6/609.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.214+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/188.out auth v612 ap=1 s=505 n(v0 rc2024-09-19T09:20:29.808960+0000 b505 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d605600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x100000006d6/188.out v356>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000853:[<0x100000006d6/188.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.214+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000951 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/315.out auth v614 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.090957+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d606680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000951:[<0x100000006d6/315.out v410>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000951:[<0x100000006d6/315.out v614>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.214+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/372.out auth v616 ap=1 s=311 n(v0 rc2024-09-19T09:20:30.188956+0000 b311 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d605b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b3:[<0x100000006d6/372.out v432>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009b3:[<0x100000006d6/372.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.214+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b81 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/603.out auth v620 ap=1 s=1500 n(v0 rc2024-09-19T09:20:31.016947+0000 b1500 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d606100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b81:[<0x100000006d6/603.out v538>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b81:[<0x100000006d6/603.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.214+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/110.out auth v596 ap=1 s=774 n(v0 rc2024-09-19T09:20:29.616962+0000 b774 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d607700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b7:[<0x100000006d6/110.out v318>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007b7:[<0x100000006d6/110.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.601 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.215+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf9 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/663.out auth v588 ap=1 s=501 n(v0 rc2024-09-19T09:20:31.179945+0000 b501 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d611080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf9:[<0x100000006d6/663.out v570>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000bf9:[<0x100000006d6/663.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.215+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/396.out auth v618 ap=1 s=673 n(v0 rc2024-09-19T09:20:30.237955+0000 b673 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d610b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e3:[<0x100000006d6/396.out v442>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009e3:[<0x100000006d6/396.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.216+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082f [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/170.out auth v594 ap=1 s=92 n(v0 rc2024-09-19T09:20:29.755961+0000 b92 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d611b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082f:[<0x100000006d6/170.out v350>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000082f:[<0x100000006d6/170.out v594>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.216+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/246.out auth v604 ap=1 s=124 n(v0 rc2024-09-19T09:20:29.944959+0000 b124 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d612c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c7:[<0x100000006d6/246.out v380>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008c7:[<0x100000006d6/246.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.216+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a91 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/483.out auth v620 ap=1 s=205 n(v0 b205 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a91:[<0x100000006d6/483.out v484>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a91:[<0x100000006d6/483.out v620>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.216+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b67 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/590.out auth v618 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.965947+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b67:[<0x100000006d6/590.out v536>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000b67:[<0x100000006d6/590.out v618>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.217+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a99 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/487.out auth v588 ap=1 s=115 n(v0 rc2024-09-19T09:20:30.441953+0000 b115 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a99:[<0x100000006d6/487.out v488>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000a99:[<0x100000006d6/487.out v588>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.217+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/297.out auth v596 ap=1 s=177 n(v0 rc2024-09-19T09:20:30.056957+0000 b177 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092d:[<0x100000006d6/297.out v408>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000092d:[<0x100000006d6/297.out v596>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.217+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000722 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/037.out auth v580 ap=1 s=7025 n(v0 rc2024-09-19T09:20:27.427986+0000 b7025 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000722:[<0x100000006d6/037.out v152>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000722:[<0x100000006d6/037.out v580>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.602 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.218+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/113.out auth v608 ap=1 s=683 n(v0 rc2024-09-19T09:20:29.625962+0000 b683 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bd:[<0x100000006d6/113.out v320>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000007bd:[<0x100000006d6/113.out v608>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.218+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000977 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/334.out auth v612 ap=1 s=102 n(v0 rc2024-09-19T09:20:30.129957+0000 b102 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000977:[<0x100000006d6/334.out v422>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000977:[<0x100000006d6/334.out v612>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.218+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c81 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/731.out auth v616 ap=1 s=52 n(v0 rc2024-09-19T09:20:31.364943+0000 b52 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c81:[<0x100000006d6/731.out v576>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c81:[<0x100000006d6/731.out v616>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.218+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008c3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/244.out auth v590 ap=1 s=43 n(v0 rc2024-09-19T09:20:29.940959+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008c3:[<0x100000006d6/244.out v378>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000008c3:[<0x100000006d6/244.out v590>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.218+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c11 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/675.out auth v602 ap=1 s=280 n(v0 rc2024-09-19T09:20:31.228944+0000 b280 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c11:[<0x100000006d6/675.out v574>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000c11:[<0x100000006d6/675.out v602>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.219+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000761 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/067.out auth v584 ap=1 s=43 n(v0 rc2024-09-19T09:20:27.483986+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000761:[<0x100000006d6/067.out v278>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000761:[<0x100000006d6/067.out v584>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.219+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/405.out auth v600 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.255955+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f5:[<0x100000006d6/405.out v446>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000009f5:[<0x100000006d6/405.out v600>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.219+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000aef [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/530.out auth v604 ap=1 s=43 n(v0 rc2024-09-19T09:20:30.529952+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000aef:[<0x100000006d6/530.out v508>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000aef:[<0x100000006d6/530.out v604>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.219+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000807 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/150.out auth v610 ap=1 s=121 n(v0 rc2024-09-19T09:20:29.715961+0000 b121 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d5bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000807:[<0x100000006d6/150.out v336>,<0x100000003a5/generic v5268>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000807:[<0x100000006d6/150.out v610>,<0x100000003a5/generic v18919>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.220+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001046 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/332.out auth v608 ap=1 s=217 n(v0 rc2024-09-19T09:20:34.792905+0000 b217 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d724680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001046:[<0x10000000da7/332.out v444>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000001046:[<0x10000000da7/332.out v608>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.603 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.220+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010dc [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/407.out auth v624 ap=1 s=91 n(v0 rc2024-09-19T09:20:34.940903+0000 b91 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d725180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010dc:[<0x10000000da7/407.out v486>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000010dc:[<0x10000000da7/407.out v624>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.221+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001068 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/349.out auth v612 ap=1 s=51 n(v0 b51 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d725700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001068:[<0x10000000da7/349.out v458>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000001068:[<0x10000000da7/349.out v612>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.221+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eee [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/161.out auth v588 ap=1 s=201 n(v0 rc2024-09-19T09:20:34.453909+0000 b201 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d72e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eee:[<0x10000000da7/161.out v354>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000eee:[<0x10000000da7/161.out v588>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.221+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e60 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/090.out auth v620 ap=1 s=703 n(v0 rc2024-09-19T09:20:34.332910+0000 b703 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d72eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e60:[<0x10000000da7/090.out v312>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e60:[<0x10000000da7/090.out v620>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.222+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000faa [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/254.out auth v582 ap=1 s=496 n(v0 rc2024-09-19T09:20:34.634907+0000 b496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d731180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000faa:[<0x10000000da7/254.out v412>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000faa:[<0x10000000da7/254.out v582>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.222+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001056 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/340.out auth v610 ap=1 s=147 n(v0 rc2024-09-19T09:20:34.807905+0000 b147 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d731700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001056:[<0x10000000da7/340.out v450>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000001056:[<0x10000000da7/340.out v610>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.223+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f98 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/245.out auth v604 ap=1 s=319 n(v0 rc2024-09-19T09:20:34.616907+0000 b319 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d73bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f98:[<0x10000000da7/245.out v406>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f98:[<0x10000000da7/245.out v604>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.223+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa0 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/249.out auth v590 ap=1 s=496 n(v0 rc2024-09-19T09:20:34.623907+0000 b496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d73c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa0:[<0x10000000da7/249.out v408>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fa0:[<0x10000000da7/249.out v590>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.224+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc6 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/268.out auth v614 ap=1 s=3160 n(v0 rc2024-09-19T09:20:34.660906+0000 b3160 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d750b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc6:[<0x10000000da7/268.out v412>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fc6:[<0x10000000da7/268.out v614>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.604 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.225+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010a6 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/380.out auth v580 ap=1 s=89 n(v0 rc2024-09-19T09:20:34.881904+0000 b89 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d751600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010a6:[<0x10000000da7/380.out v470>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000010a6:[<0x10000000da7/380.out v580>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.225+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/080.out auth v596 ap=1 s=64 n(v0 rc2024-09-19T09:20:34.313910+0000 b64 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d752c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4c:[<0x10000000da7/080.out v308>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e4c:[<0x10000000da7/080.out v596>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.227+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001084 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/363.out auth v588 ap=1 s=75 n(v0 rc2024-09-19T09:20:34.851904+0000 b75 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d75f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001084:[<0x10000000da7/363.out v460>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000001084:[<0x10000000da7/363.out v588>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.227+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/131.out auth v606 ap=1 s=210 n(v0 rc2024-09-19T09:20:34.401909+0000 b210 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d75ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb2:[<0x10000000da7/131.out v346>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000eb2:[<0x10000000da7/131.out v606>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.227+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ef6 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/165.out auth v576 ap=1 s=119676 n(v0 rc2024-09-19T09:20:34.460909+0000 b119676 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ef6:[<0x10000000da7/165.out v368>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ef6:[<0x10000000da7/165.out v576>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.227+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000104e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/336.out auth v574 ap=1 s=165 n(v0 rc2024-09-19T09:20:34.800905+0000 b165 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d70a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000104e:[<0x10000000da7/336.out v448>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000104e:[<0x10000000da7/336.out v574>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.228+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/007.out auth v592 ap=1 s=365 n(v0 rc2024-09-19T09:20:32.536930+0000 b365 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d70bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db5:[<0x10000000da7/007.out v28>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000db5:[<0x10000000da7/007.out v592>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.228+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e50 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/082.out auth v608 ap=1 s=87 n(v0 rc2024-09-19T09:20:34.317910+0000 b87 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d70c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e50:[<0x10000000da7/082.out v310>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e50:[<0x10000000da7/082.out v608>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.229+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/121.out auth v596 ap=1 s=297 n(v0 rc2024-09-19T09:20:34.384909+0000 b297 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d718000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9e:[<0x10000000da7/121.out v342>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e9e:[<0x10000000da7/121.out v596>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.605 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.229+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/248.out auth v580 ap=1 s=496 n(v0 rc2024-09-19T09:20:34.621907+0000 b496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d70d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9e:[<0x10000000da7/248.out v404>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f9e:[<0x10000000da7/248.out v580>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.229+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e33 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/068.out auth v626 ap=1 s=1736 n(v0 rc2024-09-19T09:20:32.658929+0000 b1736 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d718580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e33:[<0x10000000da7/068.out v280>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e33:[<0x10000000da7/068.out v626>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.230+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e27 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/062.out auth v586 ap=1 s=117 n(v0 rc2024-09-19T09:20:32.645929+0000 b117 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d719b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e27:[<0x10000000da7/062.out v256>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e27:[<0x10000000da7/062.out v586>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.231+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/366.out auth v618 ap=1 s=77 n(v0 rc2024-09-19T09:20:34.857904+0000 b77 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d722580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108a:[<0x10000000da7/366.out v464>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000108a:[<0x10000000da7/366.out v618>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.231+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fc2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/266.out auth v594 ap=1 s=6401 n(v0 rc2024-09-19T09:20:34.657906+0000 b6401 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d723080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fc2:[<0x10000000da7/266.out v410>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fc2:[<0x10000000da7/266.out v594>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.232+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/230.out auth v622 ap=1 s=525 n(v0 rc2024-09-19T09:20:34.585907+0000 b525 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d64cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7a:[<0x10000000da7/230.out v396>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f7a:[<0x10000000da7/230.out v622>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.233+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ec2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/139.out auth v610 ap=1 s=220 n(v0 rc2024-09-19T09:20:34.415909+0000 b220 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d65a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ec2:[<0x10000000da7/139.out v348>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ec2:[<0x10000000da7/139.out v610>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.233+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa4 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/251.out auth v576 ap=1 s=496 n(v0 rc2024-09-19T09:20:34.627907+0000 b496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d65b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa4:[<0x10000000da7/251.out v408>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fa4:[<0x10000000da7/251.out v576>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.234+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e72 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/099.out auth v578 ap=1 s=222 n(v0 rc2024-09-19T09:20:34.347910+0000 b222 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d65d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e72:[<0x10000000da7/099.out v320>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e72:[<0x10000000da7/099.out v578>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.606 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.235+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe4 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/283.out auth v582 ap=1 s=6254 n(v0 rc2024-09-19T09:20:34.688906+0000 b6254 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d667600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe4:[<0x10000000da7/283.out v422>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fe4:[<0x10000000da7/283.out v582>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.236+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f0e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/177.out auth v608 ap=1 s=497 n(v0 rc2024-09-19T09:20:34.480908+0000 b497 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d668c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f0e:[<0x10000000da7/177.out v364>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f0e:[<0x10000000da7/177.out v608>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.236+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ece [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/145.out auth v598 ap=1 s=102 n(v0 rc2024-09-19T09:20:34.426909+0000 b102 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d672580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ece:[<0x10000000da7/145.out v352>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ece:[<0x10000000da7/145.out v598>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.237+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f66 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/220.out auth v590 ap=1 s=44 n(v0 rc2024-09-19T09:20:34.565907+0000 b44 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f66:[<0x10000000da7/220.out v386>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f66:[<0x10000000da7/220.out v590>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.238+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ebe [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/137.out auth v606 ap=1 s=72 n(v0 rc2024-09-19T09:20:34.411909+0000 b72 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ebe:[<0x10000000da7/137.out v346>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ebe:[<0x10000000da7/137.out v606>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.238+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000107a [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/358.out auth v626 ap=1 s=85 n(v0 rc2024-09-19T09:20:34.842904+0000 b85 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000107a:[<0x10000000da7/358.out v468>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000107a:[<0x10000000da7/358.out v626>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.238+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eae [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/129.out auth v596 ap=1 s=138 n(v0 b138 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eae:[<0x10000000da7/129.out v336>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000eae:[<0x10000000da7/129.out v596>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.240+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eba [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/135.out auth v584 ap=1 s=307 n(v0 rc2024-09-19T09:20:34.408909+0000 b307 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eba:[<0x10000000da7/135.out v340>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000eba:[<0x10000000da7/135.out v584>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.241+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e23 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/060.out auth v598 ap=1 s=6458 n(v0 b6458 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e23:[<0x10000000da7/060.out v248>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e23:[<0x10000000da7/060.out v598>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.241+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100c [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/303.out auth v588 ap=1 s=43 n(v0 rc2024-09-19T09:20:34.727906+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d6e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100c:[<0x10000000da7/303.out v438>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000100c:[<0x10000000da7/303.out v588>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.607 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.242+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd2 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/274.out auth v614 ap=1 s=124 n(v0 b124 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3f9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd2:[<0x10000000da7/274.out v400>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fd2:[<0x10000000da7/274.out v614>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.242+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8e [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/240.out auth v618 ap=1 s=403 n(v0 rc2024-09-19T09:20:34.606907+0000 b403 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d3fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8e:[<0x10000000da7/240.out v374>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f8e:[<0x10000000da7/240.out v618>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.243+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000def [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/034.out auth v612 ap=1 s=67 n(v0 rc2024-09-19T09:20:32.591929+0000 b67 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d404b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000def:[<0x10000000da7/034.out v144>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000def:[<0x10000000da7/034.out v612>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.243+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fce [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/272.out auth v622 ap=1 s=133 n(v0 rc2024-09-19T09:20:34.667906+0000 b133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d405080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fce:[<0x10000000da7/272.out v394>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000fce:[<0x10000000da7/272.out v622>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.243+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dfd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/041.out auth v634 ap=1 s=507 n(v0 b507 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d404000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dfd:[<0x10000000da7/041.out v172>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000dfd:[<0x10000000da7/041.out v634>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.244+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f84 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/235.out auth v638 ap=1 s=210 n(v0 rc2024-09-19T09:20:34.595907+0000 b210 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d405600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f84:[<0x10000000da7/235.out v368>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000f84:[<0x10000000da7/235.out v638>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.244+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e07 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/046.out auth v636 ap=1 s=1448 n(v0 rc2024-09-19T09:20:32.615929+0000 b1448 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d405b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e07:[<0x10000000da7/046.out v192>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e07:[<0x10000000da7/046.out v636>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.245+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e01 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/043.out auth v584 ap=1 s=5220 n(v0 rc2024-09-19T09:20:32.609929+0000 b5220 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d407180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e01:[<0x10000000da7/043.out v180>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000e01:[<0x10000000da7/043.out v584>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.245+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/018.out auth v598 ap=1 s=6363 n(v0 rc2024-09-19T09:20:32.558930+0000 b6363 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d406c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcb:[<0x10000000da7/018.out v72>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000dcb:[<0x10000000da7/018.out v598>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.608 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.245+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/035.out auth v616 ap=1 s=3736 n(v0 rc2024-09-19T09:20:32.593929+0000 b3736 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d451600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df1:[<0x10000000da7/035.out v148>,<0x100000003a5/xfs v7818>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000df1:[<0x10000000da7/035.out v616>,<0x100000003a5/xfs v22209>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.246+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dd [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/027.out auth v746 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.458240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003dd:[<0x100000003a7/027.out v108>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003dd:[<0x100000003a7/027.out v746>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.246+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000417 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/056.out auth v730 ap=1 s=2419 n(v0 b2419 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000417:[<0x100000003a7/056.out v224>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000417:[<0x100000003a7/056.out v730>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.247+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/186.out auth{0=1} v1071 ap=1 s=403 n(v0 rc2024-09-19T09:20:26.890992+0000 b403 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d2e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051b:[<0x100000003a7/186.out v952>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000051b:[<0x100000003a7/186.out v1071>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.247+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000425 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/063.out auth v882 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.513240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d2e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000425:[<0x100000003a7/063.out v252>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000425:[<0x100000003a7/063.out v882>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.248+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/167.out auth{0=1} v1093 ap=1 s=43 n(v0 rc2024-09-19T09:20:26.844993+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d2feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f5:[<0x100000003a7/167.out v948>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000004f5:[<0x100000003a7/167.out v1093>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.249+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000461 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/093.out auth v1021 ap=1 s=1027 n(v0 b1027 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d301180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000461:[<0x100000003a7/093.out v914>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000461:[<0x100000003a7/093.out v1021>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.249+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005eb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/290.out auth v1067 ap=1 s=508 n(v0 rc2024-09-19T09:20:27.136990+0000 b508 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d30a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005eb:[<0x100000003a7/290.out v994>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000005eb:[<0x100000003a7/290.out v1067>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.250+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/138.out auth{0=1} v1065 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d30c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bb:[<0x100000003a7/138.out v930>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000004bb:[<0x100000003a7/138.out v1065>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.250+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000613 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/310.out auth v1061 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d30bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000613:[<0x100000003a7/310.out v1008>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000613:[<0x100000003a7/310.out v1061>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.609 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.251+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000517 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/184.out auth{0=1} v1107 ap=1 s=43 n(v0 rc2024-09-19T09:20:26.885992+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d312000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000517:[<0x100000003a7/184.out v950>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000517:[<0x100000003a7/184.out v1107>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.251+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/013.out auth v708 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.425241+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d30d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c1:[<0x100000003a7/013.out v52>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x100000003c1:[<0x100000003a7/013.out v708>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.251+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000055d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/219.out auth{0=1} v1091 ap=1 s=43 n(v0 rc2024-09-19T09:20:26.967991+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d312b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000055d:[<0x100000003a7/219.out v970>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x1000000055d:[<0x100000003a7/219.out v1091>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.252+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000437 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/072.out auth v844 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.527240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d313600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000437:[<0x100000003a7/072.out v288>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000437:[<0x100000003a7/072.out v844>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.252+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005db [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/282.out auth v1059 ap=1 s=130 n(v0 rc2024-09-19T09:20:27.116990+0000 b130 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d313b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005db:[<0x100000003a7/282.out v990>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000005db:[<0x100000003a7/282.out v1059>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.252+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/149.out auth{0=1} v1015 ap=1 s=412 n(v0 rc2024-09-19T09:20:26.802993+0000 b412 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d314c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d1:[<0x100000003a7/149.out v936>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000004d1:[<0x100000003a7/149.out v1015>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.253+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000415 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/055.out auth v782 ap=1 s=9130 n(v0 rc2024-09-19T09:20:04.501240+0000 b9130 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d31f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000415:[<0x100000003a7/055.out v220>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000415:[<0x100000003a7/055.out v782>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.254+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005ef [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/292.out auth v1049 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d31fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005ef:[<0x100000003a7/292.out v996>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000005ef:[<0x100000003a7/292.out v1049>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.254+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e7 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/160.out auth{0=1} v1085 ap=1 s=115 n(v0 rc2024-09-19T09:20:26.828993+0000 b115 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d31f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e7:[<0x100000003a7/160.out v944>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000004e7:[<0x100000003a7/160.out v1085>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.610 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.255+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005d3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/278.out auth v1075 ap=1 s=31 n(v0 rc2024-09-19T09:20:27.106990+0000 b31 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d321180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005d3:[<0x100000003a7/278.out v986>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000005d3:[<0x100000003a7/278.out v1075>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.611 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.256+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000493 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/118.out auth{0=1} v1013 ap=1 s=43 n(v0 rc2024-09-19T09:20:26.705994+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d329b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000493:[<0x100000003a7/118.out v922>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000493:[<0x100000003a7/118.out v1013>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.611 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.256+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000567 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/224.out auth{0=1} v1079 ap=1 s=43 n(v0 rc2024-09-19T09:20:26.978991+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d32a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000567:[<0x100000003a7/224.out v974>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000567:[<0x100000003a7/224.out v1079>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.611 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.256+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000557 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/216.out auth{0=1} v1043 ap=1 s=43 n(v0 rc2024-09-19T09:20:26.960992+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d32ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000557:[<0x100000003a7/216.out v966>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000557:[<0x100000003a7/216.out v1043>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.256+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/158.out auth{0=1} v1105 ap=1 s=180 n(v0 rc2024-09-19T09:20:26.824993+0000 b180 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561f4d32b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e3:[<0x100000003a7/158.out v942>,<0x100000003a5/btrfs v1913>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x100000004e3:[<0x100000003a7/158.out v1105>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.257+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000419 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/057.out auth v710 ap=1 s=43 n(v0 rc2024-09-19T09:20:04.504240+0000 b43 1=1+0) caps={24851=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561f4d332580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000419:[<0x100000003a7/057.out v228>,<0x100000003a5/btrfs v306>,<0x10000000007/tests v807>,<0x10000000006/xfstests-dev v137>,<0x10000000005/tmp v35>,<0x100000001fb/client.0 v30>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v50>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v52>,<0x1/volumes v50>]//[]","memoryvalue":"(3)0x10000000419:[<0x100000003a7/057.out v710>,<0x100000003a5/btrfs v21501>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.257+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/004.out auth v350 ap=1 s=44 n(v0 rc2024-09-19T09:20:31.428942+0000 b44 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d75f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc3:[<0x10000000cbb/004.out v16>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cc3:[<0x10000000cbb/004.out v350>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.258+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/008.out auth v332 ap=1 s=78 n(v0 rc2024-09-19T09:20:31.435942+0000 b78 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccb:[<0x10000000cbb/008.out v32>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ccb:[<0x10000000cbb/008.out v332>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.258+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/011.out auth v342 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.441942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd1:[<0x10000000cbb/011.out v44>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cd1:[<0x10000000cbb/011.out v342>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.258+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d55 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/077.out auth v318 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.441931+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d55:[<0x10000000cbb/077.out v304>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d55:[<0x10000000cbb/077.out v318>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.612 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.258+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ce1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/019.out auth v308 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.455942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ce1:[<0x10000000cbb/019.out v76>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000ce1:[<0x10000000cbb/019.out v308>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.258+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/117.out auth v314 ap=1 s=43 n(v0 rc2024-09-19T09:20:32.493930+0000 b43 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24851=0-4194304@1} caps={24851=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24851 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8b:[<0x10000000cbb/117.out v306>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d8b:[<0x10000000cbb/117.out v314>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.259+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d4d [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/073.out auth v348 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.555941+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d4d:[<0x10000000cbb/073.out v292>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d4d:[<0x10000000cbb/073.out v348>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.259+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc5 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/005.out auth v340 ap=1 s=43 n(v0 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc5:[<0x10000000cbb/005.out v20>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cc5:[<0x10000000cbb/005.out v340>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.259+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d13 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/044.out auth v324 ap=1 s=186 n(v0 rc2024-09-19T09:20:31.500941+0000 b186 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d76f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d13:[<0x10000000cbb/044.out v176>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d13:[<0x10000000cbb/044.out v324>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.260+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd3 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/012.out auth v310 ap=1 s=81 n(v0 rc2024-09-19T09:20:31.443942+0000 b81 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d778580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd3:[<0x10000000cbb/012.out v48>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cd3:[<0x10000000cbb/012.out v310>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.260+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc1 [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/003.out auth v316 ap=1 s=43 n(v0 rc2024-09-19T09:20:31.426942+0000 b43 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d778b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc1:[<0x10000000cbb/003.out v12>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cc1:[<0x10000000cbb/003.out v316>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.260+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d3b [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/064.out auth v328 ap=1 s=89 n(v0 rc2024-09-19T09:20:31.537941+0000 b89 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d779600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d3b:[<0x10000000cbb/064.out v256>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000d3b:[<0x10000000cbb/064.out v328>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.613 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:20:48.261+0000 7ff9a1177640 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cdb [2,head] /volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/016.out auth v326 ap=1 s=404 n(v0 rc2024-09-19T09:20:31.450942+0000 b404 1=1+0) caps={24851=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561f4d779b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cdb:[<0x10000000cbb/016.out v64>,<0x100000003a5/overlay v5708>,<0x10000000007/tests v2090>,<0x10000000006/xfstests-dev v221>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v50>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v68>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v77>,<0x1/volumes v74>]//[]","memoryvalue":"(3)0x10000000cdb:[<0x10000000cbb/016.out v326>,<0x100000003a5/overlay v19345>,<0x10000000007/tests v2409>,<0x10000000006/xfstests-dev v271>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v68>,<0x100000001fa/48eeea67-3676-48df-8ba4-ca3da54965ee v72>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v92>,<0x1/volumes v79>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T09:20:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether we are cross compiling... no 2024-09-19T09:20:48.614 INFO:tasks.workunit.client.0.smithi046.stdout:checking for suffix of object files... o 2024-09-19T09:20:48.628 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:20:48.659 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:20:48.845 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:20:48.849 INFO:tasks.workunit.client.0.smithi046.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-09-19T09:20:48.855 INFO:tasks.workunit.client.0.smithi046.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:20:48.855 INFO:tasks.workunit.client.0.smithi046.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:20:48.857 INFO:tasks.workunit.client.0.smithi046.stdout:checking for fgrep... /usr/bin/grep -F 2024-09-19T09:20:48.860 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ld used by gcc... /usr/bin/ld 2024-09-19T09:20:48.862 INFO:tasks.workunit.client.0.smithi046.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-09-19T09:20:48.892 INFO:tasks.workunit.client.0.smithi046.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-09-19T09:20:48.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: pgmap v413: 97 pgs: 97 active+clean; 46 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 1.02k op/s 2024-09-19T09:20:48.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub queued for path: / 2024-09-19T09:20:48.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:48.940 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000002f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/append_writer.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/allocstale.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ftrunc.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/unwritten_mmap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/lstat64.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000030b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/e4compact.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.941 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/popattr.py) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_fallocate.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/soak_duration.awk) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_create_short_dirs.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_futimens.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000030d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ext4_resize.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_getcwd.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_attr_corruption.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.942 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/godown.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/uring_read_fault.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_dio.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/bulkstat_null_ocount.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/rewinddir-test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/genhashnames.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_cow_memory_failure.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/writemod.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/attr_replace_test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.943 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/stat_test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/holetest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/detached_mounts_propagation.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/multi_open_unlink.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmapcat.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/readdir-while-renames.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/iopat.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000030a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/dumpfile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.944 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/permname.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill2.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/locktest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.952 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mkswap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.953 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000002ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/deduperace.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.953 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_writev_overlap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.953 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_holes.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.953 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_type.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.953 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_offset.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmap-rw-fault.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/replay-log.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.954 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/SOURCE) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/mount-idmapped.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.955 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/missing.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.956 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:48.957 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:48.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/repair) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/report) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/casefold) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/perf) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.958 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/fail_make_request) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmerror) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/gcov) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.959 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/locktest) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/encrypt) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/preamble) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dump) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/cgroup2) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.960 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/zoned) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/renameat2) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/metadump) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ceph) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/nfs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.961 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ubifs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmflakey) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/filter) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.962 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdelay) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/module) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/reflink) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/test_names) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdust) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmthin) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.963 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/inject) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.964 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/f2fs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.964 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/overlay) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.964 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:48.964 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:48.964 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:48.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:48.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ba5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/621.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000074d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009c7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/601.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.965 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.966 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.966 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.966 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aaf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.966 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.966 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000091d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/289.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/292.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ac5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/566.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/449.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.967 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000799 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/095.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/388.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000abb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/504.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ac7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/510.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000adb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/520.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000751 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/059.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.968 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000907 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/278.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/383.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008d9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/255.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/424.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/708.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.969 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/625.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.970 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/402.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.970 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000937 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.970 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000793 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/092.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.970 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.970 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bfb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/664.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.970 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b45 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/573.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/198.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a21 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/427.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/197.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bd5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/645.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000abd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/505.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.971 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/676.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000771 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/075.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/724.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.972 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/258.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bdf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/650.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/390.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c29 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/687.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.973 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000af9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/535.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/417.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000873 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/204.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c8f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/738.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/141.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.974 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/705.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/459.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000801 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/147.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000af7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/534.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.975 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/669.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.976 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/114.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.976 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/442.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.976 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000096b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/328.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.976 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b4b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.976 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/409.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.977 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/397.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.977 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000acb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/512.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.977 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000081b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.977 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000092b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/296.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.977 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/342.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.977 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000787 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/086.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008a3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/228.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/316.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/104.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/321.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.978 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/341.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000905 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/277.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aa9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/495.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000887 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/214.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/474.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.979 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/357.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/343.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/607.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/309.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/569.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.980 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a2b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/432.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bd9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/647.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000875 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/205.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000765 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/069.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bd3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/644.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/020.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000897 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/222.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/420.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006d8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/001.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000097f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/338.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.982 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000885 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/213.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000917 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/286.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/318.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/333.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/312.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000716 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/032.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.983 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/175.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000933 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/300.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bbb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/632.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/577.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000070c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/027.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aa1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/491.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/430.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.984 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/322.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/186.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/702.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000714 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/031.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/570.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/094.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/144.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.985 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/464.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bd7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/646.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/425.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000083f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/178.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.default) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000074b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/056.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/624.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.986 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000927 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/294.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/063.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000973 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/332.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/587.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/407.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000995 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/349.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ba3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/620.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.987 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c99 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/743.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000081d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/161.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/167.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/202.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000078f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/090.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/102.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b55 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/581.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/588.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.988 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/081.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000073c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.cfg) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bf7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/662.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/412.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000099d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/353.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/703.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/254.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bcd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/641.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000090b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/280.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.989 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000099f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/354.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/340.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000076f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/074.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000861 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/195.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/556.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000be5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/653.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/100.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/605.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b09 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/543.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008c5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/245.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/611.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/256.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.990 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/249.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000726 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/039.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000967 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/326.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000741 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/051.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b17 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/550.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000724 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/038.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000899 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/223.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/172.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/538.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/552.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/549.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000813 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/156.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/247.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000837 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/174.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/421.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/443.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/722.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/680.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/583.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bb5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/629.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/101.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/384.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000949 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/311.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/335.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/574.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.992 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/143.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/400.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/112.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000712 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/030.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/271.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008d5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/253.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aa7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/494.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008a9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/231.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000857 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/190.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000901 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/275.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.993 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000098b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/344.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/686.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/547.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000720 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000087d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/209.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/640.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000083b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/176.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/261.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bb1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/627.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/539.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/693.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000082b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/168.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/194.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.994 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000710 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/029.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000700 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/021.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/166.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006f4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/015.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/380.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009f7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/406.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000981 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/339.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/268.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/452.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000075d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/065.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/461.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000077b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/080.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000909 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/279.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.995 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c0f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/674.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/598.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000777 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/078.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000871 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/203.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/017.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000943 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/308.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007ad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/105.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/723.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006e8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/009.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/111.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.996 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/403.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/242.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ba7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/622.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ad9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/519.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000071c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.cfg) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b4f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/578.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/670.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000859 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/191.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/131.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/116.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ac3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/508.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.997 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/408.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006e2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/006.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/682.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/599.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cb2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/685.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/733.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000789 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/087.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/134.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.998 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000073a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000073f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006da (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/002.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/394.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000090d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/281.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/595.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/725.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c7b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/728.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:48.999 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/473.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000adf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/522.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/079.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b2b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/560.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000af3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/532.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a8f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/482.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b9d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/617.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/061.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000088d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/217.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/540.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000895 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/221.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.000 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000903 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/276.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bf1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/659.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/375.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000785 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/085.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/437.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/545.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/164.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.001 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000783 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/084.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a9b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/488.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000071d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.out.default) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/288.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/419.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.002 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/301.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/227.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/393.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/716.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000745 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/053.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/173.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000094d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/313.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/441.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/133.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.003 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/232.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000991 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/347.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/387.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/250.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/130.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/447.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/260.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000080d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/153.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ba9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/623.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/735.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/606.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a97 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.004 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000919 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/230.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/697.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/120.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000075f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/066.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/139.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000098d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/345.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/413.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b51 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/579.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/165.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/251.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/336.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.005 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a9f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/490.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/691.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b21 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/555.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006e4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/007.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000077f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/082.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/099.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/248.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/121.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000911 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/283.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/572.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/732.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/563.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.006 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000757 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/062.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/177.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000763 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/068.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/564.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ae5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/525.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/695.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/145.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/580.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bbd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/633.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/266.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006f6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a9d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/489.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.007 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/551.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000078b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bcf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/642.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000089d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000881 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008af (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/597.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.008 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006f2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/668.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/679.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.010 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009d5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000706 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000803 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000704 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/690.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000af5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/533.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000921 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/291.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000767 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.011 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/582.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c69 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/719.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000abf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/434.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/327.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/613.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000be1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/651.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/692.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/395.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/730.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/444.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/137.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.012 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b5d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/585.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/496.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/414.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000893 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/220.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b9f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/618.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/565.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.013 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/358.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/479.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/129.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/462.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bc9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/639.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/438.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/135.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ac9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/511.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/429.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/586.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/458.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.014 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/602.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/039.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000939 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/303.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/060.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/038.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/596.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000afb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bf3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/660.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/030.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000769 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.015 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000732 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000738 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bc7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/638.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006ea (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000781 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bdd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/649.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000096f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b8b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/608.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.016 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006ee (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006dc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ad5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000094f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000431 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/069.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/020.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.017 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000815 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/594.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a39 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000be3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/652.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/694.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000043b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/074.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a5d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.018 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000040d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/051.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000845 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c2d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/689.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ab3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/007.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000042f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/068.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000be9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/655.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/476.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000423 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/062.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000961 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/323.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bc3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/636.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.019 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000841 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/179.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000042b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/066.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000409 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/684.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000081f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/162.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/435.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008ad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/233.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000413 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/739.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/681.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000411 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/053.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/274.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.020 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000993 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/348.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/589.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/665.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000072a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/041.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/240.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000421 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/061.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/492.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000071a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/034.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008b1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/235.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/272.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000734 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/046.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a56 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.021 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a69 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/463.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006fa (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/018.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/043.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c4f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/706.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/571.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/741.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/002.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/009.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ce7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/022.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/105.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/111.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cc7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/006.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.022 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/116.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cf5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/029.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cdd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/017.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/078.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/058.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/047.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cf9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/031.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/065.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.023 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ce5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/021.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/015.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/068.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cc9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/007.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/082.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/062.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/066.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/085.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/053.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/079.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.024 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/084.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/061.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d5b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/080.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d8c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cbf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/002.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/101.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/071.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/048.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/045.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ccf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/010.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/026.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.025 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/083.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/060.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ced (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/025.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/052.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/076.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/103.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cd7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/014.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d0f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/042.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ceb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/024.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ce9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/023.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/108.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/070.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.026 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/037.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/067.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/113.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/034.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/041.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d17 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/046.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cdf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/018.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/043.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/035.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/106.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/110.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d0b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/040.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.027 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/115.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/050.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/001.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/114.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cfb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/032.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/086.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/104.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/033.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d51 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/075.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cf3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/028.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/059.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.028 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:48 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.053 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.009+0000 7f227cc1e640 1 -- 172.21.15.46:0/2048336506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2278107840 msgr2=0x7f2278109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.009+0000 7f227cc1e640 1 --2- 172.21.15.46:0/2048336506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2278107840 0x7f2278109cb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2270009900 tx=0x7f227002a410 comp rx=0 tx=0).stop 2024-09-19T09:20:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 -- 172.21.15.46:0/2048336506 shutdown_connections 2024-09-19T09:20:49.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 --2- 172.21.15.46:0/2048336506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2278107840 0x7f2278109cb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 --2- 172.21.15.46:0/2048336506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2278104f10 0x7f2278107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 --2- 172.21.15.46:0/2048336506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22781025e0 0x7f22781049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 -- 172.21.15.46:0/2048336506 >> 172.21.15.46:0/2048336506 conn(0x7f22780fc1e0 msgr2=0x7f22780fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 -- 172.21.15.46:0/2048336506 shutdown_connections 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 -- 172.21.15.46:0/2048336506 wait complete. 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 Processor -- start 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.010+0000 7f227cc1e640 1 -- start start 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 0x7f2278101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2278104f10 0x7f2278100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2278107840 0x7f2278100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f227810d820 con 0x7f22781025e0 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f227810d6a0 con 0x7f2278107840 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f227810d9a0 con 0x7f2278104f10 2024-09-19T09:20:49.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 0x7f2278101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 0x7f2278101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 -- 172.21.15.46:0/147678098 learned_addr learned my addr 172.21.15.46:0/147678098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f2275d9b640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2278104f10 0x7f2278100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f2276d9d640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2278107840 0x7f2278100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 -- 172.21.15.46:0/147678098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2278104f10 msgr2=0x7f2278100590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2278104f10 0x7f2278100590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 -- 172.21.15.46:0/147678098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2278107840 msgr2=0x7f2278100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2278107840 0x7f2278100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 -- 172.21.15.46:0/147678098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278101360 con 0x7f22781025e0 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227659c640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 0x7f2278101f50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f226800eb90 tx=0x7f226800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f226f7fe640 1 -- 172.21.15.46:0/147678098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268004d20 con 0x7f22781025e0 2024-09-19T09:20:49.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f226f7fe640 1 -- 172.21.15.46:0/147678098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f226800ee90 con 0x7f22781025e0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.011+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22781a1f30 con 0x7f22781025e0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.012+0000 7f226f7fe640 1 -- 172.21.15.46:0/147678098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268010830 con 0x7f22781025e0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.012+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22781a2340 con 0x7f22781025e0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.014+0000 7f226f7fe640 1 -- 172.21.15.46:0/147678098 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2268005020 con 0x7f22781025e0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.014+0000 7f227fa91740 1 Processor -- start 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.014+0000 7f227fa91740 1 -- start start 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227fa91740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd69da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227fa91740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd6eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227fa91740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd71830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227fa91740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d54cccd2f0 con 0x55d54cd699a0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227fa91740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d54cc75270 con 0x55d54cd6f370 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227fa91740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d54ccc92b0 con 0x55d54cd6a2e0 2024-09-19T09:20:49.058 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f2276d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd69da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd6eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f2276d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd69da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60074/0 (socket says 172.21.15.46:60074) 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f2276d9d640 1 -- 172.21.15.46:0/3903614753 learned_addr learned my addr 172.21.15.46:0/3903614753 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f2275d9b640 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd71830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f226f7fe640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22640a32f0 0x7f22640a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 -- 172.21.15.46:0/3903614753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 msgr2=0x55d54cd71830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd71830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 -- 172.21.15.46:0/3903614753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 msgr2=0x55d54cd69da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd69da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 -- 172.21.15.46:0/3903614753 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54cc74340 con 0x55d54cd6a2e0 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f2276d9d640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22640a32f0 0x7f22640a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.059 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f226f7fe640 1 -- 172.21.15.46:0/147678098 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f22680cfef0 con 0x7f22781025e0 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.015+0000 7f227659c640 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd6eda0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22680cd9f0 tx=0x7f22680c7310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=956ff44f7c63b24f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f226cff9640 1 -- 172.21.15.46:0/3903614753 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226809c310 con 0x55d54cd6a2e0 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f226cff9640 1 -- 172.21.15.46:0/3903614753 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22680bc070 con 0x55d54cd6a2e0 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f226cff9640 1 -- 172.21.15.46:0/3903614753 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226809bea0 con 0x55d54cd6a2e0 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 -- 172.21.15.46:0/3903614753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 msgr2=0x55d54cd6eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f2276d9d640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22640a32f0 0x7f22640a57b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2270006010 tx=0x7f2270009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd6eda0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f22680cd9f0 tx=0x7f22680c7310 comp rx=0 tx=0).stop 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 -- 172.21.15.46:0/3903614753 shutdown_connections 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd71830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd6eda0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 --2- 172.21.15.46:0/3903614753 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd69da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.060 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.016+0000 7f227fa91740 1 -- 172.21.15.46:0/3903614753 >> 172.21.15.46:0/3903614753 conn(0x55d54cd65010 msgr2=0x55d54cd65410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 -- 172.21.15.46:0/3903614753 shutdown_connections 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 -- 172.21.15.46:0/3903614753 wait complete. 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 -- start start 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 Processor -- start 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd73aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd73fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd7b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d54cd72280 con 0x55d54cd6a2e0 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d54cc56290 con 0x55d54cd6f370 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d54cd72400 con 0x55d54cd699a0 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227fa91740 10 client.0 _ll_register_callbacks cb 0x55d54cc87140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f2275d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd73fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.061 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f2275d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd73fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60090/0 (socket says 172.21.15.46:60090) 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f2275d9b640 1 -- 172.21.15.46:0/211712225 learned_addr learned my addr 172.21.15.46:0/211712225 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f227659c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd73aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.017+0000 7f2276d9d640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd7b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227659c640 1 -- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 msgr2=0x55d54cd7b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227659c640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd7b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227659c640 1 -- 172.21.15.46:0/211712225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 msgr2=0x55d54cd73fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227659c640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd73fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227659c640 1 -- 172.21.15.46:0/211712225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54c9e0210 con 0x55d54cd699a0 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f2275d9b640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd73fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f2276d9d640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd7b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227659c640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd73aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2268009270 tx=0x7f2268005960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4300cf5cc85a569 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.062 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f225dffb640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f225dffb640 1 -- 172.21.15.46:0/211712225 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226809c080 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f225dffb640 1 -- 172.21.15.46:0/211712225 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f226809a840 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22680bc070 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f225dffb640 1 -- 172.21.15.46:0/211712225 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f226809bea0 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 10 client.25648 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d54caac620 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f225dffb640 1 -- 172.21.15.46:0/211712225 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22680bc070 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f225dffb640 1 -- 172.21.15.46:0/211712225 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f2268098bb0 con 0x55d54cd699a0 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 10 client.25648 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 10 client.25648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 20 client.25648 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cd7f370 0x55d54cd817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.063 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 4 client.25648 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.018+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d54ccdaa20 con 0x55d54cd7f370 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.019+0000 7f2275d9b640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cd7f370 0x55d54cd817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.019+0000 7f225dffb640 10 client.25648 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.019+0000 7f2275d9b640 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cd7f370 0x55d54cd817a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda6c4f088ffc4ed server_cookie=14eb75670923fbe2 in_seq=0 out_seq=0 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f225dffb640 1 -- 172.21.15.46:0/211712225 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d54ccdaa20 con 0x55d54cd7f370 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f225dffb640 10 client.25648 handle_command_reply: tid=0 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 client.25648 shutdown 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 msgr2=0x55d54cd73aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd73aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2268009270 tx=0x7f2268005960 comp rx=0 tx=0).stop 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 shutdown_connections 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cd7f370 0x55d54cd817a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd73fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd7b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 --2- 172.21.15.46:0/211712225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd73aa0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f225dffb640 0 client.25648 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 >> 172.21.15.46:0/211712225 conn(0x55d54cd65010 msgr2=0x55d54cd66820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 shutdown_connections 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 1 -- 172.21.15.46:0/211712225 wait complete. 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.020+0000 7f227fa91740 20 client.25648 trim_cache size 0 max 16384 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 Processor -- start 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 -- start start 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd7afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd63ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f22781ab140 con 0x55d54cd699a0 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22781acd40 con 0x55d54cd6f370 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227fa91740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22781ab810 con 0x55d54cd6a2e0 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60098/0 (socket says 172.21.15.46:60098) 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 -- 172.21.15.46:0/3065960573 learned_addr learned my addr 172.21.15.46:0/3065960573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f2275d9b640 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd7afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f2276d9d640 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd63ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 -- 172.21.15.46:0/3065960573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 msgr2=0x55d54cd7afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd7afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 -- 172.21.15.46:0/3065960573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 msgr2=0x55d54cd63ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd63ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 -- 172.21.15.46:0/3065960573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54cd71ce0 con 0x55d54cd699a0 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f2275d9b640 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd7afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.036+0000 7f227659c640 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd639a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f22680989a0 tx=0x7f2268004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6742586bcc6e43bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f225ffff640 1 -- 172.21.15.46:0/3065960573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226809c310 con 0x55d54cd699a0 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f225ffff640 1 -- 172.21.15.46:0/3065960573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22680bc040 con 0x55d54cd699a0 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f225ffff640 1 -- 172.21.15.46:0/3065960573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226809c540 con 0x55d54cd699a0 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 -- 172.21.15.46:0/3065960573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 msgr2=0x55d54cd639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd639a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f22680989a0 tx=0x7f2268004ec0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 -- 172.21.15.46:0/3065960573 shutdown_connections 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cd63ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd6a2e0 0x55d54cd7afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 --2- 172.21.15.46:0/3065960573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd699a0 0x55d54cd639a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 -- 172.21.15.46:0/3065960573 >> 172.21.15.46:0/3065960573 conn(0x55d54cd65010 msgr2=0x55d54cd73850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 -- 172.21.15.46:0/3065960573 shutdown_connections 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 -- 172.21.15.46:0/3065960573 wait complete. 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.037+0000 7f227fa91740 1 -- start start 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 Processor -- start 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd78650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cde8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f22781ac5b0 con 0x55d54cd6a2e0 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22781abee0 con 0x55d54cd6f370 2024-09-19T09:20:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22781a9120 con 0x55d54cd699a0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227fa91740 10 client.0 _ll_register_callbacks cb 0x7f22680093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd78650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd78650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60112/0 (socket says 172.21.15.46:60112) 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 -- 172.21.15.46:0/713217388 learned_addr learned my addr 172.21.15.46:0/713217388 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2276d9d640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cde8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f227659c640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 -- 172.21.15.46:0/713217388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 msgr2=0x55d54cd78110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd78110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 -- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 msgr2=0x55d54cde8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cde8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 -- 172.21.15.46:0/713217388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54cde8680 con 0x55d54cd6a2e0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f2275d9b640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd78650 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2260000c00 tx=0x7f2260012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d09143bca347ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.038+0000 7f225dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f225dffb640 1 -- 172.21.15.46:0/713217388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226002b060 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f225dffb640 1 -- 172.21.15.46:0/713217388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f2260010c90 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22680bc040 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f225dffb640 1 -- 172.21.15.46:0/713217388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f226001f400 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 10 client.16197 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d54cde9a60 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f225dffb640 1 -- 172.21.15.46:0/713217388 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22680bc040 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f225dffb640 1 -- 172.21.15.46:0/713217388 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f2260025030 con 0x55d54cd6a2e0 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 10 client.16197 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 20 client.16197 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cdea4b0 0x55d54cdec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 4 client.16197 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:20:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d54ccd4d70 con 0x55d54cdea4b0 2024-09-19T09:20:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.039+0000 7f227659c640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cdea4b0 0x55d54cdec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.040+0000 7f227659c640 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cdea4b0 0x55d54cdec8d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f4ecbd8df186016 server_cookie=fb432ba380c31ba1 in_seq=0 out_seq=0 2024-09-19T09:20:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.040+0000 7f225dffb640 10 client.16197 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:49.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: pgmap v413: 97 pgs: 97 active+clean; 46 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 1.02k op/s 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub queued for path: / 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000002f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/append_writer.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.290 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/allocstale.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ftrunc.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/unwritten_mmap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/lstat64.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000030b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/e4compact.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/popattr.py) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_fallocate.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/soak_duration.awk) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_create_short_dirs.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_futimens.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000030d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ext4_resize.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.291 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_getcwd.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.292 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_attr_corruption.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.292 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/godown.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.292 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/uring_read_fault.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.292 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_dio.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.292 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/bulkstat_null_ocount.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/rewinddir-test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/genhashnames.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_cow_memory_failure.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/writemod.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.293 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/attr_replace_test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.294 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/stat_test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.294 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/holetest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.294 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/detached_mounts_propagation.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.294 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/multi_open_unlink.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.294 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmapcat.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/readdir-while-renames.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/iopat.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000030a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/dumpfile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/permname.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill2.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.295 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.296 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/locktest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.296 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mkswap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.296 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000002ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/deduperace.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.296 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_writev_overlap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.296 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_holes.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.296 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_type.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.297 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_offset.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.297 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmap-rw-fault.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.297 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/replay-log.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.297 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.297 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.298 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.298 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/SOURCE) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.298 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.298 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.298 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/mount-idmapped.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.298 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.299 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/missing.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.299 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.299 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.299 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.299 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.299 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.300 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.300 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.300 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.300 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:49.300 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/repair) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.300 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/report) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.301 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.301 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/casefold) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.301 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/perf) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.301 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/fail_make_request) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.302 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmerror) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.302 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.302 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/gcov) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.302 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.302 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/locktest) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.303 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/encrypt) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.303 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/preamble) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.303 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dump) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.303 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/cgroup2) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.303 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/zoned) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.303 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/renameat2) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.304 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.304 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/metadump) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.304 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ceph) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.304 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/nfs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.304 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ubifs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.305 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmflakey) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.305 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/filter) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.305 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdelay) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.305 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/module) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.305 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/reflink) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.305 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/test_names) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdust) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmthin) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/inject) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/f2fs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/overlay) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:49.306 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ba5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/621.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000074d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009c7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/601.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.307 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.308 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.308 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aaf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.308 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.314 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:20:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.272+0000 7f225dffb640 1 -- 172.21.15.46:0/713217388 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d54ccd4d70 con 0x55d54cdea4b0 2024-09-19T09:20:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.272+0000 7f225dffb640 10 client.16197 handle_command_reply: tid=0 2024-09-19T09:20:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.272+0000 7f227fa91740 1 client.16197 shutdown 2024-09-19T09:20:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 msgr2=0x55d54cd78650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd78650 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2260000c00 tx=0x7f2260012be0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 shutdown_connections 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d54cdea4b0 0x55d54cdec8d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f225dffb640 0 client.16197 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d54cd6a2e0 0x55d54cd78650 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d54cd6f370 0x55d54cde8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 --2- 172.21.15.46:0/713217388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d54cd699a0 0x55d54cd78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 >> 172.21.15.46:0/713217388 conn(0x55d54cd65010 msgr2=0x55d54cd639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 shutdown_connections 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.273+0000 7f227fa91740 1 -- 172.21.15.46:0/713217388 wait complete. 2024-09-19T09:20:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227fa91740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T09:20:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:20:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:20:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:20:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22640a32f0 msgr2=0x7f22640a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22640a32f0 0x7f22640a57b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2270006010 tx=0x7f2270009260 comp rx=0 tx=0).stop 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 msgr2=0x7f2278101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 0x7f2278101f50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f226800eb90 tx=0x7f226800c6a0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 shutdown_connections 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22640a32f0 0x7f22640a57b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2278107840 0x7f2278100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2278104f10 0x7f2278100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 --2- 172.21.15.46:0/147678098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22781025e0 0x7f2278101f50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 >> 172.21.15.46:0/147678098 conn(0x7f22780fc1e0 msgr2=0x7f2278102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 shutdown_connections 2024-09-19T09:20:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:20:49.274+0000 7f227cc1e640 1 -- 172.21.15.46:0/147678098 wait complete. 2024-09-19T09:20:49.325 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000091d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/289.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.325 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/292.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.325 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ac5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.325 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/566.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.325 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/449.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.325 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000799 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/095.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/388.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000abb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/504.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ac7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/510.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000adb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/520.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000751 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/059.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000907 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/278.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/383.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.326 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008d9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/255.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.327 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/424.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.327 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/708.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.327 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/625.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.327 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/402.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.327 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000937 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.327 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000793 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/092.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.328 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.328 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bfb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/664.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.328 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b45 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/573.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.328 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/198.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.328 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a21 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/427.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.328 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/197.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bd5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/645.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000abd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/505.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/676.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000771 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/075.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/724.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/258.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bdf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/650.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.329 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/390.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c29 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/687.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000af9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/535.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/417.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000873 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/204.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c8f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/738.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/141.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/705.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/459.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000801 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/147.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000af7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/534.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/669.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.330 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/114.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/442.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000096b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/328.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b4b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/409.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/397.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000acb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/512.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000081b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000092b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/296.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/342.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000787 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/086.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008a3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/228.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/316.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.331 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/104.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/321.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/341.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000905 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/277.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aa9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/495.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000887 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/214.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/474.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/357.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/343.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/607.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.332 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/309.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/569.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a2b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/432.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bd9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/647.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000875 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/205.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000765 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/069.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bd3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/644.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/020.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000897 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/222.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/420.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006d8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/001.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.333 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000097f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/338.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000885 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/213.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000917 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/286.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/318.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/333.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/312.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000716 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/032.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/175.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000933 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/300.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bbb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/632.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/577.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000070c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/027.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aa1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/491.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.334 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/430.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/322.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/186.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/702.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000714 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/031.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/570.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/094.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/144.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/464.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bd7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/646.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/425.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000083f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/178.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.335 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.default) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000074b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/056.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/624.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000927 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/294.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/063.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000973 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/332.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/587.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/407.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000995 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/349.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ba3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/620.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.336 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c99 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/743.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000081d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/161.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/167.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/202.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000078f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/090.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/102.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b55 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/581.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/588.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/081.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000073c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.cfg) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bf7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/662.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/412.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.337 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000099d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/353.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/703.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/254.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bcd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/641.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000090b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/280.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000099f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/354.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/340.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000076f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/074.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.338 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000861 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/195.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/556.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000be5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/653.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/100.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/605.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b09 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/543.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008c5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/245.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.339 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/611.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/256.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/249.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000726 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/039.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000967 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/326.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000741 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/051.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b17 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/550.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000724 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/038.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000899 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/223.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.340 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/172.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/538.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/552.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/549.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000813 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/156.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/247.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000837 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/174.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/421.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/443.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/722.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/680.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/583.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.341 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bb5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/629.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/101.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/384.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000949 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/311.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/335.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/574.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/143.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/400.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/112.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000712 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/030.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/271.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.342 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008d5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/253.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aa7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/494.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008a9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/231.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000857 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/190.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000901 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/275.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000098b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/344.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/686.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.343 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/547.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000720 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000087d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/209.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/640.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000083b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/176.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/261.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bb1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/627.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/539.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/693.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.344 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000082b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/168.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/194.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000710 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/029.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000700 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/021.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/166.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006f4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/015.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/380.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009f7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/406.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000981 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/339.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/268.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/452.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000075d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/065.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.345 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/461.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000077b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/080.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000909 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/279.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c0f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/674.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/598.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000777 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/078.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000871 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/203.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/017.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000943 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/308.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007ad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/105.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.346 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/723.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006e8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/009.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/111.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/403.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/242.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ba7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/622.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ad9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/519.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000071c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.cfg) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b4f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/578.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/670.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000859 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/191.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/131.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.347 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/116.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ac3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/508.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/408.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006e2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/006.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/682.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/599.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cb2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/685.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/733.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000789 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/087.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/134.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000073a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.348 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000073f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006da (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/002.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/394.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000090d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/281.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/595.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/725.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c7b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/728.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/473.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000adf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/522.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/079.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.349 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b2b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/560.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.350 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000af3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/532.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.351 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a8f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/482.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.351 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b9d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/617.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.351 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/061.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.351 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000088d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/217.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.351 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/540.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000895 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/221.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000903 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/276.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bf1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/659.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/375.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000785 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/085.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/437.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.352 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/545.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/164.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000783 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/084.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a9b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/488.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000071d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.out.default) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/288.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.353 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/419.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/301.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/227.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/393.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/716.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000745 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/053.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/173.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000094d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/313.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.354 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/441.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/133.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/232.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000991 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/347.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/387.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/250.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/130.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.355 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/447.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/260.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000080d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/153.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ba9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/623.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/735.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/606.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a97 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.356 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000919 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/230.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/697.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/120.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000075f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/066.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/139.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000098d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/345.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.357 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/413.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b51 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/579.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/165.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/251.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/336.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a9f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/490.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/691.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b21 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/555.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.358 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006e4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/007.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000077f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/082.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/099.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/248.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/121.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000911 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/283.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/572.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/732.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.359 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/563.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000757 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/062.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/177.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000763 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/068.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/564.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ae5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/525.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/695.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/145.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.360 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/580.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bbd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/633.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/266.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006f6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a9d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/489.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/551.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.361 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000078b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bcf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/642.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000089d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000881 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008af (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/597.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.362 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006f2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/668.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/679.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009d5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000706 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000803 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000704 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.363 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/690.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000af5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/533.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000921 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/291.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.364 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000767 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/582.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c69 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/719.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000abf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/434.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/327.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/613.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000be1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/651.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.365 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/692.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/395.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/730.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/444.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/137.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b5d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/585.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/496.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/414.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000893 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/220.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.366 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b9f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/618.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/565.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/358.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/479.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/129.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/462.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bc9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/639.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/438.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/135.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ac9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/511.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/429.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/586.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.367 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/458.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/602.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/039.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000939 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/303.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/060.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/038.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/596.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000afb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bf3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/660.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.368 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/030.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000769 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000732 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000738 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bc7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/638.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.369 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006ea (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000781 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bdd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/649.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000096f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b8b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/608.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006ee (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006dc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ad5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000094f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.370 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000431 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/069.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/020.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000815 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/594.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a39 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000be3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/652.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/694.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000043b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/074.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.371 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a5d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000040d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/051.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000845 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c2d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/689.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ab3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/007.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000042f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/068.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.372 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000be9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/655.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/476.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000423 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/062.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000961 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/323.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bc3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/636.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000841 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/179.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000042b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/066.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000409 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/684.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000081f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/162.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/435.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008ad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/233.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.373 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000413 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/739.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/681.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000411 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/053.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/274.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000993 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/348.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/589.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/665.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000072a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/041.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/240.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000421 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/061.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/492.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000071a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/034.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.374 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008b1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/235.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/272.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000734 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/046.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a56 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a69 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/463.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006fa (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/018.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/043.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c4f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/706.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/571.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/741.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/002.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/009.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.375 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ce7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/022.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/105.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/111.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cc7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/006.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/116.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cf5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/029.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cdd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/017.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/078.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/058.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/047.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cf9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/031.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/065.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ce5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/021.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.376 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/015.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/068.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cc9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/007.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/082.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/062.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/066.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/085.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/053.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/079.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/084.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/061.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.377 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d5b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/080.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d8c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cbf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/002.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/101.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/071.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/048.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/045.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ccf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/010.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/026.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/083.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/060.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ced (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/025.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.378 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/052.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/076.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/103.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cd7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/014.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d0f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/042.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ceb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/024.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ce9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/023.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/108.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/070.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/037.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.379 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/067.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/113.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/034.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/041.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d17 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/046.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cdf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/018.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/043.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/035.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/106.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/110.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d0b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/040.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/115.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.380 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/050.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/001.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/114.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cfb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/032.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/086.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/104.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/033.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d51 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/075.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cf3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/028.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/059.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.381 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:48 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.383 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: pgmap v413: 97 pgs: 97 active+clean; 46 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 1.02k op/s 2024-09-19T09:20:49.383 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub queued for path: / 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000002f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/append_writer.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/allocstale.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ftrunc.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/unwritten_mmap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/lstat64.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000030b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/e4compact.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.384 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/popattr.py) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_fallocate.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/soak_duration.awk) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_create_short_dirs.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_futimens.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000030d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ext4_resize.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_getcwd.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_attr_corruption.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/godown.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/uring_read_fault.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_dio.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/bulkstat_null_ocount.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/rewinddir-test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.385 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/genhashnames.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_cow_memory_failure.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/writemod.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/attr_replace_test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/stat_test.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/holetest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/detached_mounts_propagation.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/multi_open_unlink.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmapcat.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/readdir-while-renames.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/iopat.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000030a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/dumpfile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/permname.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.386 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill2.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/locktest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mkswap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000002ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/deduperace.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_writev_overlap.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_holes.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_type.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_offset.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmap-rw-fault.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/replay-log.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.387 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/SOURCE) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/mount-idmapped.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/missing.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.c) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.388 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.h) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/repair) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/report) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmlogwrites) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/casefold) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/perf) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/fail_make_request) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmerror) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/scsi_debug) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.389 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/gcov) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmhugedisk) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/locktest) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/encrypt) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/preamble) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dump) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/cgroup2) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/zoned) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/renameat2) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/metadump) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ceph) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/nfs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.390 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ubifs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmflakey) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/filter) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdelay) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/module) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/reflink) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/test_names) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdust) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmthin) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/inject) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/f2fs) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/overlay) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.391 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ba5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/621.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000074d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/057.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009c7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/382.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/601.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/446.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/385.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/436.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aaf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/498.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.392 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/455.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000091d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/289.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/292.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ac5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/509.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/566.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/449.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000799 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/095.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/388.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000abb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/504.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ac7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/510.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000adb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/520.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000751 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/059.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.393 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000907 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/278.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/383.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008d9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/255.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/424.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/708.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/625.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/402.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000937 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/302.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000793 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/092.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/401.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bfb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/664.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b45 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/573.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.394 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/198.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a21 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/427.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/197.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bd5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/645.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000abd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/505.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/676.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/149.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000771 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/075.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/724.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.395 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/258.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/478.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bdf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/650.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/390.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c29 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/687.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000af9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/535.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/417.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000873 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/204.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c8f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/738.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/141.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/705.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.396 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/459.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/055.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000801 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/147.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000af7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/534.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/669.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/114.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/442.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000096b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/328.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b4b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/576.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/409.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/397.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000acb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/512.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.397 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000081b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/160.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000092b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/296.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/342.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000787 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/086.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008a3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/228.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/316.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/104.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/321.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/341.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000905 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/277.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aa9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/495.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000887 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/214.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.398 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/474.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/357.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/343.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/607.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/309.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/569.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a2b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/432.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bd9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/647.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000875 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/205.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000765 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/069.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bd3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/644.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.399 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006fe (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/020.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000897 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/222.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/420.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006d8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/001.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000097f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/338.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000885 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/213.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000917 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/286.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/318.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/333.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/312.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000716 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/032.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.400 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/175.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000933 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/300.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bbb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/632.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/577.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000070c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/027.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aa1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/491.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/430.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/322.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/186.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/702.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000714 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/031.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/570.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.401 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000797 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/094.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/144.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/464.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bd7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/646.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/425.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000083f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/178.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000073d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.default) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000074b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/056.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/624.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000927 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/294.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/063.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000973 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/332.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/587.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.402 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/407.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000995 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/349.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ba3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/620.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c99 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/743.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000081d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/161.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/167.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000086f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/202.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000078f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/090.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/102.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b55 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/581.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/588.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000077d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/081.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000073c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.cfg) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.403 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bf7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/662.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/412.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000099d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/353.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/703.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/254.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bcd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/641.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000090b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/280.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000099f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/354.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/340.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000076f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/074.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000861 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/195.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/556.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.404 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000be5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/653.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/100.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/605.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b09 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/543.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008c5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/245.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/611.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/256.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/249.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000726 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/039.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000967 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/326.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000741 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/051.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b17 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/550.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.405 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000724 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/038.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000899 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/223.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/172.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/538.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/552.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/549.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000813 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/156.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/247.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000837 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/174.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/421.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/443.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/722.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/680.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.406 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/583.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bb5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/629.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/101.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/384.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000949 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/311.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/335.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/574.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/143.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/400.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/112.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000712 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/030.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008f9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/271.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.407 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008d5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/253.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aa7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/494.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008a9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/231.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000857 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/190.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000901 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/275.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000098b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/344.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/686.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/547.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000720 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000087d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/209.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/640.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000083b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/176.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/261.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.408 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bb1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/627.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/539.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/693.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000082b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/168.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/194.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000710 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/029.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000700 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/021.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/166.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006f4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/015.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/380.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009f7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/406.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.409 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000981 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/339.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/268.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/452.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000075d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/065.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/461.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000077b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/080.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000909 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/279.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c0f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/674.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/598.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000777 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/078.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000871 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/203.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006f8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/017.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000943 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/308.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.410 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007ad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/105.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/723.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006e8 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/009.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/111.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/403.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008bf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/242.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ba7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/622.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ad9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/519.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000071c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.cfg) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b4f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/578.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/670.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000859 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/191.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.411 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/131.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/116.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ac3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/508.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/408.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006e2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/006.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/682.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/599.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cb2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/685.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/733.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000789 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/087.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/134.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.412 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000073a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000073f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006da (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/002.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/394.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000090d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/281.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/595.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/725.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c7b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/728.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/473.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000adf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/522.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000779 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/079.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b2b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/560.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.413 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000af3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/532.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a8f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/482.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b9d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/617.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/061.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000088d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/217.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/540.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000895 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/221.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000903 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/276.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bf1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/659.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/375.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000785 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/085.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/437.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/545.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.414 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/164.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000783 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/084.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a9b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/488.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000071d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.out.default) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/288.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/419.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/301.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/227.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/393.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/716.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000745 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/053.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.415 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/173.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000094d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/313.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/441.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007e5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/133.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/232.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000991 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/347.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/387.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/250.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007df (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/130.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/447.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/260.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.416 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000080d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/153.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ba9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/623.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/735.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/606.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a97 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/486.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000919 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/287.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/230.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/697.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/120.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000075f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/066.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007f1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/139.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000098d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/345.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.417 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/413.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b51 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/579.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/165.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/251.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/336.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a9f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/490.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/691.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b21 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/555.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006e4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/007.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000077f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/082.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/099.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008cb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/248.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/121.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.418 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000911 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/283.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/572.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/732.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/563.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000757 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/062.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/177.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000763 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/068.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/564.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ae5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/525.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/695.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007fd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/145.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/470.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.419 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/580.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bbd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/633.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/266.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006f6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/016.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a9d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/489.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/551.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000078b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/088.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bcf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/642.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000089d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/225.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000881 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/211.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008af (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/234.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/132.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.420 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/152.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/597.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006f2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/014.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/668.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/128.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/679.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009d5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/389.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000706 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/024.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000803 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/148.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000704 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/023.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/426.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.421 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/252.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/690.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/108.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/236.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000af5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/533.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000921 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/291.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000767 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/070.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/582.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c69 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/719.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008b9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/239.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000abf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/506.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.422 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/434.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/327.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/613.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000be1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/651.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/692.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/395.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/730.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/444.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/137.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.423 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b5d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/585.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/496.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/414.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000893 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/220.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b9f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/618.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/565.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009a7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/358.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/479.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/129.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/462.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bc9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/639.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/438.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.424 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/135.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ac9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/511.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/429.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/586.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/458.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/602.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/039.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000939 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/303.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.425 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/060.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/038.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/596.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000afb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/536.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bf3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/660.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/398.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/264.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/030.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000769 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/071.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000732 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/045.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/592.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000738 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/048.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.426 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007f7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/142.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000089f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/226.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bc7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/638.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006ea (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/010.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000781 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/083.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bdd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/649.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000096f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/330.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b8b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/608.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006ee (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/012.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006dc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/003.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ad5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/517.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008ed (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/265.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.427 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/477.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000094f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/314.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/542.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000431 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/069.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/020.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000815 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/157.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/594.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.428 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/554.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/541.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a39 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/439.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000be3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/652.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/694.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000043b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/074.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a5d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/457.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/399.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007d7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/126.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/257.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000040d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/051.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000845 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/181.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c2d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/689.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.429 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ab3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/500.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/007.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/064.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000042f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/068.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/568.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000be9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/655.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/476.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000423 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/062.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000961 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/323.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bc3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/636.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000841 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/179.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000042b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/066.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000409 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.430 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/684.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000081f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/162.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/435.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008ad (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/233.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000413 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/739.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/681.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000411 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/053.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/274.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000993 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/348.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/589.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/665.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000072a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/041.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.431 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/240.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000421 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/061.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aa3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/492.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000071a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/034.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008b1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/235.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008fb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/272.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000734 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/046.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a56 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a69 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/463.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006fa (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/018.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000072e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/043.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.432 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c4f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/706.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/571.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/741.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/002.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/009.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ce7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/022.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/105.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d7f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/111.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cc7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/006.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d89 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/116.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cf5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/029.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.433 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cdd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/017.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d57 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/078.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d2f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/058.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d19 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/047.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cf9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/031.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d3d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/065.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ce5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/021.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/015.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d43 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/068.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cc9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/007.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d5f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/082.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d37 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/062.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/066.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.434 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d1d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/049.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d65 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/085.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/054.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/053.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d59 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/079.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d63 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/084.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d35 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/061.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d5b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/080.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d8c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cbf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/002.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d6b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/101.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.435 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d03 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/036.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d49 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/071.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d1b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/048.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d15 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/045.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ccf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/010.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/026.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d61 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/083.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/060.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ced (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/025.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/052.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d53 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/076.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d6f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/103.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cd7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/014.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.436 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d0f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/042.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ceb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/024.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ce9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/023.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/108.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d47 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/070.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d05 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/037.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d41 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/067.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d83 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/113.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/034.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d0d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/041.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d17 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/046.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cdf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/018.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.437 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/043.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/035.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/106.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d7d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/110.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d0b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/040.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d87 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/115.out) see mds.i log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d1f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/050.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/001.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d85 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/114.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cfb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/032.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/086.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.438 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d71 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/104.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/033.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d51 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/075.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cf3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/028.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d31 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/059.out) see mds.c log and `damage ls` output for details 2024-09-19T09:20:49.439 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:48 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:49.638 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: scrub summary: active paths [/] 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a93 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/484.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009bd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009b1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000889 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.149 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000941 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b7b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/600.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bb9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/631.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009a9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/359.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ae3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/524.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000095b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/320.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/189.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ae9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/527.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b9b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/616.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.150 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000791 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/091.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/171.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bb3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/628.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/243.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bbf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/634.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ab7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/502.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/471.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000076d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/073.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000879 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/207.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ae1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/523.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/119.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000849 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/183.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/475.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.151 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/468.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009d9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/391.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/124.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b2d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/561.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/667.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000730 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/044.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000079d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006e0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.152 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000006fc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aa5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000775 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b93 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/612.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/696.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/469.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bc5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/637.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/727.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.153 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/548.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000728 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/040.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/698.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/115.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/737.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000929 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/295.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/726.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c97 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/742.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bc1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/635.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/609.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/188.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/315.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/372.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/603.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.154 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/110.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.155 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000bf9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/663.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/396.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/170.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/246.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/483.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000b67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/590.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000a99 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/487.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000092d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/297.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.156 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/037.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.157 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/113.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.157 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000977 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/334.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.157 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/731.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.157 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/244.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.157 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000c11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/675.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.157 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/067.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000009f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/405.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000aef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/530.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000807 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/150.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000001046 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/332.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000010dc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/407.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/349.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000eee (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/161.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e60 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/090.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000faa (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/254.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/340.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f98 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/245.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/249.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fc6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/268.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.158 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/380.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e4c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/080.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000001084 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/363.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000eb2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/131.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ef6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/165.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000104e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/336.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000db5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/007.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e50 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/082.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/121.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/248.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/068.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/062.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/366.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.159 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/266.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/230.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/139.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/251.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e72 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/099.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/283.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f0e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/177.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/145.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f66 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/220.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ebe (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/137.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/358.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000eae (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/129.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.160 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000eba (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/135.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/060.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/303.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fd2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/274.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f8e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/240.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000def (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/034.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/272.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000dfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/041.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000f84 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/235.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/046.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000e01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/043.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000dcb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/018.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000df1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/035.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.161 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/027.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000417 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/056.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000051b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/186.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000425 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/063.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/167.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000461 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/093.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000005eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/290.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/138.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000613 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/310.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000517 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/184.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/013.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x1000000055d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/219.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/072.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.162 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000005db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/282.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/149.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000415 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/055.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000005ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/292.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/160.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000005d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/278.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/118.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000567 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/224.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000557 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/216.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/158.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000419 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/057.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cc3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/004.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ccb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/008.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.163 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cd1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/011.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d55 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/077.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000ce1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/019.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d8b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/117.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/073.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cc5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/005.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/044.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cd3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/012.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cc1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/003.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000d3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/064.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: Scrub error on inode 0x10000000cdb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/016.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.164 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:49 smithi046 ceph-mon[31203]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: scrub summary: active paths [/] 2024-09-19T09:20:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a93 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/484.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009bd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009b1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000889 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000941 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b7b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/600.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bb9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/631.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009a9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/359.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ae3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/524.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000095b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/320.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.211 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/189.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ae9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/527.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b9b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/616.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000791 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/091.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/171.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bb3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/628.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/243.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bbf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/634.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ab7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/502.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/471.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000076d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/073.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.212 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000879 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/207.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ae1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/523.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/119.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000849 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/183.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/475.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/468.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009d9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/391.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/124.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b2d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/561.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/667.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000730 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/044.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.213 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000079d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006e0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000006fc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aa5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000775 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b93 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/612.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/696.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.214 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/469.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bc5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/637.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/727.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/548.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000728 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/040.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/698.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/115.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/737.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000929 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/295.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/726.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c97 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/742.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.215 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bc1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/635.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/609.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/188.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/315.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/372.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/603.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.216 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/110.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000bf9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/663.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/396.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/170.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/246.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/483.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000b67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/590.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.217 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000a99 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/487.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000092d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/297.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/037.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/113.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000977 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/334.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/731.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/244.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000c11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/675.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/067.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000009f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/405.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000aef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/530.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000807 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/150.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000001046 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/332.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.218 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000010dc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/407.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/349.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000eee (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/161.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e60 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/090.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000faa (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/254.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/340.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f98 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/245.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/249.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fc6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/268.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/380.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e4c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/080.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000001084 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/363.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000eb2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/131.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.219 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ef6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/165.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000104e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/336.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000db5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/007.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e50 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/082.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/121.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/248.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/068.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/062.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/366.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/266.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.220 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/230.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/139.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/251.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e72 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/099.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/283.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f0e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/177.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/145.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f66 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/220.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ebe (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/137.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/358.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000eae (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/129.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000eba (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/135.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/060.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.221 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/303.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fd2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/274.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f8e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/240.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000def (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/034.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/272.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000dfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/041.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000f84 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/235.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/046.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000e01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/043.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000dcb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/018.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000df1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/035.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/027.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000417 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/056.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.222 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000051b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/186.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000425 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/063.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/167.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000461 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/093.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000005eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/290.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/138.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000613 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/310.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000517 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/184.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/013.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x1000000055d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/219.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/072.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000005db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/282.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/149.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.223 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000415 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/055.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000005ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/292.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/160.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000005d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/278.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/118.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000567 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/224.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000557 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/216.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/158.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000419 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/057.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cc3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/004.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ccb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/008.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cd1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/011.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d55 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/077.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.224 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000ce1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/019.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d8b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/117.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/073.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cc5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/005.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/044.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cd3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/012.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cc1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/003.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000d3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/064.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: Scrub error on inode 0x10000000cdb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/016.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.225 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:49 smithi115 ceph-mon[35055]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: scrub summary: active paths [/] 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a93 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/484.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009bd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/377.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b25 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/557.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009b1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/371.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/098.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000889 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/215.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007ff (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/146.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.264 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000941 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/307.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b7b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/600.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/200.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008e9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/263.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bb9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/631.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009a9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/359.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ae3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/524.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000095b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/320.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/189.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ae9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/527.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b9b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/616.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.265 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000791 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/091.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/171.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bb3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/628.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/243.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bbf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/634.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ab7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/502.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/471.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000076d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/073.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000879 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/207.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.266 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ae1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/523.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/119.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000849 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/183.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/475.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a73 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/468.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009d9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/391.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/124.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b2d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/561.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/667.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000730 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/044.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008e1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/259.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.267 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/122.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/481.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000079d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/097.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006e0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/005.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a95 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/485.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000006fc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/019.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aa5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/493.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000775 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/077.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/117.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/379.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b93 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/612.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.268 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/696.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009a1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/355.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008a5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/229.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a75 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/469.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bc5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/637.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c79 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/727.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/548.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000728 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/040.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c3f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/698.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/115.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/737.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.269 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000929 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/295.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c77 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/726.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c97 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/742.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bc1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/635.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/609.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/188.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/315.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009b3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/372.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/603.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/110.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000bf9 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/663.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/396.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.270 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/170.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008c7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/246.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a91 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/483.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000b67 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/590.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000a99 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/487.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000092d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/297.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000722 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/037.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/113.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000977 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/334.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c81 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/731.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000008c3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/244.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.271 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000c11 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/675.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.272 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/067.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.272 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000009f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/405.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.272 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000aef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/530.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.272 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000807 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/150.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000001046 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/332.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000010dc (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/407.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000001068 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/349.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000eee (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/161.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e60 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/090.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000faa (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/254.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000001056 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/340.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f98 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/245.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.273 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/249.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fc6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/268.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000010a6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/380.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e4c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/080.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000001084 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/363.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000eb2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/131.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ef6 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/165.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000104e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/336.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000db5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/007.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e50 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/082.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/121.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.274 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/248.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e33 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/068.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/062.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000108a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/366.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fc2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/266.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/230.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ec2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/139.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/251.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e72 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/099.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/283.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f0e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/177.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.275 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ece (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/145.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f66 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/220.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ebe (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/137.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000107a (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/358.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000eae (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/129.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000eba (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/135.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e23 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/060.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000100c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/303.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fd2 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/274.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f8e (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/240.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000def (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/034.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.276 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000fce (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/272.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.277 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000dfd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/041.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.277 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000f84 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/235.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.280 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e07 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/046.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.280 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000e01 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/043.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.280 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000dcb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/018.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000df1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/035.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003dd (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/027.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000417 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/056.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000051b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/186.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000425 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/063.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/167.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000461 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/093.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000005eb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/290.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/138.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000613 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/310.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000517 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/184.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.281 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/013.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x1000000055d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/219.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000437 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/072.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000005db (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/282.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/149.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000415 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/055.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000005ef (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/292.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/160.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000005d3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/278.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/118.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000567 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/224.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.282 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000557 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/216.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/158.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000419 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/057.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cc3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/004.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ccb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/008.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cd1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/011.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d55 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/077.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000ce1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/019.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d8b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/117.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d4d (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/073.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cc5 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/005.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.283 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d13 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/044.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cd3 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/012.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cc1 (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/003.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000d3b (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/064.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: Scrub error on inode 0x10000000cdb (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/016.out) see mds.h log and `damage ls` output for details 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.284 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:49 smithi099 ceph-mon[35256]: scrub summary: idle+waiting paths [/] 2024-09-19T09:20:50.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.232+0000 7f142a856640 1 -- 172.21.15.46:0/2169718656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1424102d40 msgr2=0x7f1424103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.232+0000 7f142a856640 1 --2- 172.21.15.46:0/2169718656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1424102d40 0x7f1424103120 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f141402a480 comp rx=0 tx=0).stop 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 -- 172.21.15.46:0/2169718656 shutdown_connections 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 --2- 172.21.15.46:0/2169718656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142410c170 0x7f142410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 --2- 172.21.15.46:0/2169718656 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1424103660 0x7f142410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 --2- 172.21.15.46:0/2169718656 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1424102d40 0x7f1424103120 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 -- 172.21.15.46:0/2169718656 >> 172.21.15.46:0/2169718656 conn(0x7f14240fc7a0 msgr2=0x7f14240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:50.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 -- 172.21.15.46:0/2169718656 shutdown_connections 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 -- 172.21.15.46:0/2169718656 wait complete. 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 Processor -- start 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.233+0000 7f142a856640 1 -- start start 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1424102d40 0x7f1424198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1424103660 0x7f1424198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 0x7f142419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1424111fd0 con 0x7f142410c170 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1424111e50 con 0x7f1424102d40 2024-09-19T09:20:50.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1424112150 con 0x7f1424103660 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 0x7f142419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 0x7f142419ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60130/0 (socket says 172.21.15.46:60130) 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 -- 172.21.15.46:0/4021460561 learned_addr learned my addr 172.21.15.46:0/4021460561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1423fff640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1424102d40 0x7f1424198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f14237fe640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1424103660 0x7f1424198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 -- 172.21.15.46:0/4021460561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1424103660 msgr2=0x7f1424198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1424103660 0x7f1424198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 -- 172.21.15.46:0/4021460561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1424102d40 msgr2=0x7f1424198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1424102d40 0x7f1424198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 -- 172.21.15.46:0/4021460561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142419d4e0 con 0x7f142410c170 2024-09-19T09:20:50.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f1428df3640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 0x7f142419ce00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f141c00b970 tx=0x7f141c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f14217fa640 1 -- 172.21.15.46:0/4021460561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c019070 con 0x7f142410c170 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142419d7d0 con 0x7f142410c170 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f14217fa640 1 -- 172.21.15.46:0/4021460561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141c00cb40 con 0x7f142410c170 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14241a50b0 con 0x7f142410c170 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.234+0000 7f14217fa640 1 -- 172.21.15.46:0/4021460561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c007650 con 0x7f142410c170 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f14217fa640 1 -- 172.21.15.46:0/4021460561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f141c01c070 con 0x7f142410c170 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 Processor -- start 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 -- start start 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a74a0 0x55a0e15a7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 0x55a0e15b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15b2680 0x55a0e15b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a0e150d2e0 con 0x55a0e15a7dc0 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a0e14b4ce0 con 0x55a0e15a74a0 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f142cc2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a0e15092a0 con 0x55a0e15b2680 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f1423fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 0x55a0e15b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f1423fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 0x55a0e15b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60144/0 (socket says 172.21.15.46:60144) 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.237+0000 7f1423fff640 1 -- 172.21.15.46:0/2167576883 learned_addr learned my addr 172.21.15.46:0/2167576883 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f14237fe640 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a74a0 0x55a0e15a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f14217fa640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f140c0a3240 0x7f140c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f14237fe640 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15b2680 0x55a0e15b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1423fff640 1 -- 172.21.15.46:0/2167576883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15b2680 msgr2=0x55a0e15b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1423fff640 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15b2680 0x55a0e15b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1423fff640 1 -- 172.21.15.46:0/2167576883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a74a0 msgr2=0x55a0e15a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1423fff640 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a74a0 0x55a0e15a7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1423fff640 1 -- 172.21.15.46:0/2167576883 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e1499440 con 0x55a0e15a7dc0 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f14237fe640 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15b2680 0x55a0e15b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1428df3640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f140c0a3240 0x7f140c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f14217fa640 1 -- 172.21.15.46:0/4021460561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f141c0cef40 con 0x7f142410c170 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f1423fff640 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 0x55a0e15b2140 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f14140316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3532f5dbf48b5f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f140a7fc640 1 -- 172.21.15.46:0/2167576883 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414040070 con 0x55a0e15a7dc0 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f140a7fc640 1 -- 172.21.15.46:0/2167576883 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1414005020 con 0x55a0e15a7dc0 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.238+0000 7f140a7fc640 1 -- 172.21.15.46:0/2167576883 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414035040 con 0x55a0e15a7dc0 2024-09-19T09:20:50.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 -- 172.21.15.46:0/2167576883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 msgr2=0x55a0e15b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 0x55a0e15b2140 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f14140316e0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f1428df3640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f140c0a3240 0x7f140c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f141c097a40 tx=0x7f141c066020 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 -- 172.21.15.46:0/2167576883 shutdown_connections 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a7dc0 0x55a0e15b2140 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15b2680 0x55a0e15b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 --2- 172.21.15.46:0/2167576883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a74a0 0x55a0e15a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 -- 172.21.15.46:0/2167576883 >> 172.21.15.46:0/2167576883 conn(0x55a0e15a3a30 msgr2=0x55a0e15a3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 -- 172.21.15.46:0/2167576883 shutdown_connections 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 -- 172.21.15.46:0/2167576883 wait complete. 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.239+0000 7f142cc2f740 1 -- start start 2024-09-19T09:20:50.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 Processor -- start 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e15b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e15af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e15af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a0e15b5250 con 0x55a0e15b2680 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a0e14c8050 con 0x55a0e15a7dc0 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a0e15b53d0 con 0x55a0e15a74a0 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f142cc2f740 10 client.0 _ll_register_callbacks cb 0x55a0e1508160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e15af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e15af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60158/0 (socket says 172.21.15.46:60158) 2024-09-19T09:20:50.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 -- 172.21.15.46:0/3758230179 learned_addr learned my addr 172.21.15.46:0/3758230179 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f1423fff640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e15af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e15b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 -- 172.21.15.46:0/3758230179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 msgr2=0x55a0e15b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e15b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 -- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 msgr2=0x55a0e15af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e15af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.240+0000 7f14237fe640 1 -- 172.21.15.46:0/3758230179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e127e3c0 con 0x55a0e15b2680 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14237fe640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e15af710 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f14180058c0 tx=0x7f1418004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e847a6b2cf07477e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14037fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14037fe640 1 -- 172.21.15.46:0/3758230179 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141800ee50 con 0x55a0e15b2680 2024-09-19T09:20:50.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14037fe640 1 -- 172.21.15.46:0/3758230179 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1418004020 con 0x55a0e15b2680 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1414005020 con 0x55a0e15b2680 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14037fe640 1 -- 172.21.15.46:0/3758230179 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1418004220 con 0x55a0e15b2680 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 10 client.16209 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a0e15c0ae0 con 0x55a0e15b2680 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14037fe640 1 -- 172.21.15.46:0/3758230179 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1414005020 con 0x55a0e15b2680 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f14037fe640 1 -- 172.21.15.46:0/3758230179 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f141801d020 con 0x55a0e15b2680 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 10 client.16209 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 20 client.16209 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e15c1ff0 0x55a0e15c4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 4 client.16209 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:50.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.241+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e151a850 con 0x55a0e15c1ff0 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.242+0000 7f1423fff640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e15c1ff0 0x55a0e15c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.242+0000 7f14037fe640 10 client.16209 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.242+0000 7f1423fff640 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e15c1ff0 0x55a0e15c4400 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a40324c484bbe3ba server_cookie=f0ef7c4eb1d9e377 in_seq=0 out_seq=0 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f14037fe640 1 -- 172.21.15.46:0/3758230179 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0e151a850 con 0x55a0e15c1ff0 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f14037fe640 10 client.16209 handle_command_reply: tid=0 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 client.16209 shutdown 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 msgr2=0x55a0e15af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e15af710 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f14180058c0 tx=0x7f1418004730 comp rx=0 tx=0).stop 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 shutdown_connections 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e15c1ff0 0x55a0e15c4400 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e15af710 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e15af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3758230179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e15b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f14037fe640 0 client.16209 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 >> 172.21.15.46:0/3758230179 conn(0x55a0e15a3a30 msgr2=0x55a0e15a2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 shutdown_connections 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 1 -- 172.21.15.46:0/3758230179 wait complete. 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.243+0000 7f142cc2f740 20 client.16209 trim_cache size 0 max 16384 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.260+0000 7f142cc2f740 1 Processor -- start 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 -- start start 2024-09-19T09:20:50.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 0x55a0e15be4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a7dc0 0x55a0e15aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15b2680 0x55a0e15baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14241ad570 con 0x55a0e15a74a0 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14241af170 con 0x55a0e15b2680 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f142cc2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f14241adc40 con 0x55a0e15a7dc0 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 0x55a0e15be4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 0x55a0e15be4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60170/0 (socket says 172.21.15.46:60170) 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 -- 172.21.15.46:0/422425597 learned_addr learned my addr 172.21.15.46:0/422425597 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f1423fff640 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a7dc0 0x55a0e15aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15b2680 0x55a0e15baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 -- 172.21.15.46:0/422425597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a7dc0 msgr2=0x55a0e15aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a7dc0 0x55a0e15aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 -- 172.21.15.46:0/422425597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15b2680 msgr2=0x55a0e15baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15b2680 0x55a0e15baa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 -- 172.21.15.46:0/422425597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e15ad720 con 0x55a0e15a74a0 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.261+0000 7f14237fe640 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 0x55a0e15be4b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1418001eb0 tx=0x7f141800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71f0c91d26c27d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f1409ffb640 1 -- 172.21.15.46:0/422425597 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141800bb10 con 0x55a0e15a74a0 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f1409ffb640 1 -- 172.21.15.46:0/422425597 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141800be70 con 0x55a0e15a74a0 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f1409ffb640 1 -- 172.21.15.46:0/422425597 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141802b670 con 0x55a0e15a74a0 2024-09-19T09:20:50.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 -- 172.21.15.46:0/422425597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 msgr2=0x55a0e15be4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 0x55a0e15be4b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1418001eb0 tx=0x7f141800b420 comp rx=0 tx=0).stop 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 -- 172.21.15.46:0/422425597 shutdown_connections 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15b2680 0x55a0e15baa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a7dc0 0x55a0e15aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 --2- 172.21.15.46:0/422425597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15a74a0 0x55a0e15be4b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 -- 172.21.15.46:0/422425597 >> 172.21.15.46:0/422425597 conn(0x55a0e15a3a30 msgr2=0x55a0e15a9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 -- 172.21.15.46:0/422425597 shutdown_connections 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.262+0000 7f142cc2f740 1 -- 172.21.15.46:0/422425597 wait complete. 2024-09-19T09:20:50.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 -- start start 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 Processor -- start 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e1624ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e16251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e162fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14241ae9e0 con 0x55a0e15b2680 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14241ae310 con 0x55a0e15a7dc0 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f14241ab550 con 0x55a0e15a74a0 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f142cc2f740 10 client.0 _ll_register_callbacks cb 0x7f142406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f14237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e162fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f1423fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e16251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f1423fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e16251e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:42104/0 (socket says 172.21.15.46:42104) 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f14237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e162fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60184/0 (socket says 172.21.15.46:60184) 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f1423fff640 1 -- 172.21.15.46:0/3273122353 learned_addr learned my addr 172.21.15.46:0/3273122353 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.263+0000 7f14237fe640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e1624ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f1423fff640 1 -- 172.21.15.46:0/3273122353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 msgr2=0x55a0e1624ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f1423fff640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e1624ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f1423fff640 1 -- 172.21.15.46:0/3273122353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 msgr2=0x55a0e162fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f1423fff640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e162fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f1423fff640 1 -- 172.21.15.46:0/3273122353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e1625aa0 con 0x55a0e15a7dc0 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f14237fe640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e1624ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f1423fff640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e16251e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14140048b0 tx=0x7f14140047a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=146e9328fd44db76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:50.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f14037fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f14037fe640 1 -- 172.21.15.46:0/3273122353 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1414053020 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f141800be70 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f14037fe640 1 -- 172.21.15.46:0/3273122353 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f1414004450 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f14037fe640 1 -- 172.21.15.46:0/3273122353 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1414040040 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f142cc2f740 10 client.25718 fetch_fsmap learned FSMap version 32 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55a0e1631400 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.264+0000 7f14037fe640 1 -- 172.21.15.46:0/3273122353 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f141800be70 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f14037fe640 1 -- 172.21.15.46:0/3273122353 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f141404f600 con 0x55a0e15a7dc0 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f142cc2f740 10 client.25718 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f142cc2f740 10 client.25718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:20:50.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f142cc2f740 20 client.25718 populate_metadata read hostname 'smithi046' 2024-09-19T09:20:50.327 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:20:50.327 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:20:50.327 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": { 2024-09-19T09:20:50.327 INFO:teuthology.orchestra.run.smithi046.stdout: "11a31c3a-25bf-4c64-b464-ac8419fcad65": { 2024-09-19T09:20:50.327 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/", 2024-09-19T09:20:50.327 INFO:teuthology.orchestra.run.smithi046.stdout: "tag": "11a31c3a-25bf-4c64-b464-ac8419fcad65", 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stdout: "options": "recursive,force" 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e1631850 0x55a0e1633c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f142cc2f740 4 client.25718 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:20:50.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0e1514d60 con 0x55a0e1631850 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f14237fe640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e1631850 0x55a0e1633c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f14237fe640 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e1631850 0x55a0e1633c40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a3dff052f93108 server_cookie=b8a22c2cdb7e9696 in_seq=0 out_seq=0 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f14037fe640 10 client.25718 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.265+0000 7f14037fe640 1 -- 172.21.15.46:0/3273122353 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a0e1514d60 con 0x55a0e1631850 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f14037fe640 10 client.25718 handle_command_reply: tid=0 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 client.25718 shutdown 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 msgr2=0x55a0e16251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e16251e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14140048b0 tx=0x7f14140047a0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 shutdown_connections 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a0e1631850 0x55a0e1633c40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a0e15b2680 0x55a0e162fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f14037fe640 0 client.25718 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a0e15a7dc0 0x55a0e16251e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 --2- 172.21.15.46:0/3273122353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a0e15a74a0 0x55a0e1624ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 >> 172.21.15.46:0/3273122353 conn(0x55a0e15a3a30 msgr2=0x55a0e15aa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 shutdown_connections 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 1 -- 172.21.15.46:0/3273122353 wait complete. 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142cc2f740 20 client.25718 trim_cache size 0 max 16384 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f140c0a3240 msgr2=0x7f140c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142a856640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f140c0a3240 0x7f140c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f141c097a40 tx=0x7f141c066020 comp rx=0 tx=0).stop 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 msgr2=0x7f142419ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:50.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.266+0000 7f142a856640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 0x7f142419ce00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f141c00b970 tx=0x7f141c00be30 comp rx=0 tx=0).stop 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 shutdown_connections 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f140c0a3240 0x7f140c0a5700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f142410c170 0x7f142419ce00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1424103660 0x7f1424198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 --2- 172.21.15.46:0/4021460561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1424102d40 0x7f1424198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 >> 172.21.15.46:0/4021460561 conn(0x7f14240fc7a0 msgr2=0x7f14240fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 shutdown_connections 2024-09-19T09:20:50.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:20:50.267+0000 7f142a856640 1 -- 172.21.15.46:0/4021460561 wait complete. 2024-09-19T09:20:50.784 INFO:tasks.workunit.client.0.smithi046.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-09-19T09:20:50.784 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether ln -s works... yes 2024-09-19T09:20:50.813 INFO:tasks.workunit.client.0.smithi046.stdout:checking the maximum length of command line arguments... 1572864 2024-09-19T09:20:50.816 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-09-19T09:20:50.817 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-09-19T09:20:50.817 INFO:tasks.workunit.client.0.smithi046.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-09-19T09:20:50.817 INFO:tasks.workunit.client.0.smithi046.stdout:checking for objdump... objdump 2024-09-19T09:20:50.818 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to recognize dependent libraries... pass_all 2024-09-19T09:20:50.818 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dlltool... no 2024-09-19T09:20:50.818 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-09-19T09:20:50.818 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ar... ar 2024-09-19T09:20:50.925 INFO:tasks.workunit.client.0.smithi046.stdout:checking for archiver @FILE support... @ 2024-09-19T09:20:50.925 INFO:tasks.workunit.client.0.smithi046.stdout:checking for strip... strip 2024-09-19T09:20:50.926 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ranlib... ranlib 2024-09-19T09:20:50.926 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gawk... gawk 2024-09-19T09:20:51.028 INFO:tasks.workunit.client.0.smithi046.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-09-19T09:20:51.029 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sysroot... no 2024-09-19T09:20:51.040 INFO:tasks.workunit.client.0.smithi046.stdout:checking for a working dd... /usr/bin/dd 2024-09-19T09:20:51.050 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-09-19T09:20:51.090 INFO:tasks.workunit.client.0.smithi046.stdout:checking for mt... no 2024-09-19T09:20:51.104 INFO:tasks.workunit.client.0.smithi046.stdout:checking if : is a manifest tool... no 2024-09-19T09:20:51.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:50 smithi115 ceph-mon[35055]: pgmap v414: 97 pgs: 97 active+clean; 45 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 764 op/s 2024-09-19T09:20:51.223 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:50 smithi046 ceph-mon[31203]: pgmap v414: 97 pgs: 97 active+clean; 45 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 764 op/s 2024-09-19T09:20:51.253 INFO:tasks.cephfs.filesystem:scrub status for tag:11a31c3a-25bf-4c64-b464-ac8419fcad65 - {'path': '/', 'tag': '11a31c3a-25bf-4c64-b464-ac8419fcad65', 'options': 'recursive,force'} 2024-09-19T09:20:51.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:50 smithi099 ceph-mon[35256]: pgmap v414: 97 pgs: 97 active+clean; 45 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 764 op/s 2024-09-19T09:20:51.269 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:20:51.482 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ANSI C header files... yes 2024-09-19T09:20:51.516 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/types.h... yes 2024-09-19T09:20:51.553 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/stat.h... yes 2024-09-19T09:20:51.595 INFO:tasks.workunit.client.0.smithi046.stdout:checking for stdlib.h... yes 2024-09-19T09:20:51.634 INFO:tasks.workunit.client.0.smithi046.stdout:checking for string.h... yes 2024-09-19T09:20:51.674 INFO:tasks.workunit.client.0.smithi046.stdout:checking for memory.h... yes 2024-09-19T09:20:51.713 INFO:tasks.workunit.client.0.smithi046.stdout:checking for strings.h... yes 2024-09-19T09:20:51.752 INFO:tasks.workunit.client.0.smithi046.stdout:checking for inttypes.h... yes 2024-09-19T09:20:51.792 INFO:tasks.workunit.client.0.smithi046.stdout:checking for stdint.h... yes 2024-09-19T09:20:52.049 INFO:tasks.workunit.client.0.smithi046.stdout:checking for unistd.h... yes 2024-09-19T09:20:52.049 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dlfcn.h... yes 2024-09-19T09:20:52.049 INFO:tasks.workunit.client.0.smithi046.stdout:checking for objdir... .libs 2024-09-19T09:20:52.049 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-09-19T09:20:52.050 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-09-19T09:20:52.050 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-09-19T09:20:52.095 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc static flag -static works... no 2024-09-19T09:20:52.150 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc supports -c -o file.o... yes 2024-09-19T09:20:52.150 INFO:tasks.workunit.client.0.smithi046.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-09-19T09:20:52.156 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-09-19T09:20:52.203 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether -lc should be explicitly linked in... no 2024-09-19T09:20:52.261 INFO:tasks.workunit.client.0.smithi046.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-09-19T09:20:52.262 INFO:tasks.workunit.client.0.smithi046.stdout:checking how to hardcode library paths into programs... immediate 2024-09-19T09:20:52.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether stripping libraries is possible... yes 2024-09-19T09:20:52.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking if libtool supports shared libraries... yes 2024-09-19T09:20:52.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether to build shared libraries... yes 2024-09-19T09:20:52.263 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether to build static libraries... yes 2024-09-19T09:20:52.270 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc... (cached) gcc 2024-09-19T09:20:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:20:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:20:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:20:52.304 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gmake... /usr/bin/gmake 2024-09-19T09:20:52.305 INFO:tasks.workunit.client.0.smithi046.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-09-19T09:20:52.305 INFO:tasks.workunit.client.0.smithi046.stdout:checking for tar... /bin/tar 2024-09-19T09:20:52.306 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gzip... /bin/gzip 2024-09-19T09:20:52.328 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether gcc -MM is supported... yes 2024-09-19T09:20:52.328 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sort... /bin/sort 2024-09-19T09:20:52.328 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether ln -s works... yes 2024-09-19T09:20:52.328 INFO:tasks.workunit.client.0.smithi046.stdout:checking for rpm... /bin/rpm 2024-09-19T09:20:52.331 INFO:tasks.workunit.client.0.smithi046.stdout:checking for rpmbuild... no 2024-09-19T09:20:52.386 INFO:tasks.workunit.client.0.smithi046.stdout:checking assert.h usability... yes 2024-09-19T09:20:52.401 INFO:tasks.workunit.client.0.smithi046.stdout:checking assert.h presence... yes 2024-09-19T09:20:52.402 INFO:tasks.workunit.client.0.smithi046.stdout:checking for assert.h... yes 2024-09-19T09:20:52.451 INFO:tasks.workunit.client.0.smithi046.stdout:checking bstring.h usability... no 2024-09-19T09:20:52.479 INFO:tasks.workunit.client.0.smithi046.stdout:checking bstring.h presence... no 2024-09-19T09:20:52.479 INFO:tasks.workunit.client.0.smithi046.stdout:checking for bstring.h... no 2024-09-19T09:20:52.517 INFO:tasks.workunit.client.0.smithi046.stdout:checking libgen.h usability... yes 2024-09-19T09:20:52.534 INFO:tasks.workunit.client.0.smithi046.stdout:checking libgen.h presence... yes 2024-09-19T09:20:52.534 INFO:tasks.workunit.client.0.smithi046.stdout:checking for libgen.h... yes 2024-09-19T09:20:52.588 INFO:tasks.workunit.client.0.smithi046.stdout:checking dirent.h usability... yes 2024-09-19T09:20:52.605 INFO:tasks.workunit.client.0.smithi046.stdout:checking dirent.h presence... yes 2024-09-19T09:20:52.605 INFO:tasks.workunit.client.0.smithi046.stdout:checking for dirent.h... yes 2024-09-19T09:20:52.652 INFO:tasks.workunit.client.0.smithi046.stdout:checking errno.h usability... yes 2024-09-19T09:20:52.669 INFO:tasks.workunit.client.0.smithi046.stdout:checking errno.h presence... yes 2024-09-19T09:20:52.669 INFO:tasks.workunit.client.0.smithi046.stdout:checking for errno.h... yes 2024-09-19T09:20:52.719 INFO:tasks.workunit.client.0.smithi046.stdout:checking malloc.h usability... yes 2024-09-19T09:20:52.737 INFO:tasks.workunit.client.0.smithi046.stdout:checking malloc.h presence... yes 2024-09-19T09:20:52.737 INFO:tasks.workunit.client.0.smithi046.stdout:checking for malloc.h... yes 2024-09-19T09:20:52.786 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid.h usability... no 2024-09-19T09:20:52.815 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid.h presence... no 2024-09-19T09:20:52.815 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid.h... no 2024-09-19T09:20:52.858 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid/uuid.h usability... yes 2024-09-19T09:20:52.876 INFO:tasks.workunit.client.0.smithi046.stdout:checking uuid/uuid.h presence... yes 2024-09-19T09:20:52.877 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid/uuid.h... yes 2024-09-19T09:20:52.925 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/uuid.h usability... no 2024-09-19T09:20:52.956 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/uuid.h presence... no 2024-09-19T09:20:52.956 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/uuid.h... no 2024-09-19T09:20:53.009 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/file.h usability... yes 2024-09-19T09:20:53.026 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/file.h presence... yes 2024-09-19T09:20:53.026 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/file.h... yes 2024-09-19T09:20:53.083 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fcntl.h usability... yes 2024-09-19T09:20:53.100 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fcntl.h presence... yes 2024-09-19T09:20:53.100 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/fcntl.h... yes 2024-09-19T09:20:53.151 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/syssgi.h usability... no 2024-09-19T09:20:53.179 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/syssgi.h presence... no 2024-09-19T09:20:53.180 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/syssgi.h... no 2024-09-19T09:20:53.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:52 smithi115 ceph-mon[35055]: pgmap v415: 97 pgs: 97 active+clean; 46 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 818 op/s 2024-09-19T09:20:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:52 smithi046 ceph-mon[31203]: pgmap v415: 97 pgs: 97 active+clean; 46 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 818 op/s 2024-09-19T09:20:53.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:52 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[31199]: 2024-09-19T09:20:52.938+0000 7f18c3cc2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:53.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:52 smithi099 ceph-mon[35256]: pgmap v415: 97 pgs: 97 active+clean; 46 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.7 MiB/s wr, 818 op/s 2024-09-19T09:20:53.267 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/param.h usability... yes 2024-09-19T09:20:53.286 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/param.h presence... yes 2024-09-19T09:20:53.286 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/param.h... yes 2024-09-19T09:20:53.300 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/stat.h... (cached) yes 2024-09-19T09:20:53.344 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/statvfs.h usability... yes 2024-09-19T09:20:53.361 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/statvfs.h presence... yes 2024-09-19T09:20:53.361 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/statvfs.h... yes 2024-09-19T09:20:53.405 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/time.h usability... yes 2024-09-19T09:20:53.422 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/time.h presence... yes 2024-09-19T09:20:53.422 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/time.h... yes 2024-09-19T09:20:53.467 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/ioctl.h usability... yes 2024-09-19T09:20:53.483 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/ioctl.h presence... yes 2024-09-19T09:20:53.483 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/ioctl.h... yes 2024-09-19T09:20:53.544 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/wait.h usability... yes 2024-09-19T09:20:53.562 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/wait.h presence... yes 2024-09-19T09:20:53.562 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/wait.h... yes 2024-09-19T09:20:53.580 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/types.h... (cached) yes 2024-09-19T09:20:53.585 INFO:tasks.workunit.client.0.smithi046.stdout:checking for strings.h... (cached) yes 2024-09-19T09:20:53.621 INFO:tasks.workunit.client.0.smithi046.stdout:checking err.h usability... yes 2024-09-19T09:20:53.638 INFO:tasks.workunit.client.0.smithi046.stdout:checking err.h presence... yes 2024-09-19T09:20:53.638 INFO:tasks.workunit.client.0.smithi046.stdout:checking for err.h... yes 2024-09-19T09:20:53.687 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/falloc.h usability... yes 2024-09-19T09:20:53.703 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/falloc.h presence... yes 2024-09-19T09:20:53.703 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/falloc.h... yes 2024-09-19T09:20:53.758 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-09-19T09:20:53.789 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-09-19T09:20:53.789 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/fs/xfs_fsops.h... no 2024-09-19T09:20:53.835 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_itable.h usability... no 2024-09-19T09:20:53.866 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/fs/xfs_itable.h presence... no 2024-09-19T09:20:53.866 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/fs/xfs_itable.h... no 2024-09-19T09:20:53.913 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/platform_defs.h usability... no 2024-09-19T09:20:53.942 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/platform_defs.h presence... no 2024-09-19T09:20:53.942 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/platform_defs.h... no 2024-09-19T09:20:53.987 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfs/ioctl.h usability... no 2024-09-19T09:20:54.014 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfs/ioctl.h presence... no 2024-09-19T09:20:54.014 INFO:tasks.workunit.client.0.smithi046.stdout:checking for btrfs/ioctl.h... no 2024-09-19T09:20:54.056 INFO:tasks.workunit.client.0.smithi046.stdout:checking cifs/ioctl.h usability... no 2024-09-19T09:20:54.084 INFO:tasks.workunit.client.0.smithi046.stdout:checking cifs/ioctl.h presence... no 2024-09-19T09:20:54.084 INFO:tasks.workunit.client.0.smithi046.stdout:checking for cifs/ioctl.h... no 2024-09-19T09:20:54.134 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/mman.h usability... yes 2024-09-19T09:20:54.151 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/mman.h presence... yes 2024-09-19T09:20:54.151 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/mman.h... yes 2024-09-19T09:20:54.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:53 smithi115 ceph-mon[35055]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:53 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:active 2024-09-19T09:20:54.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:53 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:54.211 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/ext4.h usability... no 2024-09-19T09:20:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:53 smithi046 ceph-mon[31203]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:53 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:active 2024-09-19T09:20:54.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:53 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:54.240 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/ext4.h presence... no 2024-09-19T09:20:54.240 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/ext4.h... no 2024-09-19T09:20:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:53 smithi099 ceph-mon[35256]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:53 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] up:active 2024-09-19T09:20:54.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:53 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:54.267 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/xfs_log_format.h... no 2024-09-19T09:20:54.321 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid_compare... no 2024-09-19T09:20:54.361 INFO:tasks.workunit.client.0.smithi046.stdout:checking for uuid_compare in -luuid... yes 2024-09-19T09:20:54.420 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/xfs.h... yes 2024-09-19T09:20:54.452 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/libxfs.h... no 2024-09-19T09:20:54.482 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether xlog_assign_lsn is declared... no 2024-09-19T09:20:54.520 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/xqm.h... yes 2024-09-19T09:20:54.576 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfsctl from xfs/xfs.h... ok 2024-09-19T09:20:54.610 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/handle.h usability... yes 2024-09-19T09:20:54.626 INFO:tasks.workunit.client.0.smithi046.stdout:checking xfs/handle.h presence... yes 2024-09-19T09:20:54.627 INFO:tasks.workunit.client.0.smithi046.stdout:checking for xfs/handle.h... yes 2024-09-19T09:20:54.675 INFO:tasks.workunit.client.0.smithi046.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-09-19T09:20:54.717 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/acl.h usability... yes 2024-09-19T09:20:54.734 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/acl.h presence... yes 2024-09-19T09:20:54.735 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/acl.h... yes 2024-09-19T09:20:54.781 INFO:tasks.workunit.client.0.smithi046.stdout:checking acl/libacl.h usability... yes 2024-09-19T09:20:54.796 INFO:tasks.workunit.client.0.smithi046.stdout:checking acl/libacl.h presence... yes 2024-09-19T09:20:54.796 INFO:tasks.workunit.client.0.smithi046.stdout:checking for acl/libacl.h... yes 2024-09-19T09:20:54.837 INFO:tasks.workunit.client.0.smithi046.stdout:checking for acl_init in -lacl... yes 2024-09-19T09:20:54.904 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm-ndbm.h usability... no 2024-09-19T09:20:54.931 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm-ndbm.h presence... no 2024-09-19T09:20:54.931 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gdbm-ndbm.h... no 2024-09-19T09:20:54.970 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm/ndbm.h usability... no 2024-09-19T09:20:54.998 INFO:tasks.workunit.client.0.smithi046.stdout:checking gdbm/ndbm.h presence... no 2024-09-19T09:20:54.998 INFO:tasks.workunit.client.0.smithi046.stdout:checking for gdbm/ndbm.h... no 2024-09-19T09:20:55.035 INFO:tasks.workunit.client.0.smithi046.stdout:checking ndbm.h usability... no 2024-09-19T09:20:55.064 INFO:tasks.workunit.client.0.smithi046.stdout:checking ndbm.h presence... no 2024-09-19T09:20:55.064 INFO:tasks.workunit.client.0.smithi046.stdout:checking for ndbm.h... no 2024-09-19T09:20:55.096 INFO:tasks.workunit.client.0.smithi046.stdout:checking libaio.h usability... yes 2024-09-19T09:20:55.115 INFO:tasks.workunit.client.0.smithi046.stdout:checking libaio.h presence... yes 2024-09-19T09:20:55.115 INFO:tasks.workunit.client.0.smithi046.stdout:checking for libaio.h... yes 2024-09-19T09:20:55.162 INFO:tasks.workunit.client.0.smithi046.stdout:checking liburing.h usability... no 2024-09-19T09:20:55.192 INFO:tasks.workunit.client.0.smithi046.stdout:checking liburing.h presence... no 2024-09-19T09:20:55.192 INFO:tasks.workunit.client.0.smithi046.stdout:checking for liburing.h... no 2024-09-19T09:20:55.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: pgmap v416: 97 pgs: 97 active+clean; 31 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 693 op/s 2024-09-19T09:20:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:active 2024-09-19T09:20:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:20:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:20:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:20:55.210 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:54 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: pgmap v416: 97 pgs: 97 active+clean; 31 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 693 op/s 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:active 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:20:55.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:54 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:20:55.232 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/capability.h usability... no 2024-09-19T09:20:55.260 INFO:tasks.workunit.client.0.smithi046.stdout:checking sys/capability.h presence... no 2024-09-19T09:20:55.261 INFO:tasks.workunit.client.0.smithi046.stdout:checking for sys/capability.h... no 2024-09-19T09:20:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: pgmap v416: 97 pgs: 97 active+clean; 31 MiB data, 494 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 693 op/s 2024-09-19T09:20:55.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] up:active 2024-09-19T09:20:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:20:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:20:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:20:55.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:54 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:20:55.292 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fiemap.h usability... yes 2024-09-19T09:20:55.308 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fiemap.h presence... yes 2024-09-19T09:20:55.308 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/fiemap.h... yes 2024-09-19T09:20:55.346 INFO:tasks.workunit.client.0.smithi046.stdout:checking for fallocate... yes 2024-09-19T09:20:55.399 INFO:tasks.workunit.client.0.smithi046.stdout:checking for open_by_handle_at... yes 2024-09-19T09:20:55.436 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fs.h usability... yes 2024-09-19T09:20:55.453 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/fs.h presence... yes 2024-09-19T09:20:55.453 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/fs.h... yes 2024-09-19T09:20:55.511 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfsutil.h usability... no 2024-09-19T09:20:55.539 INFO:tasks.workunit.client.0.smithi046.stdout:checking btrfsutil.h presence... no 2024-09-19T09:20:55.539 INFO:tasks.workunit.client.0.smithi046.stdout:checking for btrfsutil.h... no 2024-09-19T09:20:55.585 INFO:tasks.workunit.client.0.smithi046.stdout:checking for copy_file_range... yes 2024-09-19T09:20:55.630 INFO:tasks.workunit.client.0.smithi046.stdout:checking for SEEK_DATA... yes 2024-09-19T09:20:55.689 INFO:tasks.workunit.client.0.smithi046.stdout:checking for BMV_OF_SHARED... yes 2024-09-19T09:20:55.734 INFO:tasks.workunit.client.0.smithi046.stdout:checking for nftw... yes 2024-09-19T09:20:55.789 INFO:tasks.workunit.client.0.smithi046.stdout:checking for RLIMIT_NOFILE... yes 2024-09-19T09:20:55.833 INFO:tasks.workunit.client.0.smithi046.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-09-19T09:20:55.899 INFO:tasks.workunit.client.0.smithi046.stdout:checking for FICLONE... yes 2024-09-19T09:20:55.945 INFO:tasks.workunit.client.0.smithi046.stdout:checking for renameat2... yes 2024-09-19T09:20:55.989 INFO:tasks.workunit.client.0.smithi046.stdout:checking for reallocarray... yes 2024-09-19T09:20:56.056 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct mount_attr... yes 2024-09-19T09:20:56.131 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_qgroup_limit... yes 2024-09-19T09:20:56.189 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-09-19T09:20:56.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:55 smithi115 ceph-mon[35055]: scrub summary: idle 2024-09-19T09:20:56.230 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:55 smithi046 ceph-mon[31203]: scrub summary: idle 2024-09-19T09:20:56.245 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-09-19T09:20:56.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:55 smithi099 ceph-mon[35256]: scrub summary: idle 2024-09-19T09:20:56.300 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-09-19T09:20:56.356 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-09-19T09:20:56.411 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-09-19T09:20:56.467 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-09-19T09:20:56.507 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/btrfs.h usability... yes 2024-09-19T09:20:56.524 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/btrfs.h presence... yes 2024-09-19T09:20:56.524 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/btrfs.h... yes 2024-09-19T09:20:56.571 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/btrfs_tree.h usability... yes 2024-09-19T09:20:56.589 INFO:tasks.workunit.client.0.smithi046.stdout:checking linux/btrfs_tree.h presence... yes 2024-09-19T09:20:56.589 INFO:tasks.workunit.client.0.smithi046.stdout:checking for linux/btrfs_tree.h... yes 2024-09-19T09:20:56.627 INFO:tasks.workunit.client.0.smithi046.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-09-19T09:20:56.658 INFO:tasks.workunit.client.0.smithi046.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-09-19T09:20:56.677 INFO:tasks.workunit.client.0.smithi046.stdout:configure: creating ./config.status 2024-09-19T09:20:57.023 INFO:tasks.workunit.client.0.smithi046.stdout:config.status: creating include/builddefs 2024-09-19T09:20:57.036 INFO:tasks.workunit.client.0.smithi046.stdout:config.status: creating include/config.h 2024-09-19T09:20:57.047 INFO:tasks.workunit.client.0.smithi046.stdout:config.status: executing libtool commands 2024-09-19T09:20:57.124 INFO:tasks.workunit.client.0.smithi046.stdout:Building include 2024-09-19T09:20:57.124 INFO:tasks.workunit.client.0.smithi046.stdout:Building lib 2024-09-19T09:20:57.124 INFO:tasks.workunit.client.0.smithi046.stdout:Building tests 2024-09-19T09:20:57.129 INFO:tasks.workunit.client.0.smithi046.stdout: [LTDEP] 2024-09-19T09:20:57.137 INFO:tasks.workunit.client.0.smithi046.stdout:Building btrfs 2024-09-19T09:20:57.137 INFO:tasks.workunit.client.0.smithi046.stdout:Building ceph 2024-09-19T09:20:57.137 INFO:tasks.workunit.client.0.smithi046.stdout:Building cifs 2024-09-19T09:20:57.144 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ceph/group.list 2024-09-19T09:20:57.144 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/cifs/group.list 2024-09-19T09:20:57.160 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/btrfs/group.list 2024-09-19T09:20:57.162 INFO:tasks.workunit.client.0.smithi046.stdout:Building ext4 2024-09-19T09:20:57.165 INFO:tasks.workunit.client.0.smithi046.stdout:Building f2fs 2024-09-19T09:20:57.172 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/f2fs/group.list 2024-09-19T09:20:57.178 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ext4/group.list 2024-09-19T09:20:57.197 INFO:tasks.workunit.client.0.smithi046.stdout:Building generic 2024-09-19T09:20:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:56 smithi115 ceph-mon[35055]: pgmap v417: 97 pgs: 97 active+clean; 27 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 579 op/s 2024-09-19T09:20:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:56 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:active 2024-09-19T09:20:57.209 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:56 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:56 smithi046 ceph-mon[31203]: pgmap v417: 97 pgs: 97 active+clean; 27 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 579 op/s 2024-09-19T09:20:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:56 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:active 2024-09-19T09:20:57.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:56 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:57.231 INFO:tasks.workunit.client.0.smithi046.stdout:Building nfs 2024-09-19T09:20:57.237 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/nfs/group.list 2024-09-19T09:20:57.256 INFO:tasks.workunit.client.0.smithi046.stdout:Building ocfs2 2024-09-19T09:20:57.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:56 smithi099 ceph-mon[35256]: pgmap v417: 97 pgs: 97 active+clean; 27 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 579 op/s 2024-09-19T09:20:57.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:56 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] up:active 2024-09-19T09:20:57.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:56 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:20:57.263 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/ocfs2/group.list 2024-09-19T09:20:57.280 INFO:tasks.workunit.client.0.smithi046.stdout:Building overlay 2024-09-19T09:20:57.286 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/generic/group.list 2024-09-19T09:20:57.299 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/overlay/group.list 2024-09-19T09:20:57.301 INFO:tasks.workunit.client.0.smithi046.stdout:Building perf 2024-09-19T09:20:57.308 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/perf/group.list 2024-09-19T09:20:57.325 INFO:tasks.workunit.client.0.smithi046.stdout:Building selftest 2024-09-19T09:20:57.332 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dataascii.lo 2024-09-19T09:20:57.332 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/selftest/group.list 2024-09-19T09:20:57.349 INFO:tasks.workunit.client.0.smithi046.stdout:Building shared 2024-09-19T09:20:57.355 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/shared/group.list 2024-09-19T09:20:57.360 INFO:tasks.workunit.client.0.smithi046.stdout:Building tmpfs 2024-09-19T09:20:57.368 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/tmpfs/group.list 2024-09-19T09:20:57.378 INFO:tasks.workunit.client.0.smithi046.stdout:Building udf 2024-09-19T09:20:57.385 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/udf/group.list 2024-09-19T09:20:57.386 INFO:tasks.workunit.client.0.smithi046.stdout:Building xfs 2024-09-19T09:20:57.402 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] databin.lo 2024-09-19T09:20:57.433 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] datapid.lo 2024-09-19T09:20:57.468 INFO:tasks.workunit.client.0.smithi046.stdout: [GROUP] /home/ubuntu/cephtest/mnt.0/client.0/tmp/xfstests-dev/tests/xfs/group.list 2024-09-19T09:20:57.475 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] file_lock.lo 2024-09-19T09:20:57.556 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] forker.lo 2024-09-19T09:20:57.567 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] pattern.lo 2024-09-19T09:20:57.973 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] open_flags.lo 2024-09-19T09:20:58.263 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:58 smithi099 ceph-mon[35256]: pgmap v418: 97 pgs: 97 active+clean; 29 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 559 op/s 2024-09-19T09:20:58.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:58 smithi115 ceph-mon[35055]: pgmap v418: 97 pgs: 97 active+clean; 29 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 559 op/s 2024-09-19T09:20:58.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:58 smithi046 ceph-mon[31203]: pgmap v418: 97 pgs: 97 active+clean; 29 MiB data, 497 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 559 op/s 2024-09-19T09:20:58.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:58 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[31199]: 2024-09-19T09:20:58.129+0000 7f18c3cc2640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:58.518 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] random_range.lo 2024-09-19T09:20:58.522 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] string_to_tokens.lo 2024-09-19T09:20:58.526 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] str_to_bytes.lo 2024-09-19T09:20:58.638 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] tlibio.lo 2024-09-19T09:20:58.674 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] write_log.lo 2024-09-19T09:20:58.714 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] random.lo 2024-09-19T09:20:58.919 INFO:tasks.workunit.client.0.smithi046.stdout: [LD] 2024-09-19T09:20:59.154 INFO:tasks.workunit.client.0.smithi046.stdout:Building ltp 2024-09-19T09:20:59.154 INFO:tasks.workunit.client.0.smithi046.stdout:Building src 2024-09-19T09:20:59.154 INFO:tasks.workunit.client.0.smithi046.stdout:Building m4 2024-09-19T09:20:59.154 INFO:tasks.workunit.client.0.smithi046.stdout:Building common 2024-09-19T09:20:59.158 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2024-09-19T09:20:59.174 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2024-09-19T09:20:59.262 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:20:59 smithi099 ceph-mon[35256]: Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:59.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:20:59 smithi115 ceph-mon[35055]: Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:59.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:20:59 smithi046 ceph-mon[31203]: Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T09:20:59.632 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] doio 2024-09-19T09:20:59.632 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fsstress 2024-09-19T09:20:59.632 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fsx 2024-09-19T09:21:00.356 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] growfiles 2024-09-19T09:21:00.404 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] iogen 2024-09-19T09:21:00.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:00 smithi115 ceph-mon[35055]: pgmap v419: 97 pgs: 97 active+clean; 30 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 585 KiB/s wr, 471 op/s 2024-09-19T09:21:00.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:00 smithi046 ceph-mon[31203]: pgmap v419: 97 pgs: 97 active+clean; 30 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 585 KiB/s wr, 471 op/s 2024-09-19T09:21:00.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:00 smithi099 ceph-mon[35256]: pgmap v419: 97 pgs: 97 active+clean; 30 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 585 KiB/s wr, 471 op/s 2024-09-19T09:21:00.793 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-stress 2024-09-19T09:21:01.441 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2024-09-19T09:21:01.441 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2024-09-19T09:21:01.441 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2024-09-19T09:21:01.442 INFO:tasks.workunit.client.0.smithi046.stdout: [DEP] 2024-09-19T09:21:01.690 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dirstress 2024-09-19T09:21:01.690 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fill 2024-09-19T09:21:01.690 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fill2 2024-09-19T09:21:01.691 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] getpagesize 2024-09-19T09:21:01.848 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] holes 2024-09-19T09:21:01.859 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] lstat64 2024-09-19T09:21:01.947 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] nametest 2024-09-19T09:21:01.950 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] permname 2024-09-19T09:21:02.061 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] randholes 2024-09-19T09:21:02.077 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] runas 2024-09-19T09:21:02.210 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] truncfile 2024-09-19T09:21:02.210 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] usemem 2024-09-19T09:21:02.258 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] mmapcat 2024-09-19T09:21:02.345 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] append_reader 2024-09-19T09:21:02.367 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] append_writer 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/1753105701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88103710 msgr2=0x7f4f88109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/1753105701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88103710 0x7f4f88109fa0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009be0 tx=0x7f4f8002a6c0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/1753105701 shutdown_connections 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/1753105701 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88103710 0x7f4f88109fa0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/1753105701 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88102d50 0x7f4f881031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/1753105701 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88101b60 0x7f4f88101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/1753105701 >> 172.21.15.46:0/1753105701 conn(0x7f4f880fd2c0 msgr2=0x7f4f880ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/1753105701 shutdown_connections 2024-09-19T09:21:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.380+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/1753105701 wait complete. 2024-09-19T09:21:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 Processor -- start 2024-09-19T09:21:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 -- start start 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 0x7f4f88075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88102d50 0x7f4f880745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88103710 0x7f4f88074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8810d770 con 0x7f4f88101b60 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8810d5f0 con 0x7f4f88102d50 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8ffe4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8810d8f0 con 0x7f4f88103710 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8dd80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 0x7f4f88075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8dd80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 0x7f4f88075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43864/0 (socket says 172.21.15.46:43864) 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.381+0000 7f4f8dd80640 1 -- 172.21.15.46:0/389346145 learned_addr learned my addr 172.21.15.46:0/389346145 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88102d50 0x7f4f880745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8e581640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88103710 0x7f4f88074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8dd80640 1 -- 172.21.15.46:0/389346145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88103710 msgr2=0x7f4f88074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88103710 0x7f4f88074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8dd80640 1 -- 172.21.15.46:0/389346145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88102d50 msgr2=0x7f4f880745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88102d50 0x7f4f880745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8dd80640 1 -- 172.21.15.46:0/389346145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f880753b0 con 0x7f4f88101b60 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88102d50 0x7f4f880745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8e581640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88103710 0x7f4f88074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 0x7f4f88075fa0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400e9a0 tx=0x7f4f8400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f7effd640 1 -- 172.21.15.46:0/389346145 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400cd80 con 0x7f4f88101b60 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f881a1e60 con 0x7f4f88101b60 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f7effd640 1 -- 172.21.15.46:0/389346145 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f84010910 con 0x7f4f88101b60 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f7effd640 1 -- 172.21.15.46:0/389346145 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84018a40 con 0x7f4f88101b60 2024-09-19T09:21:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.382+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f881a22c0 con 0x7f4f88101b60 2024-09-19T09:21:02.387 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.385+0000 7f4f92e55740 1 Processor -- start 2024-09-19T09:21:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.386+0000 7f4f92e55740 1 -- start start 2024-09-19T09:21:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.386+0000 7f4f7effd640 1 -- 172.21.15.46:0/389346145 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4f84010ac0 con 0x7f4f88101b60 2024-09-19T09:21:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a29da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2a2e0 0x559e06a2eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a31830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f92e55740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559e0698d2f0 con 0x559e06a299a0 2024-09-19T09:21:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f92e55740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559e06935270 con 0x559e06a2f370 2024-09-19T09:21:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f92e55740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559e069892b0 con 0x559e06a2a2e0 2024-09-19T09:21:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8e581640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a29da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8e581640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a29da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43870/0 (socket says 172.21.15.46:43870) 2024-09-19T09:21:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8e581640 1 -- 172.21.15.46:0/243706937 learned_addr learned my addr 172.21.15.46:0/243706937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2a2e0 0x559e06a2eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a31830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8d57f640 1 -- 172.21.15.46:0/243706937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2a2e0 msgr2=0x559e06a2eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2a2e0 0x559e06a2eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8d57f640 1 -- 172.21.15.46:0/243706937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 msgr2=0x559e06a29da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a29da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.387+0000 7f4f8d57f640 1 -- 172.21.15.46:0/243706937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e06934340 con 0x559e06a2f370 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a31830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009fa0 tx=0x7f4f780118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=355869fa29ca4a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.390 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f7effd640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4f740a32f0 0x7f4f740a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f73fff640 1 -- 172.21.15.46:0/243706937 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78004030 con 0x559e06a2f370 2024-09-19T09:21:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f73fff640 1 -- 172.21.15.46:0/243706937 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f780041d0 con 0x559e06a2f370 2024-09-19T09:21:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f73fff640 1 -- 172.21.15.46:0/243706937 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7800f910 con 0x559e06a2f370 2024-09-19T09:21:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f8e581640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4f740a32f0 0x7f4f740a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.388+0000 7f4f7effd640 1 -- 172.21.15.46:0/389346145 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4f840cfba0 con 0x7f4f88101b60 2024-09-19T09:21:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 -- 172.21.15.46:0/243706937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 msgr2=0x559e06a31830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f8e581640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4f740a32f0 0x7f4f740a57b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f80005cc0 tx=0x7f4f80030a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a31830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009fa0 tx=0x7f4f780118d0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 -- 172.21.15.46:0/243706937 shutdown_connections 2024-09-19T09:21:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a31830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2a2e0 0x559e06a2eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 --2- 172.21.15.46:0/243706937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a29da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 -- 172.21.15.46:0/243706937 >> 172.21.15.46:0/243706937 conn(0x559e06a25010 msgr2=0x559e06a25410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 -- 172.21.15.46:0/243706937 shutdown_connections 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.389+0000 7f4f92e55740 1 -- 172.21.15.46:0/243706937 wait complete. 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 -- start start 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 Processor -- start 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a33c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a34190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a3b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x559e06a32340 con 0x559e06a2a2e0 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x559e06916290 con 0x559e06a2f370 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559e06a324c0 con 0x559e06a299a0 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.390+0000 7f4f92e55740 10 client.0 _ll_register_callbacks cb 0x559e06947140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8d57f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a34190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8d57f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a34190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43874/0 (socket says 172.21.15.46:43874) 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8d57f640 1 -- 172.21.15.46:0/256447638 learned_addr learned my addr 172.21.15.46:0/256447638 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a33c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a3b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 -- 172.21.15.46:0/256447638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 msgr2=0x559e06a33c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a33c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 -- 172.21.15.46:0/256447638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 msgr2=0x559e06a34190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a34190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 -- 172.21.15.46:0/256447638 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e066a0210 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a34190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f8e581640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a3b1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f80030960 tx=0x7f4f8002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c12083bd76f80fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.391+0000 7f4f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f717fa640 1 -- 172.21.15.46:0/256447638 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80050070 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f717fa640 1 -- 172.21.15.46:0/256447638 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4f80004450 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f780041d0 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f717fa640 1 -- 172.21.15.46:0/256447638 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4f8005c050 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 10 client.25730 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559e0676c620 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f717fa640 1 -- 172.21.15.46:0/256447638 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f780041d0 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f717fa640 1 -- 172.21.15.46:0/256447638 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f4f8003c040 con 0x559e06a2f370 2024-09-19T09:21:02.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 10 client.25730 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 10 client.25730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 20 client.25730 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06a3f9a0 0x559e06a41e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 4 client.25730 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.392+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e0699aa20 con 0x559e06a3f9a0 2024-09-19T09:21:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.393+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06a3f9a0 0x559e06a41e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.393+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06a3f9a0 0x559e06a41e00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e17a110924044105 server_cookie=f9b1f3d53d3a8e7a in_seq=0 out_seq=0 2024-09-19T09:21:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.393+0000 7f4f717fa640 10 client.25730 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f717fa640 1 -- 172.21.15.46:0/256447638 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e0699aa20 con 0x559e06a3f9a0 2024-09-19T09:21:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f717fa640 10 client.25730 handle_command_reply: tid=0 2024-09-19T09:21:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 client.25730 shutdown 2024-09-19T09:21:02.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 msgr2=0x559e06a3b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a3b1d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f80030960 tx=0x7f4f8002a6c0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 shutdown_connections 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06a3f9a0 0x559e06a41e00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a34190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a3b1d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f717fa640 0 client.25730 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 --2- 172.21.15.46:0/256447638 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a33c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 >> 172.21.15.46:0/256447638 conn(0x559e06a25010 msgr2=0x559e06a26820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 shutdown_connections 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.394+0000 7f4f92e55740 1 -- 172.21.15.46:0/256447638 wait complete. 2024-09-19T09:21:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.395+0000 7f4f92e55740 20 client.25730 trim_cache size 0 max 16384 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 Processor -- start 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 -- start start 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a240b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a3b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a26400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881ab190 con 0x559e06a2a2e0 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881acd90 con 0x559e06a2f370 2024-09-19T09:21:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f92e55740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881ab860 con 0x559e06a299a0 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f8e581640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a26400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f8dd80640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f8e581640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a26400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:60062/0 (socket says 172.21.15.46:60062) 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f8dd80640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a240b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:41470/0 (socket says 172.21.15.46:41470) 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.414+0000 7f4f8e581640 1 -- 172.21.15.46:0/674902697 learned_addr learned my addr 172.21.15.46:0/674902697 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8dd80640 1 -- 172.21.15.46:0/674902697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 msgr2=0x559e06a26400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a26400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a3b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8dd80640 1 -- 172.21.15.46:0/674902697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 msgr2=0x559e06a3b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a3b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8dd80640 1 -- 172.21.15.46:0/674902697 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e06a31ba0 con 0x559e06a299a0 2024-09-19T09:21:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a3b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a240b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x559e06a2ad10 tx=0x7f4f840cf040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7785c32f7f8d7d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f737fe640 1 -- 172.21.15.46:0/674902697 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8409bcd0 con 0x559e06a299a0 2024-09-19T09:21:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f737fe640 1 -- 172.21.15.46:0/674902697 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f840d5070 con 0x559e06a299a0 2024-09-19T09:21:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.415+0000 7f4f737fe640 1 -- 172.21.15.46:0/674902697 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8409baf0 con 0x559e06a299a0 2024-09-19T09:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 -- 172.21.15.46:0/674902697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 msgr2=0x559e06a240b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a240b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x559e06a2ad10 tx=0x7f4f840cf040 comp rx=0 tx=0).stop 2024-09-19T09:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 -- 172.21.15.46:0/674902697 shutdown_connections 2024-09-19T09:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a2a2e0 0x559e06a3b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2f370 0x559e06a26400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 --2- 172.21.15.46:0/674902697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a299a0 0x559e06a240b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 -- 172.21.15.46:0/674902697 >> 172.21.15.46:0/674902697 conn(0x559e06a25010 msgr2=0x559e06a239a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 -- 172.21.15.46:0/674902697 shutdown_connections 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 -- 172.21.15.46:0/674902697 wait complete. 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.416+0000 7f4f92e55740 1 -- start start 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 Processor -- start 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a388c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2a2e0 0x559e06a38e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2f370 0x559e06a39dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881ac600 con 0x559e06a299a0 2024-09-19T09:21:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881abf30 con 0x559e06a2a2e0 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881a9170 con 0x559e06a2f370 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f92e55740 10 client.0 _ll_register_callbacks cb 0x7f4f80043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f8dd80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f8dd80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43886/0 (socket says 172.21.15.46:43886) 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f8dd80640 1 -- 172.21.15.46:0/656638741 learned_addr learned my addr 172.21.15.46:0/656638741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.417+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2a2e0 0x559e06a38e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8e581640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2f370 0x559e06a39dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8d57f640 1 -- 172.21.15.46:0/656638741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2f370 msgr2=0x559e06a39dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2f370 0x559e06a39dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8d57f640 1 -- 172.21.15.46:0/656638741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 msgr2=0x559e06a388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8d57f640 1 -- 172.21.15.46:0/656638741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e06a3a3d0 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f8d57f640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2a2e0 0x559e06a38e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f78000c00 tx=0x7f4f780035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4116926f5d766a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f717fa640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f717fa640 1 -- 172.21.15.46:0/656638741 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78003a30 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f717fa640 1 -- 172.21.15.46:0/656638741 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f4f78016040 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f840d5070 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.418+0000 7f4f717fa640 1 -- 172.21.15.46:0/656638741 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4f78029030 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 10 client.25736 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559e06aaa6e0 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f717fa640 1 -- 172.21.15.46:0/656638741 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f840d5070 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f717fa640 1 -- 172.21.15.46:0/656638741 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f4f7802c070 con 0x559e06a2a2e0 2024-09-19T09:21:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 10 client.25736 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 10 client.25736 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 20 client.25736 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06aaaed0 0x559e06aad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 4 client.25736 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559e06994d70 con 0x559e06aaaed0 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.419+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06aaaed0 0x559e06aad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.420+0000 7f4f717fa640 10 client.25736 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.420+0000 7f4f8dd80640 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06aaaed0 0x559e06aad2f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3722b65eb35c106 server_cookie=25e79d207a5bb713 in_seq=0 out_seq=0 2024-09-19T09:21:02.445 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dirperf 2024-09-19T09:21:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.451+0000 7f4f717fa640 1 -- 172.21.15.46:0/656638741 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559e06994d70 con 0x559e06aaaed0 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.451+0000 7f4f717fa640 10 client.25736 handle_command_reply: tid=0 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 client.25736 shutdown 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2a2e0 msgr2=0x559e06a38e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2a2e0 0x559e06a38e00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f78000c00 tx=0x7f4f780035f0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 shutdown_connections 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x559e06aaaed0 0x559e06aad2f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559e06a2f370 0x559e06a39dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559e06a2a2e0 0x559e06a38e00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 --2- 172.21.15.46:0/656638741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x559e06a299a0 0x559e06a388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f717fa640 0 client.25736 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:02.454 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 >> 172.21.15.46:0/656638741 conn(0x559e06a25010 msgr2=0x559e06a241c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 shutdown_connections 2024-09-19T09:21:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 1 -- 172.21.15.46:0/656638741 wait complete. 2024-09-19T09:21:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:21:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:21:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:21:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:21:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.452+0000 7f4f92e55740 20 client.25736 trim_cache size 0 max 16384 2024-09-19T09:21:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4f740a32f0 msgr2=0x7f4f740a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4f740a32f0 0x7f4f740a57b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f80005cc0 tx=0x7f4f80030a30 comp rx=0 tx=0).stop 2024-09-19T09:21:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 msgr2=0x7f4f88075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 0x7f4f88075fa0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400e9a0 tx=0x7f4f8400ee60 comp rx=0 tx=0).stop 2024-09-19T09:21:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 shutdown_connections 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f4f740a32f0 0x7f4f740a57b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f88103710 0x7f4f88074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f88102d50 0x7f4f880745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 --2- 172.21.15.46:0/389346145 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f88101b60 0x7f4f88075fa0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 >> 172.21.15.46:0/389346145 conn(0x7f4f880fd2c0 msgr2=0x7f4f88106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 shutdown_connections 2024-09-19T09:21:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:02.453+0000 7f4f8ffe4640 1 -- 172.21.15.46:0/389346145 wait complete. 2024-09-19T09:21:02.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:02 smithi115 ceph-mon[35055]: pgmap v420: 97 pgs: 97 active+clean; 40 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 574 op/s 2024-09-19T09:21:02.468 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] metaperf 2024-09-19T09:21:02.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:02 smithi046 ceph-mon[31203]: pgmap v420: 97 pgs: 97 active+clean; 40 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 574 op/s 2024-09-19T09:21:02.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:02 smithi099 ceph-mon[35256]: pgmap v420: 97 pgs: 97 active+clean; 40 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 574 op/s 2024-09-19T09:21:02.548 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] devzero 2024-09-19T09:21:02.550 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] feature 2024-09-19T09:21:02.707 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] alloc 2024-09-19T09:21:02.727 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fault 2024-09-19T09:21:02.777 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fstest 2024-09-19T09:21:02.788 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_access_root 2024-09-19T09:21:02.891 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] godown 2024-09-19T09:21:02.959 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] resvtest 2024-09-19T09:21:02.960 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] writemod 2024-09-19T09:21:03.027 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] writev_on_pagefault 2024-09-19T09:21:03.096 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] makeextents 2024-09-19T09:21:03.104 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] itrash 2024-09-19T09:21:03.168 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] rename 2024-09-19T09:21:03.201 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] multi_open_unlink 2024-09-19T09:21:03.282 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] unwritten_sync 2024-09-19T09:21:03.309 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] genhashnames 2024-09-19T09:21:03.317 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_holes 2024-09-19T09:21:03.380 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_writev 2024-09-19T09:21:03.473 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_truncate_cmtime 2024-09-19T09:21:03.483 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dirhash_collide 2024-09-19T09:21:03.503 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_rename_overwrite 2024-09-19T09:21:03.534 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] holetest 2024-09-19T09:21:03.643 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_truncate_self 2024-09-19T09:21:03.651 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] af_unix 2024-09-19T09:21:03.707 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_stale_pmd 2024-09-19T09:21:03.798 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_cow_race 2024-09-19T09:21:03.800 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_fallocate 2024-09-19T09:21:03.810 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fsync-err 2024-09-19T09:21:03.880 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_write_ro 2024-09-19T09:21:03.966 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_ext4_dax_journal_corruption 2024-09-19T09:21:03.967 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_ext4_dax_inline_corruption 2024-09-19T09:21:04.006 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_ofd_locks 2024-09-19T09:21:04.059 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_collision 2024-09-19T09:21:04.148 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_get_file_time 2024-09-19T09:21:04.148 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] mmap-write-concurrent 2024-09-19T09:21:04.216 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_create_short_dirs 2024-09-19T09:21:04.298 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_create_long_dirs 2024-09-19T09:21:04.307 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_enospc 2024-09-19T09:21:04.347 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_writev_overlap 2024-09-19T09:21:04.416 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] checkpoint_journal 2024-09-19T09:21:04.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:04 smithi115 ceph-mon[35055]: pgmap v421: 97 pgs: 97 active+clean; 43 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.7 MiB/s wr, 474 op/s 2024-09-19T09:21:04.465 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] mmap-rw-fault 2024-09-19T09:21:04.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:04 smithi046 ceph-mon[31203]: pgmap v421: 97 pgs: 97 active+clean; 43 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.7 MiB/s wr, 474 op/s 2024-09-19T09:21:04.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:04 smithi099 ceph-mon[35256]: pgmap v421: 97 pgs: 97 active+clean; 43 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.7 MiB/s wr, 474 op/s 2024-09-19T09:21:04.534 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] allocstale 2024-09-19T09:21:04.543 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_cow_memory_failure 2024-09-19T09:21:04.600 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fake-dump-rootino 2024-09-19T09:21:04.669 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dio-buf-fault 2024-09-19T09:21:04.718 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] rewinddir-test 2024-09-19T09:21:04.727 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] readdir-while-renames 2024-09-19T09:21:04.779 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] xfsctl 2024-09-19T09:21:04.841 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] bstat 2024-09-19T09:21:04.913 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mtab 2024-09-19T09:21:04.914 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] getdevicesize 2024-09-19T09:21:04.975 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] preallo_rw_pattern_reader 2024-09-19T09:21:05.070 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] preallo_rw_pattern_writer 2024-09-19T09:21:05.084 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] ftrunc 2024-09-19T09:21:05.135 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] trunc 2024-09-19T09:21:05.156 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fs_perms 2024-09-19T09:21:05.238 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] testx 2024-09-19T09:21:05.251 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] looptest 2024-09-19T09:21:05.324 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] locktest 2024-09-19T09:21:05.330 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] unwritten_mmap 2024-09-19T09:21:05.378 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] bulkstat_unlink_test 2024-09-19T09:21:05.465 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] deduperace 2024-09-19T09:21:05.489 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] bulkstat_unlink_test_modified 2024-09-19T09:21:05.608 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_dir_offset 2024-09-19T09:21:05.670 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_futimens 2024-09-19T09:21:05.705 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_immutable 2024-09-19T09:21:05.717 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] stale_handle 2024-09-19T09:21:05.787 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] pwrite_mmap_blocked 2024-09-19T09:21:05.813 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_dir_offset2 2024-09-19T09:21:05.903 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] seek_sanity_test 2024-09-19T09:21:05.971 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] seek_copy_test 2024-09-19T09:21:06.023 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_readdir_1 2024-09-19T09:21:06.151 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_readdir_2 2024-09-19T09:21:06.202 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fsync-tester 2024-09-19T09:21:06.311 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] nsexec 2024-09-19T09:21:06.415 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] cloner 2024-09-19T09:21:06.421 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] renameat2 2024-09-19T09:21:06.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:06 smithi115 ceph-mon[35055]: pgmap v422: 97 pgs: 97 active+clean; 44 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-09-19T09:21:06.474 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_getcwd 2024-09-19T09:21:06.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:06 smithi046 ceph-mon[31203]: pgmap v422: 97 pgs: 97 active+clean; 44 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-09-19T09:21:06.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:06 smithi099 ceph-mon[35256]: pgmap v422: 97 pgs: 97 active+clean; 44 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.7 MiB/s wr, 334 op/s 2024-09-19T09:21:06.522 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] e4compact 2024-09-19T09:21:06.600 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] test-nextquota 2024-09-19T09:21:06.608 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] punch-alternating 2024-09-19T09:21:06.650 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] attr-list-by-handle-cursor-test 2024-09-19T09:21:06.779 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dio-interleaved 2024-09-19T09:21:06.779 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] listxattr 2024-09-19T09:21:06.781 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_dir_type 2024-09-19T09:21:06.826 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] dio-invalidate-cache 2024-09-19T09:21:06.937 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] stat_test 2024-09-19T09:21:06.945 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_encrypted_d_revalidate 2024-09-19T09:21:06.953 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] attr_replace_test 2024-09-19T09:21:07.052 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] swapon 2024-09-19T09:21:07.120 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] mkswap 2024-09-19T09:21:07.125 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_attr_corruption 2024-09-19T09:21:07.237 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_open_tmpfiles 2024-09-19T09:21:07.274 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fscrypt-crypt-util 2024-09-19T09:21:07.278 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] bulkstat_null_ocount 2024-09-19T09:21:07.292 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] splice-test 2024-09-19T09:21:07.506 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] detached_mounts_propagation 2024-09-19T09:21:07.506 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] chprojid_fail 2024-09-19T09:21:07.545 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] ext4_resize 2024-09-19T09:21:07.676 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_readdir_3 2024-09-19T09:21:07.698 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] splice2pipe 2024-09-19T09:21:07.710 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] uuid_ioctl 2024-09-19T09:21:07.883 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_snapshot_deleted_subvolume 2024-09-19T09:21:07.884 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fiemap-fault 2024-09-19T09:21:07.894 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fiemap-tester 2024-09-19T09:21:08.052 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] open_by_handle 2024-09-19T09:21:08.052 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_stripealign 2024-09-19T09:21:08.060 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_mmap_dio 2024-09-19T09:21:08.191 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] xfsfind 2024-09-19T09:21:08.221 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] t_reflink_read_race 2024-09-19T09:21:08.223 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] fssum 2024-09-19T09:21:08.340 INFO:tasks.workunit.client.0.smithi046.stdout:Building log-writes 2024-09-19T09:21:08.346 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] replay-log 2024-09-19T09:21:08.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:08 smithi115 ceph-mon[35055]: pgmap v423: 97 pgs: 97 active+clean; 36 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.7 MiB/s wr, 328 op/s 2024-09-19T09:21:08.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:08 smithi046 ceph-mon[31203]: pgmap v423: 97 pgs: 97 active+clean; 36 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.7 MiB/s wr, 328 op/s 2024-09-19T09:21:08.500 INFO:tasks.workunit.client.0.smithi046.stdout:Building perf 2024-09-19T09:21:08.500 INFO:tasks.workunit.client.0.smithi046.stdout:Building aio-dio-regress 2024-09-19T09:21:08.505 INFO:tasks.workunit.client.0.smithi046.stdout:Building vfs 2024-09-19T09:21:08.508 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aiocp 2024-09-19T09:21:08.511 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] vfstest 2024-09-19T09:21:08.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:08 smithi099 ceph-mon[35256]: pgmap v423: 97 pgs: 97 active+clean; 36 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.7 MiB/s wr, 328 op/s 2024-09-19T09:21:08.699 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-append-write-read-race 2024-09-19T09:21:08.700 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-append-write-fallocate-race 2024-09-19T09:21:08.747 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-cow-race 2024-09-19T09:21:08.871 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-cycle-write 2024-09-19T09:21:08.879 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-eof-race 2024-09-19T09:21:08.925 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-extend-stat 2024-09-19T09:21:09.064 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-fcntl-race 2024-09-19T09:21:09.066 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-hole-filling-race 2024-09-19T09:21:09.093 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-invalidate-failure 2024-09-19T09:21:09.223 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-invalidate-readahead 2024-09-19T09:21:09.239 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aiodio_sparse2 2024-09-19T09:21:09.265 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-subblock-eof-read 2024-09-19T09:21:09.435 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-dio-write-verify 2024-09-19T09:21:09.460 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-09-19T09:21:09.506 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-09-19T09:21:09.610 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] aio-last-ref-held-by-io 2024-09-19T09:21:09.638 INFO:tasks.workunit.client.0.smithi046.stdout: [CC] mount-idmapped 2024-09-19T09:21:10.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:10 smithi115 ceph-mon[35055]: pgmap v424: 97 pgs: 97 active+clean; 36 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.5 MiB/s wr, 317 op/s 2024-09-19T09:21:10.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:10 smithi046 ceph-mon[31203]: pgmap v424: 97 pgs: 97 active+clean; 36 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.5 MiB/s wr, 317 op/s 2024-09-19T09:21:10.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:10 smithi099 ceph-mon[35256]: pgmap v424: 97 pgs: 97 active+clean; 36 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 1.5 MiB/s wr, 317 op/s 2024-09-19T09:21:10.625 INFO:tasks.workunit.client.0.smithi046.stderr:+ cd .. 2024-09-19T09:21:10.625 INFO:tasks.workunit.client.0.smithi046.stderr:+ cp xfstests-dev/ltp/fsx . 2024-09-19T09:21:10.630 INFO:tasks.workunit.client.0.smithi046.stderr:+ OPTIONS=-z 2024-09-19T09:21:10.630 INFO:tasks.workunit.client.0.smithi046.stderr:+ ./fsx -z 1MB -N 50000 -p 10000 -l 1048576 2024-09-19T09:21:10.631 INFO:tasks.workunit.client.0.smithi046.stdout:Seed set to 1 2024-09-19T09:21:10.658 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-19T09:21:10.658 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-19T09:21:10.661 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T09:21:10.661 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T09:21:10.661 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T09:21:10.664 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T09:21:10.666 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support exchange range, disabling! 2024-09-19T09:21:10.666 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero size read 2024-09-19T09:21:10.667 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero size read 2024-09-19T09:21:10.667 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x81d54 2024-09-19T09:21:10.671 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xb86d7 2024-09-19T09:21:10.678 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xe627e 2024-09-19T09:21:10.714 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0xf3194 2024-09-19T09:21:10.734 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xf3ceb 2024-09-19T09:21:10.740 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0xf47e4 2024-09-19T09:21:10.822 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xfaccc 2024-09-19T09:21:11.166 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xfe423 2024-09-19T09:21:12.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:12 smithi115 ceph-mon[35055]: pgmap v425: 97 pgs: 97 active+clean; 36 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-09-19T09:21:12.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:12 smithi046 ceph-mon[31203]: pgmap v425: 97 pgs: 97 active+clean; 36 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-09-19T09:21:12.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:12 smithi099 ceph-mon[35256]: pgmap v425: 97 pgs: 97 active+clean; 36 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 1.5 MiB/s wr, 305 op/s 2024-09-19T09:21:13.186 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xfe492 2024-09-19T09:21:14.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:14 smithi115 ceph-mon[35055]: pgmap v426: 97 pgs: 97 active+clean; 37 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 806 KiB/s wr, 207 op/s 2024-09-19T09:21:14.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:14 smithi046 ceph-mon[31203]: pgmap v426: 97 pgs: 97 active+clean; 37 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 806 KiB/s wr, 207 op/s 2024-09-19T09:21:14.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:14 smithi099 ceph-mon[35256]: pgmap v426: 97 pgs: 97 active+clean; 37 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 806 KiB/s wr, 207 op/s 2024-09-19T09:21:14.798 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xff038 2024-09-19T09:21:15.526 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0xffcac 2024-09-19T09:21:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 -- 172.21.15.46:0/3304168013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c1025f0 msgr2=0x7f7e7c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 --2- 172.21.15.46:0/3304168013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c1025f0 0x7f7e7c108e80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009ca0 tx=0x7f7e7402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 -- 172.21.15.46:0/3304168013 shutdown_connections 2024-09-19T09:21:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 --2- 172.21.15.46:0/3304168013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c1025f0 0x7f7e7c108e80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.562 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 --2- 172.21.15.46:0/3304168013 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e7c101c30 0x7f7e7c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 --2- 172.21.15.46:0/3304168013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 -- 172.21.15.46:0/3304168013 >> 172.21.15.46:0/3304168013 conn(0x7f7e7c0fc1e0 msgr2=0x7f7e7c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 -- 172.21.15.46:0/3304168013 shutdown_connections 2024-09-19T09:21:15.563 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.561+0000 7f7e82728640 1 -- 172.21.15.46:0/3304168013 wait complete. 2024-09-19T09:21:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 Processor -- start 2024-09-19T09:21:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 -- start start 2024-09-19T09:21:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c101c30 0x7f7e7c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e7c1025f0 0x7f7e7c1a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c10c6f0 con 0x7f7e7c101c30 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c10c570 con 0x7f7e7c100a40 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e82728640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c10c870 con 0x7f7e7c1025f0 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.562+0000 7f7e7bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c101c30 0x7f7e7c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c199f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:54628/0 (socket says 172.21.15.46:54628) 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 -- 172.21.15.46:0/1155726516 learned_addr learned my addr 172.21.15.46:0/1155726516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e7c1025f0 0x7f7e7c1a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.566 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 -- 172.21.15.46:0/1155726516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e7c1025f0 msgr2=0x7f7e7c1a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e7c1025f0 0x7f7e7c1a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 -- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c101c30 msgr2=0x7f7e7c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c101c30 0x7f7e7c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 -- 172.21.15.46:0/1155726516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c1a1ba0 con 0x7f7e7c100a40 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c199f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9c0 tx=0x7f7e6c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e797fa640 1 -- 172.21.15.46:0/1155726516 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00cd80 con 0x7f7e7c100a40 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e797fa640 1 -- 172.21.15.46:0/1155726516 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c0035f0 con 0x7f7e7c100a40 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c1a1e90 con 0x7f7e7c100a40 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e797fa640 1 -- 172.21.15.46:0/1155726516 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c010690 con 0x7f7e7c100a40 2024-09-19T09:21:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.563+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c1a22f0 con 0x7f7e7c100a40 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e797fa640 1 -- 172.21.15.46:0/1155726516 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7e6c0037a0 con 0x7f7e7c100a40 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 Processor -- start 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 -- start start 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c73474dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c734752da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734755830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c7346b12f0 con 0x55c73474e2e0 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c734659270 con 0x55c734753370 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e854b7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c7346ad2b0 con 0x55c73474d9a0 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e7bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c734752da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e80cc5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c73474dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e7b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734755830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e7bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c734752da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36738/0 (socket says 172.21.15.46:36738) 2024-09-19T09:21:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.566+0000 7f7e7bfff640 1 -- 172.21.15.46:0/3345789040 learned_addr learned my addr 172.21.15.46:0/3345789040 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e797fa640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7e640a32f0 0x7f7e640a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7e640a32f0 0x7f7e640a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e797fa640 1 -- 172.21.15.46:0/1155726516 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e6c0cfcb0 con 0x7f7e7c100a40 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7bfff640 1 -- 172.21.15.46:0/3345789040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 msgr2=0x55c73474dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c73474dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7bfff640 1 -- 172.21.15.46:0/3345789040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 msgr2=0x55c734755830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734755830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7bfff640 1 -- 172.21.15.46:0/3345789040 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c734658340 con 0x55c73474e2e0 2024-09-19T09:21:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734755830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c73474dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c734752da0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c09c000 tx=0x7f7e6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c18baa4a6b5833 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e627fc640 1 -- 172.21.15.46:0/3345789040 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c09ca00 con 0x55c73474e2e0 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7e640a32f0 0x7f7e640a57b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7e74005e30 tx=0x7f7e7402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e627fc640 1 -- 172.21.15.46:0/3345789040 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c09c300 con 0x55c73474e2e0 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.567+0000 7f7e627fc640 1 -- 172.21.15.46:0/3345789040 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0ccc30 con 0x55c73474e2e0 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 -- 172.21.15.46:0/3345789040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 msgr2=0x55c734752da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c734752da0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c09c000 tx=0x7f7e6c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 -- 172.21.15.46:0/3345789040 shutdown_connections 2024-09-19T09:21:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c734752da0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734755830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 --2- 172.21.15.46:0/3345789040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c73474dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 -- 172.21.15.46:0/3345789040 >> 172.21.15.46:0/3345789040 conn(0x55c734749010 msgr2=0x55c734749410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 -- 172.21.15.46:0/3345789040 shutdown_connections 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.568+0000 7f7e854b7740 1 -- 172.21.15.46:0/3345789040 wait complete. 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 -- start start 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 Processor -- start 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 0x55c734757ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c734758020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c73475f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55c734756280 con 0x55c73474d9a0 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55c73463a290 con 0x55c734753370 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c734756400 con 0x55c73474e2e0 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e854b7740 10 client.0 _ll_register_callbacks cb 0x55c73466b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e7bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 0x55c734757ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e7bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 0x55c734757ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36750/0 (socket says 172.21.15.46:36750) 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e7bfff640 1 -- 172.21.15.46:0/2590750110 learned_addr learned my addr 172.21.15.46:0/2590750110 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c73475f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.569+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c734758020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e7bfff640 1 -- 172.21.15.46:0/2590750110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 msgr2=0x55c734758020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c734758020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e7bfff640 1 -- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 msgr2=0x55c73475f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c73475f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e7bfff640 1 -- 172.21.15.46:0/2590750110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7343c4210 con 0x55c73474d9a0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 0x55c734757ae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0cdb50 tx=0x7f7e6c0cd750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb752c7525a6240 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/2590750110 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0b4030 con 0x55c73474d9a0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/2590750110 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e6c0b5270 con 0x55c73474d9a0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e6c09c300 con 0x55c73474d9a0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/2590750110 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7e6c0a4f70 con 0x55c73474d9a0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e854b7740 10 client.16242 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c734490620 con 0x55c73474d9a0 2024-09-19T09:21:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.570+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/2590750110 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c09c300 con 0x55c73474d9a0 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/2590750110 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f7e6c09b750 con 0x55c73474d9a0 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e854b7740 10 client.16242 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e854b7740 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e854b7740 20 client.16242 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e854b7740 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347633b0 0x55c7347657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e854b7740 4 client.16242 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7346bea20 con 0x55c7347633b0 2024-09-19T09:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347633b0 0x55c7347657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e5b7fe640 10 client.16242 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.571+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347633b0 0x55c7347657d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c09c7b9bc428ed server_cookie=be7d4d8b2ee99d69 in_seq=0 out_seq=0 2024-09-19T09:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/2590750110 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7346bea20 con 0x55c7347633b0 2024-09-19T09:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e5b7fe640 10 client.16242 handle_command_reply: tid=0 2024-09-19T09:21:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 client.16242 shutdown 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 msgr2=0x55c734757ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 0x55c734757ae0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0cdb50 tx=0x7f7e6c0cd750 comp rx=0 tx=0).stop 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 shutdown_connections 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347633b0 0x55c7347657d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c73475f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e5b7fe640 0 client.16242 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c734758020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 --2- 172.21.15.46:0/2590750110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474d9a0 0x55c734757ae0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 >> 172.21.15.46:0/2590750110 conn(0x55c734749010 msgr2=0x55c73474a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 shutdown_connections 2024-09-19T09:21:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 1 -- 172.21.15.46:0/2590750110 wait complete. 2024-09-19T09:21:15.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.573+0000 7f7e854b7740 20 client.16242 trim_cache size 0 max 16384 2024-09-19T09:21:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 Processor -- start 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 -- start start 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c734757fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c73475eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734749ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c1ab110 con 0x55c73474e2e0 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c1acd10 con 0x55c734753370 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.591+0000 7f7e854b7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c1ab7e0 con 0x55c73474d9a0 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c73475eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c73475eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36756/0 (socket says 172.21.15.46:36756) 2024-09-19T09:21:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e80cc5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734749ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 -- 172.21.15.46:0/653115324 learned_addr learned my addr 172.21.15.46:0/653115324 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c734757fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 -- 172.21.15.46:0/653115324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 msgr2=0x55c734757fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c734757fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 -- 172.21.15.46:0/653115324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 msgr2=0x55c734749ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734749ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 -- 172.21.15.46:0/653115324 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c734757620 con 0x55c73474e2e0 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c73475eff0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000c00 tx=0x7f7e7000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246c659cff555f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e61ffb640 1 -- 172.21.15.46:0/653115324 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70003de0 con 0x55c73474e2e0 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e61ffb640 1 -- 172.21.15.46:0/653115324 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e70026920 con 0x55c73474e2e0 2024-09-19T09:21:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.592+0000 7f7e61ffb640 1 -- 172.21.15.46:0/653115324 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011aa0 con 0x55c73474e2e0 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 -- 172.21.15.46:0/653115324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 msgr2=0x55c73475eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c73475eff0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000c00 tx=0x7f7e7000b390 comp rx=0 tx=0).stop 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 -- 172.21.15.46:0/653115324 shutdown_connections 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c73474e2e0 0x55c73475eff0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c734753370 0x55c734749ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 --2- 172.21.15.46:0/653115324 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474d9a0 0x55c734757fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 -- 172.21.15.46:0/653115324 >> 172.21.15.46:0/653115324 conn(0x55c734749010 msgr2=0x55c734757890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 -- 172.21.15.46:0/653115324 shutdown_connections 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.593+0000 7f7e854b7740 1 -- 172.21.15.46:0/653115324 wait complete. 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 -- start start 2024-09-19T09:21:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 Processor -- start 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c73474d9a0 0x55c73475c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c73475cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 0x55c73475dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c1ac580 con 0x55c734753370 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c1abeb0 con 0x55c73474d9a0 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c1a90f0 con 0x55c73474e2e0 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e854b7740 10 client.0 _ll_register_callbacks cb 0x7f7e7000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e80cc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 0x55c73475dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e80cc5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 0x55c73475dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36772/0 (socket says 172.21.15.46:36772) 2024-09-19T09:21:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e80cc5640 1 -- 172.21.15.46:0/1143097532 learned_addr learned my addr 172.21.15.46:0/1143097532 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c73474d9a0 0x55c73475c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.594+0000 7f7e7b7fe640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c73475cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e80cc5640 1 -- 172.21.15.46:0/1143097532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 msgr2=0x55c73475cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c73475cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e80cc5640 1 -- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c73474d9a0 msgr2=0x55c73475c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c73474d9a0 0x55c73475c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e80cc5640 1 -- 172.21.15.46:0/1143097532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c73475e360 con 0x55c734753370 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c73474d9a0 0x55c73475c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e80cc5640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 0x55c73475dd50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7e7402aeb0 tx=0x7f7e740095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6427b82546b7d8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/1143097532 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74004710 con 0x55c734753370 2024-09-19T09:21:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/1143097532 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f7e7402f610 con 0x55c734753370 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e70026920 con 0x55c734753370 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/1143097532 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7e7402f810 con 0x55c734753370 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e854b7740 10 client.16248 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.595+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c7347ce220 con 0x55c734753370 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/1143097532 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e70026920 con 0x55c734753370 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/1143097532 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f7e7404a040 con 0x55c734753370 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e854b7740 10 client.16248 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e854b7740 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e854b7740 20 client.16248 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e854b7740 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347ced10 0x55c7347d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e854b7740 4 client.16248 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c7346b8d70 con 0x55c7347ced10 2024-09-19T09:21:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.596+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347ced10 0x55c7347d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.597+0000 7f7e5b7fe640 10 client.16248 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.597+0000 7f7e7bfff640 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347ced10 0x55c7347d1130 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a78924e59bae02f server_cookie=b9d6fb2abaae673f in_seq=0 out_seq=0 2024-09-19T09:21:15.629 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e5b7fe640 1 -- 172.21.15.46:0/1143097532 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c7346b8d70 con 0x55c7347ced10 2024-09-19T09:21:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e5b7fe640 10 client.16248 handle_command_reply: tid=0 2024-09-19T09:21:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 client.16248 shutdown 2024-09-19T09:21:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 msgr2=0x55c73475dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.630 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 0x55c73475dd50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7e7402aeb0 tx=0x7f7e740095c0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 shutdown_connections 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55c7347ced10 0x55c7347d1130 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55c734753370 0x55c73475dd50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c73474e2e0 0x55c73475cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e5b7fe640 0 client.16248 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 --2- 172.21.15.46:0/1143097532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c73474d9a0 0x55c73475c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 >> 172.21.15.46:0/1143097532 conn(0x55c734749010 msgr2=0x55c7347479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 shutdown_connections 2024-09-19T09:21:15.631 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 1 -- 172.21.15.46:0/1143097532 wait complete. 2024-09-19T09:21:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.628+0000 7f7e854b7740 20 client.16248 trim_cache size 0 max 16384 2024-09-19T09:21:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:21:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:21:15.632 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:21:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:21:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7e640a32f0 msgr2=0x7f7e640a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.633 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7e640a32f0 0x7f7e640a57b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7e74005e30 tx=0x7f7e7402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 msgr2=0x7f7e7c199f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c199f80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9c0 tx=0x7f7e6c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 shutdown_connections 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f7e640a32f0 0x7f7e640a57b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e7c101c30 0x7f7e7c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e7c1025f0 0x7f7e7c1a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 --2- 172.21.15.46:0/1155726516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e7c100a40 0x7f7e7c199f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 >> 172.21.15.46:0/1155726516 conn(0x7f7e7c0fc1e0 msgr2=0x7f7e7c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 shutdown_connections 2024-09-19T09:21:15.634 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:15.629+0000 7f7e82728640 1 -- 172.21.15.46:0/1155726516 wait complete. 2024-09-19T09:21:15.666 INFO:tasks.workunit.client.0.smithi046.stdout:10000 copy from 0x2d237 to 0x30552, (0x331b bytes) at 0x82aed 2024-09-19T09:21:16.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:16 smithi115 ceph-mon[35055]: pgmap v427: 97 pgs: 97 active+clean; 39 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 658 KiB/s wr, 165 op/s 2024-09-19T09:21:16.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:16 smithi046 ceph-mon[31203]: pgmap v427: 97 pgs: 97 active+clean; 39 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 658 KiB/s wr, 165 op/s 2024-09-19T09:21:16.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:16 smithi099 ceph-mon[35256]: pgmap v427: 97 pgs: 97 active+clean; 39 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 658 KiB/s wr, 165 op/s 2024-09-19T09:21:18.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:18 smithi115 ceph-mon[35055]: pgmap v428: 97 pgs: 97 active+clean; 41 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 483 op/s 2024-09-19T09:21:18.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:18 smithi046 ceph-mon[31203]: pgmap v428: 97 pgs: 97 active+clean; 41 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 483 op/s 2024-09-19T09:21:18.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:18 smithi099 ceph-mon[35256]: pgmap v428: 97 pgs: 97 active+clean; 41 MiB data, 585 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 483 op/s 2024-09-19T09:21:20.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:20 smithi115 ceph-mon[35055]: pgmap v429: 97 pgs: 97 active+clean; 41 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 470 op/s 2024-09-19T09:21:20.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:20 smithi046 ceph-mon[31203]: pgmap v429: 97 pgs: 97 active+clean; 41 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 470 op/s 2024-09-19T09:21:20.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:20 smithi099 ceph-mon[35256]: pgmap v429: 97 pgs: 97 active+clean; 41 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 470 op/s 2024-09-19T09:21:21.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:21:21.547 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 -- 172.21.15.46:0/3635038847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4106f00 msgr2=0x7fb2c410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 --2- 172.21.15.46:0/3635038847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4106f00 0x7fb2c410ea80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009ca0 tx=0x7fb2bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 -- 172.21.15.46:0/3635038847 shutdown_connections 2024-09-19T09:21:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 --2- 172.21.15.46:0/3635038847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2c4102780 0x7fb2c41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 --2- 172.21.15.46:0/3635038847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4106f00 0x7fb2c410ea80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 --2- 172.21.15.46:0/3635038847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 -- 172.21.15.46:0/3635038847 >> 172.21.15.46:0/3635038847 conn(0x7fb2c40fd8b0 msgr2=0x7fb2c40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 -- 172.21.15.46:0/3635038847 shutdown_connections 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.041+0000 7fb2cb428640 1 -- 172.21.15.46:0/3635038847 wait complete. 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 Processor -- start 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 -- start start 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4102780 0x7fb2c4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2c4106f00 0x7fb2c4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4111fb0 con 0x7fb2c4106f00 2024-09-19T09:21:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4111e30 con 0x7fb2c4101dd0 2024-09-19T09:21:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2cb428640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4112130 con 0x7fb2c4102780 2024-09-19T09:21:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:44166/0 (socket says 172.21.15.46:44166) 2024-09-19T09:21:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c99c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2c4106f00 0x7fb2c4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c89c3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4102780 0x7fb2c4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 -- 172.21.15.46:0/4009864260 learned_addr learned my addr 172.21.15.46:0/4009864260 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 -- 172.21.15.46:0/4009864260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4102780 msgr2=0x7fb2c4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4102780 0x7fb2c4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 -- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2c4106f00 msgr2=0x7fb2c4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2c4106f00 0x7fb2c4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.042+0000 7fb2c91c4640 1 -- 172.21.15.46:0/4009864260 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c41a68f0 con 0x7fb2c4101dd0 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.043+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c40744f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000e9f0 tx=0x7fb2c000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:22.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.043+0000 7fb2ba7fc640 1 -- 172.21.15.46:0/4009864260 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000cd80 con 0x7fb2c4101dd0 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.043+0000 7fb2ba7fc640 1 -- 172.21.15.46:0/4009864260 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2c0010910 con 0x7fb2c4101dd0 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.043+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c41a6be0 con 0x7fb2c4101dd0 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.043+0000 7fb2ba7fc640 1 -- 172.21.15.46:0/4009864260 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0018990 con 0x7fb2c4101dd0 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.043+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c41a7170 con 0x7fb2c4101dd0 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.046+0000 7fb2ba7fc640 1 -- 172.21.15.46:0/4009864260 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb2c0010ac0 con 0x7fb2c4101dd0 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 Processor -- start 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 -- start start 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2ba7fc640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb2b00a32c0 0x7fb2b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e796880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7a1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e7a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e14e6fc2e0 con 0x55e14e796dc0 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e14e6a3ce0 con 0x55e14e7a1680 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2cd801740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e14e6f82a0 con 0x55e14e7964a0 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2ba7fc640 1 -- 172.21.15.46:0/4009864260 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb2c00cfb50 con 0x7fb2c4101dd0 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2c99c5640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb2b00a32c0 0x7fb2b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2c89c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2c99c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e7a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2c89c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39746/0 (socket says 172.21.15.46:39746) 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2064935776 learned_addr learned my addr 172.21.15.46:0/2064935776 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.047+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e796880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2064935776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 msgr2=0x55e14e796880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e796880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2064935776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 msgr2=0x55e14e7a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e7a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2064935776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14e688440 con 0x55e14e796dc0 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e796880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c99c5640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb2b00a32c0 0x7fb2b00a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc006010 tx=0x7fb2bc0099f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.048+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7a1140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009c10 tx=0x7fb2b4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174daecffce951ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:22.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.049+0000 7fb2af7fe640 1 -- 172.21.15.46:0/2064935776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4004230 con 0x55e14e796dc0 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.049+0000 7fb2af7fe640 1 -- 172.21.15.46:0/2064935776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b40043d0 con 0x55e14e796dc0 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.049+0000 7fb2af7fe640 1 -- 172.21.15.46:0/2064935776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4019710 con 0x55e14e796dc0 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.049+0000 7fb2cd801740 1 -- 172.21.15.46:0/2064935776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 msgr2=0x55e14e7a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.049+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7a1140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009c10 tx=0x7fb2b4011810 comp rx=0 tx=0).stop 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 -- 172.21.15.46:0/2064935776 shutdown_connections 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7a1140 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e7a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2064935776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e796880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 -- 172.21.15.46:0/2064935776 >> 172.21.15.46:0/2064935776 conn(0x55e14e792a30 msgr2=0x55e14e792e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 -- 172.21.15.46:0/2064935776 shutdown_connections 2024-09-19T09:21:22.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 -- 172.21.15.46:0/2064935776 wait complete. 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 -- start start 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.050+0000 7fb2cd801740 1 Processor -- start 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 0x55e14e7a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e79e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55e14e7a4250 con 0x55e14e7964a0 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55e14e6b7050 con 0x55e14e7a1680 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55e14e7a43d0 con 0x55e14e796dc0 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 0x55e14e7a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 0x55e14e7a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39758/0 (socket says 172.21.15.46:39758) 2024-09-19T09:21:22.061 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 -- 172.21.15.46:0/3775397483 learned_addr learned my addr 172.21.15.46:0/3775397483 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c99c5640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e79e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2cd801740 10 client.0 _ll_register_callbacks cb 0x55e14e6f7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 -- 172.21.15.46:0/3775397483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 msgr2=0x55e14e79e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e79e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 -- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 msgr2=0x55e14e79e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.051+0000 7fb2c91c4640 1 -- 172.21.15.46:0/3775397483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14e46d3c0 con 0x55e14e7964a0 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 0x55e14e7a0f20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00cd6d0 tx=0x7fb2c00a5d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c37c4c8b1e5dab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2acff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:22.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2acff9640 1 -- 172.21.15.46:0/3775397483 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00a4e10 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2acff9640 1 -- 172.21.15.46:0/3775397483 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb2c00ac010 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b40043d0 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2acff9640 1 -- 172.21.15.46:0/3775397483 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb2c00ac210 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2cd801740 10 client.16260 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e14e7afbe0 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2acff9640 1 -- 172.21.15.46:0/3775397483 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b40043d0 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.052+0000 7fb2acff9640 1 -- 172.21.15.46:0/3775397483 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fb2c00cdb40 con 0x55e14e7964a0 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2cd801740 10 client.16260 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2cd801740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2cd801740 20 client.16260 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:22.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2cd801740 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e7b1070 0x55e14e7b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2cd801740 4 client.16260 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e14e709850 con 0x55e14e7b1070 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e7b1070 0x55e14e7b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e7b1070 0x55e14e7b3530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41bca36308242da5 server_cookie=f3036782fcf7c046 in_seq=0 out_seq=0 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.053+0000 7fb2acff9640 10 client.16260 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.054+0000 7fb2acff9640 1 -- 172.21.15.46:0/3775397483 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e14e709850 con 0x55e14e7b1070 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.054+0000 7fb2acff9640 10 client.16260 handle_command_reply: tid=0 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.054+0000 7fb2cd801740 1 client.16260 shutdown 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.054+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 msgr2=0x55e14e7a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.054+0000 7fb2cd801740 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 0x55e14e7a0f20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00cd6d0 tx=0x7fb2c00a5d90 comp rx=0 tx=0).stop 2024-09-19T09:21:22.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.054+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 shutdown_connections 2024-09-19T09:21:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e7b1070 0x55e14e7b3530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e79e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 --2- 172.21.15.46:0/3775397483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7964a0 0x55e14e7a0f20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2acff9640 0 client.16260 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 >> 172.21.15.46:0/3775397483 conn(0x55e14e792a30 msgr2=0x55e14e798710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 shutdown_connections 2024-09-19T09:21:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 1 -- 172.21.15.46:0/3775397483 wait complete. 2024-09-19T09:21:22.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.055+0000 7fb2cd801740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T09:21:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 Processor -- start 2024-09-19T09:21:22.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 -- start start 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e7b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41ab340 con 0x55e14e796dc0 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41acf40 con 0x55e14e7a1680 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2cd801740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41aba10 con 0x55e14e7964a0 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.074+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e7b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e7b8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:45150/0 (socket says 172.21.15.46:45150) 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c91c4640 1 -- 172.21.15.46:0/2721495776 learned_addr learned my addr 172.21.15.46:0/2721495776 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:22.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c99c5640 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2721495776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 msgr2=0x55e14e7b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e7b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2721495776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 msgr2=0x55e14e79b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 -- 172.21.15.46:0/2721495776 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e14e796bf0 con 0x55e14e796dc0 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7b9340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4011d10 tx=0x7fb2b4009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee209951841bad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2aeffd640 1 -- 172.21.15.46:0/2721495776 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b401f040 con 0x55e14e796dc0 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2aeffd640 1 -- 172.21.15.46:0/2721495776 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b4029070 con 0x55e14e796dc0 2024-09-19T09:21:22.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.075+0000 7fb2aeffd640 1 -- 172.21.15.46:0/2721495776 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4003870 con 0x55e14e796dc0 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 -- 172.21.15.46:0/2721495776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 msgr2=0x55e14e7b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7b9340 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4011d10 tx=0x7fb2b4009770 comp rx=0 tx=0).stop 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 -- 172.21.15.46:0/2721495776 shutdown_connections 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e796dc0 0x55e14e7b9340 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7a1680 0x55e14e79b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 --2- 172.21.15.46:0/2721495776 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e7964a0 0x55e14e7b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 -- 172.21.15.46:0/2721495776 >> 172.21.15.46:0/2721495776 conn(0x55e14e792a30 msgr2=0x55e14e79caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 -- 172.21.15.46:0/2721495776 shutdown_connections 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.076+0000 7fb2cd801740 1 -- 172.21.15.46:0/2721495776 wait complete. 2024-09-19T09:21:22.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 -- start start 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 Processor -- start 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 0x55e14e7a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e7a5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7a1680 0x55e14e7a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41ac7b0 con 0x55e14e7a1680 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41ac0e0 con 0x55e14e7964a0 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.077+0000 7fb2cd801740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c41a9320 con 0x55e14e796dc0 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2cd801740 10 client.0 _ll_register_callbacks cb 0x7fb2c009bd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 0x55e14e7a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 0x55e14e7a53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:44204/0 (socket says 172.21.15.46:44204) 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 -- 172.21.15.46:0/880653006 learned_addr learned my addr 172.21.15.46:0/880653006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e7a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c99c5640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7a1680 0x55e14e7a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 -- 172.21.15.46:0/880653006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 msgr2=0x55e14e7a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e7a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 -- 172.21.15.46:0/880653006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7a1680 msgr2=0x55e14e7a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7a1680 0x55e14e7a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 -- 172.21.15.46:0/880653006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e14e81ae00 con 0x55e14e7964a0 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c99c5640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7a1680 0x55e14e7a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2c91c4640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 0x55e14e7a53d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00097b0 tx=0x7fb2c00a06d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42bbaf1d55053e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2acff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:22.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2acff9640 1 -- 172.21.15.46:0/880653006 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c00a4e10 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2acff9640 1 -- 172.21.15.46:0/880653006 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fb2c00b0300 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.078+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b4029070 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2acff9640 1 -- 172.21.15.46:0/880653006 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb2c00a0150 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 10 client.25772 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e14e81c0d0 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2acff9640 1 -- 172.21.15.46:0/880653006 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b4029070 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2acff9640 1 -- 172.21.15.46:0/880653006 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fb2c0097fa0 con 0x55e14e7964a0 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 10 client.25772 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 10 client.25772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 20 client.25772 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e81c830 0x55e14e81ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 4 client.25772 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:21:22.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e14e79eaa0 con 0x55e14e81c830 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.079+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e81c830 0x55e14e81ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2c89c3640 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e81c830 0x55e14e81ec50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e8cd4cae5ac7d1 server_cookie=6b55d98275205d91 in_seq=0 out_seq=0 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2acff9640 10 client.25772 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2acff9640 1 -- 172.21.15.46:0/880653006 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e14e79eaa0 con 0x55e14e81c830 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2acff9640 10 client.25772 handle_command_reply: tid=0 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 client.25772 shutdown 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 msgr2=0x55e14e7a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 0x55e14e7a53d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00097b0 tx=0x7fb2c00a06d0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 shutdown_connections 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55e14e81c830 0x55e14e81ec50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55e14e7a1680 0x55e14e7a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55e14e796dc0 0x55e14e7a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2acff9640 0 client.25772 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:22.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 --2- 172.21.15.46:0/880653006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e14e7964a0 0x55e14e7a53d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 >> 172.21.15.46:0/880653006 conn(0x55e14e792a30 msgr2=0x55e14e79c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:22.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 shutdown_connections 2024-09-19T09:21:22.088 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:21:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: "status": "no active scrubs running", 2024-09-19T09:21:22.088 INFO:teuthology.orchestra.run.smithi046.stdout: "scrubs": {} 2024-09-19T09:21:22.088 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:21:22.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 1 -- 172.21.15.46:0/880653006 wait complete. 2024-09-19T09:21:22.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.080+0000 7fb2cd801740 20 client.25772 trim_cache size 0 max 16384 2024-09-19T09:21:22.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb2b00a32c0 msgr2=0x7fb2b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb2b00a32c0 0x7fb2b00a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc006010 tx=0x7fb2bc0099f0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 msgr2=0x7fb2c40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c40744f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000e9f0 tx=0x7fb2c000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 shutdown_connections 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb2b00a32c0 0x7fb2b00a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2c4106f00 0x7fb2c4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb2c4102780 0x7fb2c4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 --2- 172.21.15.46:0/4009864260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2c4101dd0 0x7fb2c40744f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 >> 172.21.15.46:0/4009864260 conn(0x7fb2c40fd8b0 msgr2=0x7fb2c40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 shutdown_connections 2024-09-19T09:21:22.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:22.081+0000 7fb2cb428640 1 -- 172.21.15.46:0/4009864260 wait complete. 2024-09-19T09:21:22.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:22 smithi046 ceph-mon[31203]: pgmap v430: 97 pgs: 97 active+clean; 40 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 592 op/s 2024-09-19T09:21:22.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:22 smithi115 ceph-mon[35055]: pgmap v430: 97 pgs: 97 active+clean; 40 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 592 op/s 2024-09-19T09:21:22.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:22 smithi099 ceph-mon[35256]: pgmap v430: 97 pgs: 97 active+clean; 40 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 592 op/s 2024-09-19T09:21:22.886 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:21:22.886 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:23.177 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 -- 172.21.15.46:0/2806496786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 msgr2=0x7f67900748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 --2- 172.21.15.46:0/2806496786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f67900748f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f678c009900 tx=0x7f678c02a480 comp rx=0 tx=0).stop 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 -- 172.21.15.46:0/2806496786 shutdown_connections 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 --2- 172.21.15.46:0/2806496786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679010e280 0x7f6790110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 --2- 172.21.15.46:0/2806496786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 0x7f679010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 --2- 172.21.15.46:0/2806496786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f67900748f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 -- 172.21.15.46:0/2806496786 >> 172.21.15.46:0/2806496786 conn(0x7f67900fd740 msgr2=0x7f67900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.683+0000 7f679639d640 1 -- 172.21.15.46:0/2806496786 shutdown_connections 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.684+0000 7f679639d640 1 -- 172.21.15.46:0/2806496786 wait complete. 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.684+0000 7f679639d640 1 Processor -- start 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.684+0000 7f679639d640 1 -- start start 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679639d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f679019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679639d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 0x7f679019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679639d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679010e280 0x7f679019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679639d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6790113fb0 con 0x7f6790074510 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679639d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6790113e30 con 0x7f679010e280 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679639d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6790114130 con 0x7f6790074e30 2024-09-19T09:21:23.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679539b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f679019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679539b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f679019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39794/0 (socket says 172.21.15.46:39794) 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679539b640 1 -- 172.21.15.46:0/1436241363 learned_addr learned my addr 172.21.15.46:0/1436241363 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 0x7f679019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6795b9c640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679010e280 0x7f679019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 -- 172.21.15.46:0/1436241363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679010e280 msgr2=0x7f679019ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679010e280 0x7f679019ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 -- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 msgr2=0x7f679019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f679019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 -- 172.21.15.46:0/1436241363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679019f500 con 0x7f6790074e30 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f679539b640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f679019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:23.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.685+0000 7f6794b9a640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 0x7f679019aa90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f678000e9f0 tx=0x7f678000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.686+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678000ccc0 con 0x7f6790074e30 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.686+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6780010910 con 0x7f6790074e30 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.686+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679019f7f0 con 0x7f6790074e30 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.686+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67901a70d0 con 0x7f6790074e30 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.686+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780018960 con 0x7f6790074e30 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.688+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67900748f0 con 0x7f6790074e30 2024-09-19T09:21:23.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.689+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6780010ac0 con 0x7f6790074e30 2024-09-19T09:21:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.689+0000 7f67867fc640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f677c0a32c0 0x7f677c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.690+0000 7f679539b640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f677c0a32c0 0x7f677c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.690+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f67800cfbd0 con 0x7f6790074e30 2024-09-19T09:21:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.690+0000 7f679539b640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f677c0a32c0 0x7f677c0a5780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f678c0096c0 tx=0x7f678c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:23.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.694+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f678009c2d0 con 0x7f6790074e30 2024-09-19T09:21:23.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.945+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6790109400 con 0x7f6790074e30 2024-09-19T09:21:23.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.946+0000 7f67867fc640 1 -- 172.21.15.46:0/1436241363 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11967 (secure 0 0 0) 0x7f67800a05d0 con 0x7f6790074e30 2024-09-19T09:21:23.947 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:21:23.947 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"btime":"2024-09-19T09:20:55:949281+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:20:55.076172+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/1791811881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":1791811881},{"type":"v1","addr":"172.21.15.99:6835","nonce":1791811881}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:21:23.948 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 35 2024-09-19T09:21:23.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f677c0a32c0 msgr2=0x7f677c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f677c0a32c0 0x7f677c0a5780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f678c0096c0 tx=0x7f678c005a20 comp rx=0 tx=0).stop 2024-09-19T09:21:23.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 msgr2=0x7f679019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:23.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 0x7f679019aa90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f678000e9f0 tx=0x7f678000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 shutdown_connections 2024-09-19T09:21:23.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f677c0a32c0 0x7f677c0a5780 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f679010e280 0x7f679019ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6790074e30 0x7f679019aa90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 --2- 172.21.15.46:0/1436241363 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6790074510 0x7f679019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:23.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.948+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 >> 172.21.15.46:0/1436241363 conn(0x7f67900fd740 msgr2=0x7f67900feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:23.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.949+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 shutdown_connections 2024-09-19T09:21:23.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:23.949+0000 7f679639d640 1 -- 172.21.15.46:0/1436241363 wait complete. 2024-09-19T09:21:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:24 smithi046 ceph-mon[31203]: pgmap v431: 97 pgs: 97 active+clean; 39 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 793 op/s 2024-09-19T09:21:24.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:24 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1436241363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:24.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:24 smithi115 ceph-mon[35055]: pgmap v431: 97 pgs: 97 active+clean; 39 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 793 op/s 2024-09-19T09:21:24.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:24 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1436241363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:24.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:24 smithi099 ceph-mon[35256]: pgmap v431: 97 pgs: 97 active+clean; 39 MiB data, 647 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.9 MiB/s wr, 793 op/s 2024-09-19T09:21:24.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:24 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1436241363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:25.624 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:21:25.908 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:26.355 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:26 smithi046 ceph-mon[31203]: pgmap v432: 97 pgs: 97 active+clean; 39 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.6 MiB/s wr, 746 op/s 2024-09-19T09:21:26.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:26 smithi115 ceph-mon[35055]: pgmap v432: 97 pgs: 97 active+clean; 39 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.6 MiB/s wr, 746 op/s 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 -- 172.21.15.46:0/3399862779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04102dd0 msgr2=0x7fdc041031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/3399862779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04102dd0 0x7fdc041031b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009930 tx=0x7fdbf402a420 comp rx=0 tx=0).stop 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 -- 172.21.15.46:0/3399862779 shutdown_connections 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/3399862779 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc04108300 0x7fdc0410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/3399862779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04103780 0x7fdc04107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/3399862779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04102dd0 0x7fdc041031b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 -- 172.21.15.46:0/3399862779 >> 172.21.15.46:0/3399862779 conn(0x7fdc040fc7d0 msgr2=0x7fdc040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 -- 172.21.15.46:0/3399862779 shutdown_connections 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 -- 172.21.15.46:0/3399862779 wait complete. 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 Processor -- start 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.447+0000 7fdc0ab33640 1 -- start start 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc0ab33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 0x7fdc04198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc0ab33640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04103780 0x7fdc04198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc0ab33640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc04108300 0x7fdc0419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc0ab33640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041120b0 con 0x7fdc04103780 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc0ab33640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04111f30 con 0x7fdc04102dd0 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc0ab33640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc04112230 con 0x7fdc04108300 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 0x7fdc04198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04103780 0x7fdc04198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 0x7fdc04198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:44244/0 (socket says 172.21.15.46:44244) 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 -- 172.21.15.46:0/978202204 learned_addr learned my addr 172.21.15.46:0/978202204 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc090d0640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc04108300 0x7fdc0419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 -- 172.21.15.46:0/978202204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc04108300 msgr2=0x7fdc0419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc04108300 0x7fdc0419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 -- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04103780 msgr2=0x7fdc04198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04103780 0x7fdc04198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 -- 172.21.15.46:0/978202204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0419d620 con 0x7fdc04102dd0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.448+0000 7fdc088cf640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 0x7fdc04198670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009230 tx=0x7fdbf4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.449+0000 7fdc01ffb640 1 -- 172.21.15.46:0/978202204 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf403f030 con 0x7fdc04102dd0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.449+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0419d8b0 con 0x7fdc04102dd0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.449+0000 7fdc01ffb640 1 -- 172.21.15.46:0/978202204 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbf4004440 con 0x7fdc04102dd0 2024-09-19T09:21:26.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.449+0000 7fdc01ffb640 1 -- 172.21.15.46:0/978202204 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4035070 con 0x7fdc04102dd0 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.449+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc04100960 con 0x7fdc04102dd0 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.451+0000 7fdc01ffb640 1 -- 172.21.15.46:0/978202204 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdbf4042030 con 0x7fdc04102dd0 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 Processor -- start 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 -- start start 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e87090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e87a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e94760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4ded2f0 con 0x55d9f4e88b40 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4d94cf0 con 0x55d9f4e92370 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4de92b0 con 0x55d9f4e875d0 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc090d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e87090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc090d0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e87090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39828/0 (socket says 172.21.15.46:39828) 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc090d0640 1 -- 172.21.15.46:0/3567214680 learned_addr learned my addr 172.21.15.46:0/3567214680 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc088cf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e87a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e94760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc03fff640 1 -- 172.21.15.46:0/3567214680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 msgr2=0x55d9f4e87a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc03fff640 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e87a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc01ffb640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdbf00a3240 0x7fdbf00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc03fff640 1 -- 172.21.15.46:0/3567214680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 msgr2=0x55d9f4e87090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc03fff640 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e87090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc03fff640 1 -- 172.21.15.46:0/3567214680 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f4d793a0 con 0x55d9f4e92370 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.452+0000 7fdc090d0640 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e87090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.453+0000 7fdc090d0640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdbf00a3240 0x7fdbf00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.453+0000 7fdc03fff640 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e94760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406a2d0 tx=0x7fdbec005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b85d002ae59db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.453+0000 7fdc01ffb640 1 -- 172.21.15.46:0/978202204 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdbf40efc00 con 0x7fdc04102dd0 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.453+0000 7fdbfaffd640 1 -- 172.21.15.46:0/3567214680 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec004250 con 0x55d9f4e92370 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.453+0000 7fdbfaffd640 1 -- 172.21.15.46:0/3567214680 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbec0043f0 con 0x55d9f4e92370 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.453+0000 7fdbfaffd640 1 -- 172.21.15.46:0/3567214680 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec01a960 con 0x55d9f4e92370 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/3567214680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 msgr2=0x55d9f4e94760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e94760 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406a2d0 tx=0x7fdbec005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc090d0640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdbf00a3240 0x7fdbf00a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0107d0 tx=0x7fdbfc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/3567214680 shutdown_connections 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e94760 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e87a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/3567214680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e87090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/3567214680 >> 172.21.15.46:0/3567214680 conn(0x55d9f4e50310 msgr2=0x55d9f4e83c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/3567214680 shutdown_connections 2024-09-19T09:21:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/3567214680 wait complete. 2024-09-19T09:21:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 -- start start 2024-09-19T09:21:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 Processor -- start 2024-09-19T09:21:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.454+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 0x55d9f4e91cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e92370 0x55d9f4e8f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4e95070 con 0x55d9f4e88b40 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4da8060 con 0x55d9f4e875d0 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d9f4e951f0 con 0x55d9f4e92370 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 10 client.0 _ll_register_callbacks cb 0x55d9f4afb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 0x55d9f4e91cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 0x55d9f4e91cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:44270/0 (socket says 172.21.15.46:44270) 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 -- 172.21.15.46:0/186015937 learned_addr learned my addr 172.21.15.46:0/186015937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc090d0640 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e92370 0x55d9f4e8f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 -- 172.21.15.46:0/186015937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e92370 msgr2=0x55d9f4e8f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e92370 0x55d9f4e8f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 -- 172.21.15.46:0/186015937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 msgr2=0x55d9f4e8ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 -- 172.21.15.46:0/186015937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f4b5e3c0 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc088cf640 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 0x55d9f4e91cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40ed730 tx=0x7fdbf4009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880bcc55dcfb284e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdbe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdbe3fff640 1 -- 172.21.15.46:0/186015937 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4049070 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdbe3fff640 1 -- 172.21.15.46:0/186015937 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdbf40b8970 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.455+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbec0043f0 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdbe3fff640 1 -- 172.21.15.46:0/186015937 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdbf40bbe40 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 10 client.25790 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d9f4ea0a60 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdbe3fff640 1 -- 172.21.15.46:0/186015937 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbec0043f0 con 0x55d9f4e875d0 2024-09-19T09:21:26.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdbe3fff640 1 -- 172.21.15.46:0/186015937 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fdbf40f6070 con 0x55d9f4e875d0 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 10 client.25790 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 10 client.25790 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 20 client.25790 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4ea1db0 0x55d9f4ea4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 4 client.25790 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9f4dfa860 con 0x55d9f4ea1db0 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.456+0000 7fdc03fff640 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4ea1db0 0x55d9f4ea4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdc03fff640 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4ea1db0 0x55d9f4ea4220 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e13ce17cc2ff9ca9 server_cookie=2da7f462a49bbe1a in_seq=0 out_seq=0 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdbe3fff640 10 client.25790 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdbe3fff640 1 -- 172.21.15.46:0/186015937 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d9f4dfa860 con 0x55d9f4ea1db0 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdbe3fff640 10 client.25790 handle_command_reply: tid=0 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdc0cf0c740 1 client.25790 shutdown 2024-09-19T09:21:26.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 msgr2=0x55d9f4e91cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 0x55d9f4e91cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40ed730 tx=0x7fdbf4009560 comp rx=0 tx=0).stop 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.457+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 shutdown_connections 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4ea1db0 0x55d9f4ea4220 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e92370 0x55d9f4e8f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/186015937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e875d0 0x55d9f4e91cb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 >> 172.21.15.46:0/186015937 conn(0x55d9f4e50310 msgr2=0x55d9f4e89960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdbe3fff640 0 client.25790 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 shutdown_connections 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/186015937 wait complete. 2024-09-19T09:21:26.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.458+0000 7fdc0cf0c740 20 client.25790 trim_cache size 0 max 16384 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.472+0000 7fdc0cf0c740 1 Processor -- start 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.472+0000 7fdc0cf0c740 1 -- start start 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e90ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e8a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ab240 con 0x55d9f4e88b40 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ace40 con 0x55d9f4e92370 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ab910 con 0x55d9f4e875d0 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39838/0 (socket says 172.21.15.46:39838) 2024-09-19T09:21:26.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 -- 172.21.15.46:0/1446378973 learned_addr learned my addr 172.21.15.46:0/1446378973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc090d0640 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e8a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc088cf640 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e90ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 -- 172.21.15.46:0/1446378973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 msgr2=0x55d9f4e90ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e90ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 -- 172.21.15.46:0/1446378973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 msgr2=0x55d9f4e8a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e8a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 -- 172.21.15.46:0/1446378973 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f4ea4590 con 0x55d9f4e88b40 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.473+0000 7fdc03fff640 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8a120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406a2d0 tx=0x7fdbec005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f642b89554fd17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.474+0000 7fdbfa7fc640 1 -- 172.21.15.46:0/1446378973 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0053d0 con 0x55d9f4e88b40 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.474+0000 7fdbfa7fc640 1 -- 172.21.15.46:0/1446378973 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbec009d90 con 0x55d9f4e88b40 2024-09-19T09:21:26.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.474+0000 7fdbfa7fc640 1 -- 172.21.15.46:0/1446378973 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec01ab70 con 0x55d9f4e88b40 2024-09-19T09:21:26.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/1446378973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 msgr2=0x55d9f4e8a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8a120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406a2d0 tx=0x7fdbec005d30 comp rx=0 tx=0).stop 2024-09-19T09:21:26.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/1446378973 shutdown_connections 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e8a120 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e8a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/1446378973 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e90ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/1446378973 >> 172.21.15.46:0/1446378973 conn(0x55d9f4e50310 msgr2=0x55d9f4e907c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/1446378973 shutdown_connections 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/1446378973 wait complete. 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.475+0000 7fdc0cf0c740 1 -- start start 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 Processor -- start 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e9a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e9acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e95b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041ac6b0 con 0x55d9f4e88b40 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041abfe0 con 0x55d9f4e92370 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdc041a9220 con 0x55d9f4e875d0 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc0cf0c740 10 client.0 _ll_register_callbacks cb 0x7fdbf4009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e9acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e9acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39852/0 (socket says 172.21.15.46:39852) 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc03fff640 1 -- 172.21.15.46:0/2858970236 learned_addr learned my addr 172.21.15.46:0/2858970236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc090d0640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e95b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.476+0000 7fdc088cf640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e9a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc03fff640 1 -- 172.21.15.46:0/2858970236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 msgr2=0x55d9f4e9a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc03fff640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e9a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc03fff640 1 -- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 msgr2=0x55d9f4e95b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc03fff640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e95b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc03fff640 1 -- 172.21.15.46:0/2858970236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f4e96380 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc090d0640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e95b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc03fff640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e9acd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009f60 tx=0x7fdbec005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4ac0134be8f5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdbe3fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdbe3fff640 1 -- 172.21.15.46:0/2858970236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec03e060 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdbe3fff640 1 -- 172.21.15.46:0/2858970236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7fdbec01abc0 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbec009d90 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdbe3fff640 1 -- 172.21.15.46:0/2858970236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fdbec0054e0 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc0cf0c740 10 client.16287 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.477+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d9f4f0c6d0 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdbe3fff640 1 -- 172.21.15.46:0/2858970236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbec009d90 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdbe3fff640 1 -- 172.21.15.46:0/2858970236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7fdbec026610 con 0x55d9f4e88b40 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc0cf0c740 10 client.16287 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:26.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc0cf0c740 10 client.16287 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc0cf0c740 20 client.16287 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4f0cbf0 0x55d9f4f0efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc0cf0c740 4 client.16287 mds_command: new command op to 24446 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 --> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9f4df4d70 con 0x55d9f4f0cbf0 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdc088cf640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4f0cbf0 0x55d9f4f0efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.478+0000 7fdbe3fff640 10 client.16287 ms_handle_connect on v2:172.21.15.99:6836/58768930 2024-09-19T09:21:26.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.479+0000 7fdc088cf640 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4f0cbf0 0x55d9f4f0efe0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9528b5447288d7d8 server_cookie=7130fd6549d5ec31 in_seq=0 out_seq=0 2024-09-19T09:21:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.480+0000 7fdbe3fff640 1 -- 172.21.15.46:0/2858970236 <== mds.4 v2:172.21.15.99:6836/58768930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+86629 (crc 0 0 0) 0x55d9f4df4d70 con 0x55d9f4f0cbf0 2024-09-19T09:21:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.480+0000 7fdbe3fff640 10 client.16287 handle_command_reply: tid=0 2024-09-19T09:21:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.480+0000 7fdc0cf0c740 1 client.16287 shutdown 2024-09-19T09:21:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 msgr2=0x55d9f4e9acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e9acd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009f60 tx=0x7fdbec005370 comp rx=0 tx=0).stop 2024-09-19T09:21:26.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 shutdown_connections 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d9f4e88b40 0x55d9f4e9acd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:6836/58768930,v1:172.21.15.99:6837/58768930] conn(0x55d9f4f0cbf0 0x55d9f4f0efe0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdbe3fff640 0 client.16287 ms_handle_reset on v2:172.21.15.99:6836/58768930 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d9f4e92370 0x55d9f4e95b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 --2- 172.21.15.46:0/2858970236 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d9f4e875d0 0x55d9f4e9a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 >> 172.21.15.46:0/2858970236 conn(0x55d9f4e50310 msgr2=0x55d9f4e82d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 shutdown_connections 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 1 -- 172.21.15.46:0/2858970236 wait complete. 2024-09-19T09:21:26.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.481+0000 7fdc0cf0c740 20 client.16287 trim_cache size 0 max 16384 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1983547, 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631059, 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/012.out" 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 19838189, 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629536, 2024-09-19T09:21:26.486 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/005.out" 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 27736094, 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630849, 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/667.out" 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 55579749, 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631884, 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/303.out" 2024-09-19T09:21:26.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 75079669, 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631554, 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/139.out" 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 80894984, 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628669, 2024-09-19T09:21:26.488 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_writev_overlap.c" 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 99956931, 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629973, 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/221.out" 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 104799713, 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630015, 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/242.out" 2024-09-19T09:21:26.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 108094591, 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628686, 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/unwritten_mmap.c" 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 109985901, 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628533, 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/attr_replace_test.c" 2024-09-19T09:21:26.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 112950574, 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630497, 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/491.out" 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 116489588, 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629873, 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/171.out" 2024-09-19T09:21:26.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 141774585, 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629331, 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/310.out" 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 168404998, 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630273, 2024-09-19T09:21:26.492 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/379.out" 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 184470098, 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629937, 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/203.out" 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 192691359, 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628397, 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/filter" 2024-09-19T09:21:26.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 209644946, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630637, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/561.out" 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 220867639, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628536, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/bulkstat_null_ocount.c" 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.494 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 221262267, 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630161, 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/315.out" 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 222002741, 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631786, 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/254.out" 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.495 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 225177787, 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629763, 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/116.out" 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 238784638, 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628379, 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/casefold" 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.496 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 239565162, 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629149, 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/219.out" 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 271351254, 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628554, 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/dumpfile" 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.497 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 284054586, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630863, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/674.out" 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 299232895, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628557, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ext4_resize.c" 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 312857639, 2024-09-19T09:21:26.498 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630761, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/623.out" 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 318266561, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629977, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/223.out" 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 338163677, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629031, 2024-09-19T09:21:26.499 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/160.out" 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 338228844, 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630465, 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/475.out" 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 338266926, 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630451, 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/468.out" 2024-09-19T09:21:26.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 347909656, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629865, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/167.out" 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 350117864, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629275, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/282.out" 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.501 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 357315213, 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630721, 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/603.out" 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 363116514, 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630031, 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/250.out" 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.502 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 370291669, 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631026, 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/Makefile" 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 370421175, 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630331, 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/408.out" 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.503 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 383633379, 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628409, 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/perf" 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 390938337, 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628638, 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/soak_duration.awk" 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.504 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 404982829, 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630769, 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/627.out" 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 406733866, 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630965, 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/725.out" 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.505 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 409732069, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631606, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/165.out" 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 416419209, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628416, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/renameat2" 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 417352871, 2024-09-19T09:21:26.506 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628589, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/Makefile" 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 441500513, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629985, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/227.out" 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 480222235, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628576, 2024-09-19T09:21:26.507 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/genhashnames.c" 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 487654192, 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629602, 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/037.out" 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 489834051, 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630971, 2024-09-19T09:21:26.508 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/728.out" 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 493388877, 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629083, 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/186.out" 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 497743489, 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629959, 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/214.out" 2024-09-19T09:21:26.509 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 510091610, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629564, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/019.out" 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 512829905, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630453, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/469.out" 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.510 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 514621320, 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630981, 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/733.out" 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 523357984, 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628646, 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_attr_corruption.c" 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.511 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 531205742, 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631826, 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/274.out" 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 532612844, 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630397, 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/441.out" 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.512 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 539929666, 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630669, 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/577.out" 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 550271684, 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629925, 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/197.out" 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.513 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 556322172, 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630681, 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/583.out" 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 558536176, 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631822, 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/272.out" 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.514 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 561189804, 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630501, 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/493.out" 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 562389348, 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628418, 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/report" 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.515 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 590144422, 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511632004, 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/363.out" 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 595239024, 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629909, 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/189.out" 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.516 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 602007310, 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631718, 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/220.out" 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 619975474, 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628384, 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdelay" 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 621410423, 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630519, 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/502.out" 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 646771724, 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628385, 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdust" 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.518 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 663060340, 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630977, 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/731.out" 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 663301136, 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629637, 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/053.out" 2024-09-19T09:21:26.519 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 682048764, 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628406, 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/nfs" 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 685676934, 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631440, 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/082.out" 2024-09-19T09:21:26.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 688311461, 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631357, 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/041.out" 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 696305321, 2024-09-19T09:21:26.521 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630797, 2024-09-19T09:21:26.522 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:26 smithi099 ceph-mon[35256]: pgmap v432: 97 pgs: 97 active+clean; 39 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.6 MiB/s wr, 746 op/s 2024-09-19T09:21:26.522 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/641.out" 2024-09-19T09:21:26.522 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 722317105, 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630773, 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/629.out" 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 724295791, 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630249, 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/359.out" 2024-09-19T09:21:26.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 734249863, 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631399, 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/062.out" 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 734944770, 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630747, 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/616.out" 2024-09-19T09:21:26.524 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 739171275, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629590, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/032.out" 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 746866100, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628391, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dump" 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.525 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 748228988, 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629556, 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/015.out" 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 757069720, 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630245, 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/357.out" 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.526 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 758336564, 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628564, 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill.c" 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 760802624, 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630715, 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/600.out" 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.527 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 765048017, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630989, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/737.out" 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 778542999, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628593, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/replay-log.c" 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 823502865, 2024-09-19T09:21:26.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630967, 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/726.out" 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 843931402, 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628380, 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ceph" 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 856361955, 2024-09-19T09:21:26.529 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628659, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_holes.c" 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 865830011, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630489, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/487.out" 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 875919047, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630259, 2024-09-19T09:21:26.530 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/372.out" 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 882279643, 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628695, 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.c" 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 919523326, 2024-09-19T09:21:26.531 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628587, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/locktest.c" 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 931637004, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629877, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/173.out" 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 952982373, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628388, 2024-09-19T09:21:26.532 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmhugedisk" 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 990447275, 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630283, 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/384.out" 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 997351303, 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631073, 2024-09-19T09:21:26.533 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/019.out" 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1030797390, 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628693, 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.c" 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1056178712, 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629143, 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/216.out" 2024-09-19T09:21:26.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1065599427, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628823, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/056.out" 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1075423902, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629879, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/174.out" 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.535 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1086644848, 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628392, 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/encrypt" 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1086658406, 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629931, 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/200.out" 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.536 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1091637130, 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630409, 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/447.out" 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1103375133, 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630209, 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/339.out" 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.537 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1103704478, 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630815, 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/650.out" 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1123559618, 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630999, 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/742.out" 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.538 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1134527994, 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629753, 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/111.out" 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1164355864, 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628651, 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_type.c" 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.539 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1179765924, 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628420, 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/test_names" 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1181693759, 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631474, 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/099.out" 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.540 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1184353721, 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629009, 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/149.out" 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1186268215, 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630171, 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/320.out" 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.541 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1188722914, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628606, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/multi_open_unlink.c" 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1191043540, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630907, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/696.out" 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1204130103, 2024-09-19T09:21:26.542 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629580, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/027.out" 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1208468288, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630319, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/402.out" 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1208972594, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630795, 2024-09-19T09:21:26.543 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/640.out" 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1220063801, 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629823, 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/146.out" 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1225147956, 2024-09-19T09:21:26.544 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630729, 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/607.out" 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1237101106, 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630237, 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/353.out" 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.545 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1240378851, 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630855, 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/670.out" 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1249615543, 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629528, 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/001.out" 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.546 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1255961814, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629871, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/170.out" 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1262782086, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629616, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/044.out" 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1291538456, 2024-09-19T09:21:26.547 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630333, 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/409.out" 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1301634369, 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631123, 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/044.out" 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1306118241, 2024-09-19T09:21:26.548 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631045, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/005.out" 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1307884033, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631994, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/358.out" 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1308850662, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628642, 2024-09-19T09:21:26.549 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/stat_test.c" 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1317279834, 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628688, 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/uring_read_fault.c" 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1319011582, 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628855, 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/072.out" 2024-09-19T09:21:26.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1321839878, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628825, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/057.out" 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1332468305, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628422, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ubifs" 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.551 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1340201755, 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630477, 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/481.out" 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1360138572, 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630485, 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/485.out" 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.552 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1368186127, 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629907, 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/188.out" 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1370476372, 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630963, 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/724.out" 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.553 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1387307529, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628401, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/inject" 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1391832795, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630613, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/549.out" 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1402080432, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628407, 2024-09-19T09:21:26.554 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/overlay" 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1404096808, 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630887, 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/686.out" 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1416428707, 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630325, 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/405.out" 2024-09-19T09:21:26.555 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1416746839, 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631950, 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/336.out" 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1416948964, 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631367, 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/046.out" 2024-09-19T09:21:26.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1435611889, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629939, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/204.out" 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1456412189, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629685, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/077.out" 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.557 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdbf00a3240 msgr2=0x7fdbf00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdbf00a3240 0x7fdbf00a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0107d0 tx=0x7fdbfc004a40 comp rx=0 tx=0).stop 2024-09-19T09:21:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 msgr2=0x7fdc04198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 0x7fdc04198670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009230 tx=0x7fdbf4004040 comp rx=0 tx=0).stop 2024-09-19T09:21:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 shutdown_connections 2024-09-19T09:21:26.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdbf00a3240 0x7fdbf00a5700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc04103780 0x7fdc04198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc04108300 0x7fdc0419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 --2- 172.21.15.46:0/978202204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc04102dd0 0x7fdc04198670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 >> 172.21.15.46:0/978202204 conn(0x7fdc040fc7d0 msgr2=0x7fdc04105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 shutdown_connections 2024-09-19T09:21:26.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:26.483+0000 7fdc0ab33640 1 -- 172.21.15.46:0/978202204 wait complete. 2024-09-19T09:21:26.560 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.560 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1468240204, 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630737, 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/611.out" 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1469971580, 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628405, 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/module" 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.561 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1474142479, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630125, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/297.out" 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1499087472, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630843, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/664.out" 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1511832485, 2024-09-19T09:21:26.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630131, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/300.out" 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1543100628, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629633, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/051.out" 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1552074991, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628701, 2024-09-19T09:21:26.563 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.c" 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1559169606, 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631307, 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/018.out" 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1574309715, 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628386, 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmerror" 2024-09-19T09:21:26.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1574718284, 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629897, 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/183.out" 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1583069073, 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629957, 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/213.out" 2024-09-19T09:21:26.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1583180307, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628529, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/allocstale.c" 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1594131034, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630145, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/307.out" 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.566 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1599567956, 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630265, 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/375.out" 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1614448407, 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629665, 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/067.out" 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.567 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1632960615, 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628544, 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/detached_mounts_propagation.c" 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1647699225, 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629799, 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/134.out" 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.568 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1672679893, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630961, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/723.out" 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1684402052, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629831, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/150.out" 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1686155182, 2024-09-19T09:21:26.569 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628628, 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/readdir-while-renames.c" 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1700626619, 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629027, 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/158.out" 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.570 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1705745906, 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629679, 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/074.out" 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1707376115, 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630691, 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/588.out" 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.571 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1716435710, 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628699, 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.c" 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1719320476, 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630037, 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/253.out" 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.572 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1721058772, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628592, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.h" 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1722840599, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511632092, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/407.out" 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1768935222, 2024-09-19T09:21:26.573 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628376, 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/Makefile" 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1804384767, 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629775, 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/122.out" 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1817515167, 2024-09-19T09:21:26.574 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630839, 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/662.out" 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1826912121, 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631748, 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/235.out" 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1835222004, 2024-09-19T09:21:26.575 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630783, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/634.out" 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1836863931, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628531, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/append_writer.c" 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1849938364, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629769, 2024-09-19T09:21:26.576 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/119.out" 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1891957629, 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628596, 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/lstat64.c" 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1910163955, 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629643, 2024-09-19T09:21:26.577 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/056.out" 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1921860884, 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628419, 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/scsi_debug" 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1923071891, 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628696, 2024-09-19T09:21:26.578 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.h" 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1953009123, 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630269, 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/377.out" 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1955899982, 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628555, 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/e4compact.c" 2024-09-19T09:21:26.579 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1956754611, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630187, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/328.out" 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1969493373, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631630, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/177.out" 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.580 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2000956501, 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628400, 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/gcov" 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2009223975, 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630309, 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/397.out" 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.581 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2009723709, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629703, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/086.out" 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2014976651, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629608, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/040.out" 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2022033190, 2024-09-19T09:21:26.582 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628765, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/027.out" 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2023941185, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630611, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/548.out" 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2052205790, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630109, 2024-09-19T09:21:26.583 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/289.out" 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2068221099, 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631043, 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/004.out" 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2071571390, 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628381, 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/cgroup2" 2024-09-19T09:21:26.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2077345114, 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630733, 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/609.out" 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2084533883, 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628697, 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/missing.h" 2024-09-19T09:21:26.585 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2085220381, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628821, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/055.out" 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2109866677, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630353, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/419.out" 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.586 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2113687892, 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629045, 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/167.out" 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2122518499, 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631810, 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/266.out" 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.587 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2126804815, 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630947, 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/716.out" 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2152805971, 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628702, 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.h" 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.588 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2155872055, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628691, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs" 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2164488162, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630739, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/612.out" 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2231998967, 2024-09-19T09:21:26.589 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630841, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/663.out" 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2235938705, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630969, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/727.out" 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2239256749, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628389, 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmlogwrites" 2024-09-19T09:21:26.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2243973620, 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630919, 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/702.out" 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2265553640, 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511632010, 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/366.out" 2024-09-19T09:21:26.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2268006249, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631067, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/016.out" 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2293791490, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631285, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/007.out" 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.592 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2301139406, 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630481, 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/483.out" 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2309899984, 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630301, 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/393.out" 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.593 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2320338881, 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629935, 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/202.out" 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2336659578, 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628649, 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_offset.c" 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.594 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2356529969, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629765, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/117.out" 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2364572655, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630133, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/301.out" 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2373922691, 2024-09-19T09:21:26.595 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631343, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/034.out" 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2385925699, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630121, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/295.out" 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2395250002, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630339, 2024-09-19T09:21:26.596 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/412.out" 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2399788975, 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629903, 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/186.out" 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2415015983, 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630175, 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/322.out" 2024-09-19T09:21:26.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2427168867, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630785, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/635.out" 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2437297714, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631550, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/137.out" 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.598 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2442497547, 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630023, 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/246.out" 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2477389048, 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631181, 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/073.out" 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.599 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2492120688, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629568, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/021.out" 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2524580111, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629713, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/091.out" 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2559842733, 2024-09-19T09:21:26.600 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629761, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/115.out" 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2562889429, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629725, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/097.out" 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2574168154, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630909, 2024-09-19T09:21:26.601 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/697.out" 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2583027034, 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628987, 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/138.out" 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2587393327, 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630601, 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/543.out" 2024-09-19T09:21:26.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2588116803, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629653, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/061.out" 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2590342404, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629989, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/229.out" 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.603 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2621512045, 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628583, 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/holetest.c" 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2651021073, 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629267, 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/278.out" 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.604 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2657816492, 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629759, 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/114.out" 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2658489631, 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628584, 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/iopat.c" 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.605 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2663825435, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630107, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/288.out" 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2667779742, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630147, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/308.out" 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2711134032, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630911, 2024-09-19T09:21:26.606 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/698.out" 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2712458223, 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628395, 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/fail_make_request" 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2716162314, 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628590, 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/SOURCE" 2024-09-19T09:21:26.607 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2727753992, 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628897, 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/093.out" 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2734677956, 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630627, 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/556.out" 2024-09-19T09:21:26.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2736796736, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630047, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/258.out" 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2750680699, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628648, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_create_short_dirs.c" 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.609 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2766537628, 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628704, 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.h" 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2772243787, 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630105, 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/287.out" 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.610 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2778339860, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629295, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/292.out" 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2779341746, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631395, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/060.out" 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2782396524, 2024-09-19T09:21:26.611 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629705, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/087.out" 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2808476785, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628580, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/godown.c" 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2809795931, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629919, 2024-09-19T09:21:26.612 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/194.out" 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2819222284, 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630575, 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/530.out" 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2828948808, 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629825, 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/147.out" 2024-09-19T09:21:26.613 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2840504770, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630525, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/505.out" 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2843174967, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630057, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/263.out" 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.614 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2864364168, 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631814, 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/268.out" 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2880217543, 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629699, 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/084.out" 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.615 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2917004806, 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511632038, 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/380.out" 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2924575085, 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631057, 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/011.out" 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.616 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2926071852, 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630771, 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/628.out" 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2942697113, 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630629, 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/557.out" 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.617 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2947845526, 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629739, 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/104.out" 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2952930204, 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629530, 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/002.out" 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.618 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2962595167, 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630297, 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/391.out" 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2991307201, 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628656, 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_futimens.c" 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.619 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2998733845, 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631189, 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/077.out" 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3002296244, 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628415, 2024-09-19T09:21:26.620 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/reflink" 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3021482085, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629681, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/075.out" 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3029424191, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631518, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/121.out" 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.621 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3032029894, 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630379, 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/432.out" 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3038298043, 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630755, 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/620.out" 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.622 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3072529580, 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628658, 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_getcwd.c" 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3074226872, 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629927, 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/198.out" 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.623 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3088091869, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631546, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/135.out" 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3094701751, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630563, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/524.out" 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3102748301, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631345, 2024-09-19T09:21:26.624 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/035.out" 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3108055917, 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631436, 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/080.out" 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3120254084, 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631844, 2024-09-19T09:21:26.625 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/283.out" 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3129641954, 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629079, 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/184.out" 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3163403449, 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631598, 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/161.out" 2024-09-19T09:21:26.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3185077336, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631758, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/240.out" 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3198931476, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628543, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/deduperace.c" 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.627 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3218159413, 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630605, 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/545.out" 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3256864680, 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631041, 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/003.out" 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.628 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3257541485, 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630959, 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/722.out" 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3264362997, 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630307, 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/396.out" 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.629 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3265505246, 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629159, 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/224.out" 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3283304622, 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630789, 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/637.out" 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.630 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3285354893, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631243, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/117.out" 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3326050394, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630483, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/484.out" 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3332629391, 2024-09-19T09:21:26.631 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631163, 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/064.out" 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3367123445, 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629995, 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/232.out" 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3392219660, 2024-09-19T09:21:26.632 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628602, 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mkswap.c" 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3421105633, 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628621, 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/popattr.py" 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3440179750, 2024-09-19T09:21:26.633 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628404, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/metadump" 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3464532869, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630777, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/631.out" 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3469009900, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628402, 2024-09-19T09:21:26.634 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/locktest" 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3475765983, 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629661, 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/065.out" 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3485652998, 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630017, 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/243.out" 2024-09-19T09:21:26.635 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3486168358, 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630289, 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/387.out" 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3527522091, 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629813, 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/141.out" 2024-09-19T09:21:26.636 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3531317800, 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631958, 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/340.out" 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3535577167, 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628703, 2024-09-19T09:21:26.637 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.c" 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3546869363, 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629913, 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/191.out" 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3560695342, 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628591, 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.c" 2024-09-19T09:21:26.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3561457802, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631456, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/090.out" 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3566097524, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630019, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/244.out" 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.639 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3579193413, 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630051, 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/260.out" 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3612876037, 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630257, 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/371.out" 2024-09-19T09:21:26.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3637600621, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629779, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/124.out" 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3638180700, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630901, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/693.out" 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.641 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3639160923, 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631774, 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/248.out" 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3645342993, 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629949, 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/209.out" 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.642 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3655161277, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630457, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/471.out" 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3664806460, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628837, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/063.out" 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3679169902, 2024-09-19T09:21:26.643 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629631, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota" 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3696214357, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629987, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/228.out" 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3707241464, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631780, 2024-09-19T09:21:26.644 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/251.out" 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3730737836, 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630463, 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/474.out" 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3737922019, 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628662, 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_cow_memory_failure.c" 2024-09-19T09:21:26.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3741156188, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628387, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmflakey" 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3760082736, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631776, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/249.out" 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.646 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3773555599, 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631538, 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/131.out" 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3773740104, 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629689, 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/079.out" 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.647 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3786100262, 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629657, 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/063.out" 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3790297542, 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630569, 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/527.out" 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.648 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3796426126, 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631361, 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/043.out" 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3801375767, 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630437, 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/461.out" 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.649 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3803179246, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628425, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/zoned" 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3804350804, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631411, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/068.out" 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3814741785, 2024-09-19T09:21:26.650 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629945, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/207.out" 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3823797240, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628947, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/118.out" 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3828858109, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631738, 2024-09-19T09:21:26.651 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/230.out" 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3857400796, 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629941, 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/205.out" 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3858469361, 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628603, 2024-09-19T09:21:26.652 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmap-rw-fault.c" 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3873403394, 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629961, 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/215.out" 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3881489172, 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631566, 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/145.out" 2024-09-19T09:21:26.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3901560625, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628665, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_fallocate.c" 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3923688910, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629693, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/081.out" 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.654 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3942536228, 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628694, 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.h" 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3947077325, 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628632, 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/rewinddir-test.c" 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.655 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3966929318, 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631976, 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/349.out" 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3997530035, 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628664, 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_dio.c" 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.656 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4021930359, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630865, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/675.out" 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4035530804, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630725, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/605.out" 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4048063029, 2024-09-19T09:21:26.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631051, 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/008.out" 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4067277756, 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628705, 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/writemod.c" 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.658 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4071930612, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631534, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/129.out" 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4074717111, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628565, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill2.c" 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4075605839, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630585, 2024-09-19T09:21:26.659 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/535.out" 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4087399099, 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628620, 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/permname.c" 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4092389739, 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631768, 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/245.out" 2024-09-19T09:21:26.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4102593370, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629727, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/098.out" 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4112179752, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628698, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/mount-idmapped.c" 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.661 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4122013487, 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629751, 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/110.out" 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4135969111, 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629757, 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/113.out" 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.662 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4140767556, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630239, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/354.out" 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4152476035, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629867, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/168.out" 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4154575273, 2024-09-19T09:21:26.663 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628411, 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/preamble" 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4160524048, 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630695, 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/590.out" 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4165313233, 2024-09-19T09:21:26.664 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628588, 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes" 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4179296692, 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628575, 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ftrunc.c" 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4179446753, 2024-09-19T09:21:26.665 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629677, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/073.out" 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4188891051, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630803, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/644.out" 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4192904266, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630199, 2024-09-19T09:21:26.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/334.out" 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4196606126, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628605, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmapcat.c" 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4203622148, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629755, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/112.out" 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.667 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4203999690, 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630049, 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/259.out" 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4217823709, 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628700, 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.h" 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.668 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4220545250, 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630241, 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/355.out" 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4229020158, 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630487, 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/486.out" 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.669 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4229356429, 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629291, 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/290.out" 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4231743754, 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628394, 2024-09-19T09:21:26.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/f2fs" 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4239658667, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631942, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/332.out" 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4264598217, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629965, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/217.out" 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.671 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4273099177, 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628417, 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/repair" 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4273543800, 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630157, 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/313.out" 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.672 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4278994028, 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628737, 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/013.out" 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4285533103, 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628390, 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmthin" 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:26.673 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4293441296, 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630561, 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/523.out" 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:26.674 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-09-19T09:21:27.589 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:21:27.882 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:28.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:28 smithi046 ceph-mon[31203]: pgmap v433: 97 pgs: 97 active+clean; 41 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 954 op/s 2024-09-19T09:21:28.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:28 smithi115 ceph-mon[35055]: pgmap v433: 97 pgs: 97 active+clean; 41 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 954 op/s 2024-09-19T09:21:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 -- 172.21.15.46:0/3033283859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f470410c180 msgr2=0x7f470410e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 --2- 172.21.15.46:0/3033283859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f470410c180 0x7f470410e620 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f46fc009ca0 tx=0x7f46fc02a950 comp rx=0 tx=0).stop 2024-09-19T09:21:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 -- 172.21.15.46:0/3033283859 shutdown_connections 2024-09-19T09:21:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 --2- 172.21.15.46:0/3033283859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f470410c180 0x7f470410e620 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 --2- 172.21.15.46:0/3033283859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4704103670 0x7f470410bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 --2- 172.21.15.46:0/3033283859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704102d50 0x7f4704103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 -- 172.21.15.46:0/3033283859 >> 172.21.15.46:0/3033283859 conn(0x7f47040fc7d0 msgr2=0x7f47040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 -- 172.21.15.46:0/3033283859 shutdown_connections 2024-09-19T09:21:28.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.392+0000 7f470c70c640 1 -- 172.21.15.46:0/3033283859 wait complete. 2024-09-19T09:21:28.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 Processor -- start 2024-09-19T09:21:28.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 -- start start 2024-09-19T09:21:28.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 0x7f47041009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704103670 0x7f4704100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f470410c180 0x7f4704101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4704111f60 con 0x7f4704102d50 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4704111de0 con 0x7f4704103670 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470c70c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f47041120e0 con 0x7f470410c180 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470a4a8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 0x7f47041009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470a4a8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 0x7f47041009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36530/0 (socket says 172.21.15.46:36530) 2024-09-19T09:21:28.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470a4a8640 1 -- 172.21.15.46:0/3363533749 learned_addr learned my addr 172.21.15.46:0/3363533749 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704103670 0x7f4704100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.393+0000 7f470aca9640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f470410c180 0x7f4704101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470a4a8640 1 -- 172.21.15.46:0/3363533749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f470410c180 msgr2=0x7f4704101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f470410c180 0x7f4704101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470a4a8640 1 -- 172.21.15.46:0/3363533749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704103670 msgr2=0x7f4704100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704103670 0x7f4704100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470a4a8640 1 -- 172.21.15.46:0/3363533749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47041a6900 con 0x7f4704102d50 2024-09-19T09:21:28.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470aca9640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f470410c180 0x7f4704101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:28.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704103670 0x7f4704100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:28.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 0x7f47041009b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f470000ea60 tx=0x7f470000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f46fb7fe640 1 -- 172.21.15.46:0/3363533749 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470000cde0 con 0x7f4704102d50 2024-09-19T09:21:28.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47041a6bf0 con 0x7f4704102d50 2024-09-19T09:21:28.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f46fb7fe640 1 -- 172.21.15.46:0/3363533749 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47000035f0 con 0x7f4704102d50 2024-09-19T09:21:28.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f46fb7fe640 1 -- 172.21.15.46:0/3363533749 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4700010670 con 0x7f4704102d50 2024-09-19T09:21:28.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.394+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47041a7180 con 0x7f4704102d50 2024-09-19T09:21:28.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.397+0000 7f46fb7fe640 1 -- 172.21.15.46:0/3363533749 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f47000037a0 con 0x7f4704102d50 2024-09-19T09:21:28.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.397+0000 7f470eae5740 1 Processor -- start 2024-09-19T09:21:28.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 -- start start 2024-09-19T09:21:28.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27579090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27579a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf2758ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55bf274df2f0 con 0x55bf2757ab40 2024-09-19T09:21:28.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55bf27486cf0 con 0x55bf2758cb80 2024-09-19T09:21:28.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470eae5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55bf274db2b0 con 0x55bf275795d0 2024-09-19T09:21:28.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470aca9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27579090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470aca9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27579090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36546/0 (socket says 172.21.15.46:36546) 2024-09-19T09:21:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470aca9640 1 -- 172.21.15.46:0/2423474177 learned_addr learned my addr 172.21.15.46:0/2423474177 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf2758ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.398+0000 7f470a4a8640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27579a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f46fb7fe640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46f00a3240 0x7f46f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f4709ca7640 1 -- 172.21.15.46:0/2423474177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 msgr2=0x55bf27579a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27579a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f4709ca7640 1 -- 172.21.15.46:0/2423474177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 msgr2=0x55bf27579090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27579090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f4709ca7640 1 -- 172.21.15.46:0/2423474177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2746b3a0 con 0x55bf2758cb80 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f470aca9640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27579090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f470a4a8640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27579a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f46fb7fe640 1 -- 172.21.15.46:0/3363533749 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f47000cfc40 con 0x7f4704102d50 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f470aca9640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46f00a3240 0x7f46f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf2758ef70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009f70 tx=0x7f46f40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7620c5f2eaf3b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f46f8ff9640 1 -- 172.21.15.46:0/2423474177 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40042f0 con 0x55bf2758cb80 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f46f8ff9640 1 -- 172.21.15.46:0/2423474177 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f4004490 con 0x55bf2758cb80 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.399+0000 7f46f8ff9640 1 -- 172.21.15.46:0/2423474177 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40035f0 con 0x55bf2758cb80 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 -- 172.21.15.46:0/2423474177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 msgr2=0x55bf2758ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470aca9640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46f00a3240 0x7f46f00a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f46fc006010 tx=0x7f46fc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf2758ef70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009f70 tx=0x7f46f40118d0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 -- 172.21.15.46:0/2423474177 shutdown_connections 2024-09-19T09:21:28.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf2758ef70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27579a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 --2- 172.21.15.46:0/2423474177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27579090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 -- 172.21.15.46:0/2423474177 >> 172.21.15.46:0/2423474177 conn(0x55bf27542310 msgr2=0x55bf27575c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 -- 172.21.15.46:0/2423474177 shutdown_connections 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.400+0000 7f470eae5740 1 -- 172.21.15.46:0/2423474177 wait complete. 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 -- start start 2024-09-19T09:21:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 Processor -- start 2024-09-19T09:21:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf2758c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 0x55bf27589760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2758cb80 0x55bf27589ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55bf2758f880 con 0x55bf2758cb80 2024-09-19T09:21:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55bf2749a060 con 0x55bf2757ab40 2024-09-19T09:21:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55bf2758fa00 con 0x55bf275795d0 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470eae5740 10 client.0 _ll_register_callbacks cb 0x55bf271ed8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f4709ca7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 0x55bf27589760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470aca9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2758cb80 0x55bf27589ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f4709ca7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 0x55bf27589760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52238/0 (socket says 172.21.15.46:52238) 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f4709ca7640 1 -- 172.21.15.46:0/3482614403 learned_addr learned my addr 172.21.15.46:0/3482614403 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.401+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf2758c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f4709ca7640 1 -- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 msgr2=0x55bf2758c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf2758c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f4709ca7640 1 -- 172.21.15.46:0/3482614403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2758cb80 msgr2=0x55bf27589ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2758cb80 0x55bf27589ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f4709ca7640 1 -- 172.21.15.46:0/3482614403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf272503c0 con 0x55bf2757ab40 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 0x55bf27589760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46f4004970 tx=0x7f46f40049a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a2ad7793ccb220 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f46edffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f46edffb640 1 -- 172.21.15.46:0/3482614403 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4028020 con 0x55bf2757ab40 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f4004490 con 0x55bf2757ab40 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f46edffb640 1 -- 172.21.15.46:0/3482614403 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f46f4003b00 con 0x55bf2757ab40 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f46edffb640 1 -- 172.21.15.46:0/3482614403 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f46f4003d00 con 0x55bf2757ab40 2024-09-19T09:21:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f470eae5740 10 client.25808 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.402+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bf2759b240 con 0x55bf2757ab40 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f46edffb640 1 -- 172.21.15.46:0/3482614403 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f4004490 con 0x55bf2757ab40 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f46edffb640 1 -- 172.21.15.46:0/3482614403 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f46f4018070 con 0x55bf2757ab40 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470eae5740 10 client.25808 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470eae5740 10 client.25808 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470eae5740 20 client.25808 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470eae5740 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf2759c5f0 0x55bf2759e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470eae5740 4 client.25808 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf274ec860 con 0x55bf2759c5f0 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.403+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf2759c5f0 0x55bf2759e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.404+0000 7f46edffb640 10 client.25808 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.404+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf2759c5f0 0x55bf2759e9e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=557e251dc37672f7 server_cookie=d6e7fed4d67a1580 in_seq=0 out_seq=0 2024-09-19T09:21:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f46edffb640 1 -- 172.21.15.46:0/3482614403 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf274ec860 con 0x55bf2759c5f0 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f46edffb640 10 client.25808 handle_command_reply: tid=0 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 client.25808 shutdown 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 msgr2=0x55bf27589760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 0x55bf27589760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46f4004970 tx=0x7f46f40049a0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 shutdown_connections 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf2759c5f0 0x55bf2759e9e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2758cb80 0x55bf27589ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2757ab40 0x55bf27589760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 --2- 172.21.15.46:0/3482614403 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf2758c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f46edffb640 0 client.25808 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 >> 172.21.15.46:0/3482614403 conn(0x55bf27542310 msgr2=0x55bf2757b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 shutdown_connections 2024-09-19T09:21:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 1 -- 172.21.15.46:0/3482614403 wait complete. 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.405+0000 7f470eae5740 20 client.25808 trim_cache size 0 max 16384 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 Processor -- start 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 -- start start 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27575e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27598b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf275a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f47041ab310 con 0x55bf2757ab40 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47041acf10 con 0x55bf2758cb80 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f470eae5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f47041ab9e0 con 0x55bf275795d0 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.421+0000 7f4709ca7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27598b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27598b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36562/0 (socket says 172.21.15.46:36562) 2024-09-19T09:21:28.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 -- 172.21.15.46:0/2005460201 learned_addr learned my addr 172.21.15.46:0/2005460201 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f470a4a8640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27575e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f470aca9640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf275a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 -- 172.21.15.46:0/2005460201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 msgr2=0x55bf27575e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27575e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 -- 172.21.15.46:0/2005460201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 msgr2=0x55bf275a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf275a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 -- 172.21.15.46:0/2005460201 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf27587cb0 con 0x55bf2757ab40 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f470a4a8640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27575e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f470aca9640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf275a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f4709ca7640 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27598b80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009f70 tx=0x7f46f4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42ba4c889f3952b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f46effff640 1 -- 172.21.15.46:0/2005460201 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4028040 con 0x55bf2757ab40 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f46effff640 1 -- 172.21.15.46:0/2005460201 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f401f040 con 0x55bf2757ab40 2024-09-19T09:21:28.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.422+0000 7f46effff640 1 -- 172.21.15.46:0/2005460201 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4003b60 con 0x55bf2757ab40 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 -- 172.21.15.46:0/2005460201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 msgr2=0x55bf27598b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27598b80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009f70 tx=0x7f46f4005f10 comp rx=0 tx=0).stop 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 -- 172.21.15.46:0/2005460201 shutdown_connections 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf27598b80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf2758cb80 0x55bf275a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 --2- 172.21.15.46:0/2005460201 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf275795d0 0x55bf27575e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 -- 172.21.15.46:0/2005460201 >> 172.21.15.46:0/2005460201 conn(0x55bf27542310 msgr2=0x55bf27575700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 -- 172.21.15.46:0/2005460201 shutdown_connections 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.423+0000 7f470eae5740 1 -- 172.21.15.46:0/2005460201 wait complete. 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 -- start start 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 Processor -- start 2024-09-19T09:21:28.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf275795d0 0x55bf27595240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf275862e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf2758cb80 0x55bf27586820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f47041ac780 con 0x55bf2757ab40 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47041ac0b0 con 0x55bf275795d0 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f47041a92f0 con 0x55bf2758cb80 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470eae5740 10 client.0 _ll_register_callbacks cb 0x7f4700005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f4709ca7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf275862e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f4709ca7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf275862e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36570/0 (socket says 172.21.15.46:36570) 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f4709ca7640 1 -- 172.21.15.46:0/3848911673 learned_addr learned my addr 172.21.15.46:0/3848911673 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf275795d0 0x55bf27595240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.424+0000 7f470aca9640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf2758cb80 0x55bf27586820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f4709ca7640 1 -- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf2758cb80 msgr2=0x55bf27586820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf2758cb80 0x55bf27586820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f4709ca7640 1 -- 172.21.15.46:0/3848911673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf275795d0 msgr2=0x55bf27595240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf275795d0 0x55bf27595240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f4709ca7640 1 -- 172.21.15.46:0/3848911673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf27586e60 con 0x55bf2757ab40 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf275795d0 0x55bf27595240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f4709ca7640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf275862e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f46f4013040 tx=0x7f46f4003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae34ccec602301bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f46edffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f46edffb640 1 -- 172.21.15.46:0/3848911673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4028070 con 0x55bf2757ab40 2024-09-19T09:21:28.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f46edffb640 1 -- 172.21.15.46:0/3848911673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f46f4003900 con 0x55bf2757ab40 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f401f040 con 0x55bf2757ab40 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.425+0000 7f46edffb640 1 -- 172.21.15.46:0/3848911673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f46f4003b20 con 0x55bf2757ab40 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 10 client.16305 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bf27606f70 con 0x55bf2757ab40 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f46edffb640 1 -- 172.21.15.46:0/3848911673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46f401f040 con 0x55bf2757ab40 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f46edffb640 1 -- 172.21.15.46:0/3848911673 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f46f4040030 con 0x55bf2757ab40 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 10 client.16305 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 10 client.16305 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 20 client.16305 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf27607600 0x55bf27609a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 4 client.16305 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 --> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf274e6d70 con 0x55bf27607600 2024-09-19T09:21:28.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.426+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf27607600 0x55bf27609a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f46edffb640 10 client.16305 ms_handle_connect on v2:172.21.15.115:6834/3610194671 2024-09-19T09:21:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470a4a8640 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf27607600 0x55bf27609a20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a7a26d2412cfb18c server_cookie=da19dfca4902c03e in_seq=0 out_seq=0 2024-09-19T09:21:28.522 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:21:28.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f46edffb640 1 -- 172.21.15.46:0/3848911673 <== mds.3 v2:172.21.15.115:6834/3610194671 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf274e6d70 con 0x55bf27607600 2024-09-19T09:21:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f46edffb640 10 client.16305 handle_command_reply: tid=0 2024-09-19T09:21:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 client.16305 shutdown 2024-09-19T09:21:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 msgr2=0x55bf275862e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf275862e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f46f4013040 tx=0x7f46f4003ea0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 shutdown_connections 2024-09-19T09:21:28.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:6834/3610194671,v1:172.21.15.115:6835/3610194671] conn(0x55bf27607600 0x55bf27609a20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55bf2757ab40 0x55bf275862e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55bf2758cb80 0x55bf27586820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 --2- 172.21.15.46:0/3848911673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf275795d0 0x55bf27595240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 >> 172.21.15.46:0/3848911673 conn(0x55bf27542310 msgr2=0x55bf275744e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f46edffb640 0 client.16305 ms_handle_reset on v2:172.21.15.115:6834/3610194671 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 shutdown_connections 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 1 -- 172.21.15.46:0/3848911673 wait complete. 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.427+0000 7f470eae5740 20 client.16305 trim_cache size 0 max 16384 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46f00a3240 msgr2=0x7f46f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46f00a3240 0x7f46f00a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f46fc006010 tx=0x7f46fc0095c0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 msgr2=0x7f47041009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 0x7f47041009b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f470000ea60 tx=0x7f470000ef20 comp rx=0 tx=0).stop 2024-09-19T09:21:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 shutdown_connections 2024-09-19T09:21:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46f00a3240 0x7f46f00a5700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f470410c180 0x7f4704101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4704103670 0x7f4704100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 --2- 172.21.15.46:0/3363533749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4704102d50 0x7f47041009b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 >> 172.21.15.46:0/3363533749 conn(0x7f47040fc7d0 msgr2=0x7f47040fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 shutdown_connections 2024-09-19T09:21:28.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:28.428+0000 7f470c70c640 1 -- 172.21.15.46:0/3363533749 wait complete. 2024-09-19T09:21:28.528 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:28 smithi099 ceph-mon[35256]: pgmap v433: 97 pgs: 97 active+clean; 41 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.1 MiB/s wr, 954 op/s 2024-09-19T09:21:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 -- 172.21.15.46:0/3968455508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 msgr2=0x7f58b0108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 --2- 172.21.15.46:0/3968455508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b0108e90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009ca0 tx=0x7f58a802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 -- 172.21.15.46:0/3968455508 shutdown_connections 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 --2- 172.21.15.46:0/3968455508 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b0108e90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 --2- 172.21.15.46:0/3968455508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 0x7f58b01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 --2- 172.21.15.46:0/3968455508 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 -- 172.21.15.46:0/3968455508 >> 172.21.15.46:0/3968455508 conn(0x7f58b00fc1b0 msgr2=0x7f58b00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 -- 172.21.15.46:0/3968455508 shutdown_connections 2024-09-19T09:21:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.732+0000 7f58b6552640 1 -- 172.21.15.46:0/3968455508 wait complete. 2024-09-19T09:21:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.733+0000 7f58b6552640 1 Processor -- start 2024-09-19T09:21:28.735 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.733+0000 7f58b6552640 1 -- start start 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.733+0000 7f58b6552640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b6552640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 0x7f58b0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b6552640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b6552640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f58b010c6b0 con 0x7f58b0102600 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b6552640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f58b010c530 con 0x7f58b0101c40 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b6552640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f58b010c830 con 0x7f58b0100a50 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.737 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b4aef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b4aef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b019f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36582/0 (socket says 172.21.15.46:36582) 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:39474/0 (socket says 172.21.15.46:39474) 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58b4aef640 1 -- 172.21.15.46:0/3686312402 learned_addr learned my addr 172.21.15.46:0/3686312402 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58af7fe640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 0x7f58b0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 -- 172.21.15.46:0/3686312402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 msgr2=0x7f58b0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 0x7f58b0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 -- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 msgr2=0x7f58b019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b019f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 -- 172.21.15.46:0/3686312402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b019f9f0 con 0x7f58b0100a50 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58af7fe640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 0x7f58b0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.734+0000 7f58affff640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0197dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9c0 tx=0x7f58a000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.735+0000 7f58ad7fa640 1 -- 172.21.15.46:0/3686312402 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a000cd80 con 0x7f58b0100a50 2024-09-19T09:21:28.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.735+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b019fce0 con 0x7f58b0100a50 2024-09-19T09:21:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.735+0000 7f58ad7fa640 1 -- 172.21.15.46:0/3686312402 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a0010910 con 0x7f58b0100a50 2024-09-19T09:21:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.735+0000 7f58ad7fa640 1 -- 172.21.15.46:0/3686312402 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0018980 con 0x7f58b0100a50 2024-09-19T09:21:28.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.735+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b01a0180 con 0x7f58b0100a50 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.738+0000 7f58ad7fa640 1 -- 172.21.15.46:0/3686312402 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f58a001f020 con 0x7f58b0100a50 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.738+0000 7f58b93cb740 1 Processor -- start 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.738+0000 7f58b93cb740 1 -- start start 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58ad7fa640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f58980a32f0 0x7f58980a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b20da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b25da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.745 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b4aef640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f58980a32f0 0x7f58980a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b20da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b20da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52288/0 (socket says 172.21.15.46:52288) 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58ad7fa640 1 -- 172.21.15.46:0/3686312402 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f58a00cf8b0 con 0x7f58b0100a50 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b28830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 -- 172.21.15.46:0/1120121817 learned_addr learned my addr 172.21.15.46:0/1120121817 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55eb96a842f0 con 0x55eb96b26370 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55eb96a2c270 con 0x55eb96b209a0 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eb96a802b0 con 0x55eb96b212e0 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58af7fe640 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b25da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 -- 172.21.15.46:0/1120121817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 msgr2=0x55eb96b25da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b25da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.746 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 -- 172.21.15.46:0/1120121817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 msgr2=0x55eb96b28830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b28830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58affff640 1 -- 172.21.15.46:0/1120121817 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb96a2b340 con 0x55eb96b209a0 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.739+0000 7f58af7fe640 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b25da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.740+0000 7f58b4aef640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f58980a32f0 0x7f58980a57b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f58a8004af0 tx=0x7f58a8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.740+0000 7f58affff640 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b20da0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f58a00a4640 tx=0x7f58a0018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa8b39b68acca09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.740+0000 7f58967fc640 1 -- 172.21.15.46:0/1120121817 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a009bf00 con 0x55eb96b209a0 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.740+0000 7f58967fc640 1 -- 172.21.15.46:0/1120121817 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a005be50 con 0x55eb96b209a0 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.740+0000 7f58967fc640 1 -- 172.21.15.46:0/1120121817 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0010430 con 0x55eb96b209a0 2024-09-19T09:21:28.747 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 msgr2=0x55eb96b20da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b20da0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f58a00a4640 tx=0x7f58a0018420 comp rx=0 tx=0).stop 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 shutdown_connections 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b28830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b25da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1120121817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b20da0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 >> 172.21.15.46:0/1120121817 conn(0x55eb96b1c010 msgr2=0x55eb96b1c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 shutdown_connections 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 -- 172.21.15.46:0/1120121817 wait complete. 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 -- start start 2024-09-19T09:21:28.748 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.741+0000 7f58b93cb740 1 Processor -- start 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b2b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b32180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55eb96b292e0 con 0x55eb96b26370 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55eb96a0d290 con 0x55eb96b209a0 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55eb96b29460 con 0x55eb96b212e0 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52296/0 (socket says 172.21.15.46:52296) 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 -- 172.21.15.46:0/1929168567 learned_addr learned my addr 172.21.15.46:0/1929168567 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58af7fe640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b2b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b93cb740 10 client.0 _ll_register_callbacks cb 0x55eb96a3e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:28.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58b4aef640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b32180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 -- 172.21.15.46:0/1929168567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 msgr2=0x55eb96b2b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b2b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 -- 172.21.15.46:0/1929168567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 msgr2=0x55eb96b32180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b32180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 -- 172.21.15.46:0/1929168567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb96797210 con 0x55eb96b209a0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.742+0000 7f58affff640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2ac00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58a00cd430 tx=0x7f58a009bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44bca348661657ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f588f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f588f7fe640 1 -- 172.21.15.46:0/1929168567 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a02b0 con 0x55eb96b209a0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f588f7fe640 1 -- 172.21.15.46:0/1929168567 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f58a00b40c0 con 0x55eb96b209a0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a005be50 con 0x55eb96b209a0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f588f7fe640 1 -- 172.21.15.46:0/1929168567 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f58a0010ac0 con 0x55eb96b209a0 2024-09-19T09:21:28.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f58b93cb740 10 client.25826 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55eb96863620 con 0x55eb96b209a0 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f588f7fe640 1 -- 172.21.15.46:0/1929168567 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a0010c60 con 0x55eb96b209a0 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f588f7fe640 1 -- 172.21.15.46:0/1929168567 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f58a009b350 con 0x55eb96b209a0 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f58b93cb740 10 client.25826 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.743+0000 7f58b93cb740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f58b93cb740 20 client.25826 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96b36460 0x55eb96b38870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f58b93cb740 4 client.25826 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:28.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f58a005be50 con 0x55eb96b36460 2024-09-19T09:21:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f58af7fe640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96b36460 0x55eb96b38870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f588f7fe640 10 client.25826 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:28.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.744+0000 7f58af7fe640 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96b36460 0x55eb96b38870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ccf3c3cdfbaffd6 server_cookie=d91826889cb6adc7 in_seq=0 out_seq=0 2024-09-19T09:21:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.745+0000 7f588f7fe640 1 -- 172.21.15.46:0/1929168567 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f58a005be50 con 0x55eb96b36460 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.745+0000 7f588f7fe640 10 client.25826 handle_command_reply: tid=0 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.745+0000 7f58b93cb740 1 client.25826 shutdown 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.745+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 msgr2=0x55eb96b2ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.745+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2ac00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f58a00cd430 tx=0x7f58a009bf00 comp rx=0 tx=0).stop 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 shutdown_connections 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96b36460 0x55eb96b38870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b26370 0x55eb96b32180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b2b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 --2- 172.21.15.46:0/1929168567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2ac00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 >> 172.21.15.46:0/1929168567 conn(0x55eb96b1c010 msgr2=0x55eb96b1d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f588f7fe640 0 client.25826 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 shutdown_connections 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 1 -- 172.21.15.46:0/1929168567 wait complete. 2024-09-19T09:21:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.746+0000 7f58b93cb740 20 client.25826 trim_cache size 0 max 16384 2024-09-19T09:21:28.772 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 Processor -- start 2024-09-19T09:21:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 -- start start 2024-09-19T09:21:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b209a0 0x55eb96b1a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b26370 0x55eb96b1aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a8f10 con 0x55eb96b209a0 2024-09-19T09:21:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01aab10 con 0x55eb96b26370 2024-09-19T09:21:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b93cb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a95e0 con 0x55eb96b212e0 2024-09-19T09:21:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58affff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b209a0 0x55eb96b1a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58b4aef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b26370 0x55eb96b1aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58affff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b209a0 0x55eb96b1a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36608/0 (socket says 172.21.15.46:36608) 2024-09-19T09:21:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58affff640 1 -- 172.21.15.46:0/2845216126 learned_addr learned my addr 172.21.15.46:0/2845216126 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.762+0000 7f58af7fe640 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f58b4aef640 1 -- 172.21.15.46:0/2845216126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 msgr2=0x55eb96b320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f58b4aef640 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f58b4aef640 1 -- 172.21.15.46:0/2845216126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b209a0 msgr2=0x55eb96b1a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f58b4aef640 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b209a0 0x55eb96b1a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f58b4aef640 1 -- 172.21.15.46:0/2845216126 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb96b1be30 con 0x55eb96b26370 2024-09-19T09:21:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f58b4aef640 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b26370 0x55eb96b1aee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58a802f540 tx=0x7f58a8041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=413f4fd1c2269095 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f5895ffb640 1 -- 172.21.15.46:0/2845216126 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8052070 con 0x55eb96b26370 2024-09-19T09:21:28.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f5895ffb640 1 -- 172.21.15.46:0/2845216126 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a8036040 con 0x55eb96b26370 2024-09-19T09:21:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.763+0000 7f5895ffb640 1 -- 172.21.15.46:0/2845216126 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8004770 con 0x55eb96b26370 2024-09-19T09:21:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 -- 172.21.15.46:0/2845216126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b26370 msgr2=0x55eb96b1aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b26370 0x55eb96b1aee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f58a802f540 tx=0x7f58a8041000 comp rx=0 tx=0).stop 2024-09-19T09:21:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 -- 172.21.15.46:0/2845216126 shutdown_connections 2024-09-19T09:21:28.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b26370 0x55eb96b1aee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b212e0 0x55eb96b320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2845216126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b209a0 0x55eb96b1a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 -- 172.21.15.46:0/2845216126 >> 172.21.15.46:0/2845216126 conn(0x55eb96b1c010 msgr2=0x55eb96b2abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 -- 172.21.15.46:0/2845216126 shutdown_connections 2024-09-19T09:21:28.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 -- 172.21.15.46:0/2845216126 wait complete. 2024-09-19T09:21:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.764+0000 7f58b93cb740 1 -- start start 2024-09-19T09:21:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 Processor -- start 2024-09-19T09:21:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b212e0 0x55eb96b2fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b26370 0x55eb96b30a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01aa380 con 0x55eb96b212e0 2024-09-19T09:21:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a9cb0 con 0x55eb96b209a0 2024-09-19T09:21:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f58b01a6ef0 con 0x55eb96b26370 2024-09-19T09:21:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b93cb740 10 client.0 _ll_register_callbacks cb 0x7f58a009bcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:28.780 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52318/0 (socket says 172.21.15.46:52318) 2024-09-19T09:21:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58affff640 1 -- 172.21.15.46:0/2816418375 learned_addr learned my addr 172.21.15.46:0/2816418375 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58af7fe640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b212e0 0x55eb96b2fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.765+0000 7f58b4aef640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b26370 0x55eb96b30a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58affff640 1 -- 172.21.15.46:0/2816418375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b26370 msgr2=0x55eb96b30a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.781 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58affff640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b26370 0x55eb96b30a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58affff640 1 -- 172.21.15.46:0/2816418375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b212e0 msgr2=0x55eb96b2fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58affff640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b212e0 0x55eb96b2fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58affff640 1 -- 172.21.15.46:0/2816418375 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb96b31020 con 0x55eb96b209a0 2024-09-19T09:21:28.782 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58affff640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2f510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58a000c6a0 tx=0x7f58a0018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e948a78c1cc0d3e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f588f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f588f7fe640 1 -- 172.21.15.46:0/2816418375 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a009a2e0 con 0x55eb96b209a0 2024-09-19T09:21:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f588f7fe640 1 -- 172.21.15.46:0/2816418375 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8182+0+0 (secure 0 0 0) 0x7f58a00a46e0 con 0x55eb96b209a0 2024-09-19T09:21:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58a8036040 con 0x55eb96b209a0 2024-09-19T09:21:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f588f7fe640 1 -- 172.21.15.46:0/2816418375 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f58a009b550 con 0x55eb96b209a0 2024-09-19T09:21:28.783 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58b93cb740 10 client.25832 fetch_fsmap learned FSMap version 35 2024-09-19T09:21:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.766+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55eb96b32330 con 0x55eb96b209a0 2024-09-19T09:21:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f588f7fe640 1 -- 172.21.15.46:0/2816418375 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58a8036040 con 0x55eb96b209a0 2024-09-19T09:21:28.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f588f7fe640 1 -- 172.21.15.46:0/2816418375 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 35) ==== 8378+0+0 (secure 0 0 0) 0x7f58a007ab30 con 0x55eb96b209a0 2024-09-19T09:21:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58b93cb740 10 client.25832 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:21:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58b93cb740 10 client.25832 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:28.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58b93cb740 20 client.25832 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96ba1730 0x55eb96ba3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58b93cb740 4 client.25832 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb96a91a20 con 0x55eb96ba1730 2024-09-19T09:21:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58af7fe640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96ba1730 0x55eb96ba3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f588f7fe640 10 client.25832 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:28.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.767+0000 7f58af7fe640 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96ba1730 0x55eb96ba3b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a5b38362c5a989 server_cookie=72ebb8f5d7cb173c in_seq=0 out_seq=0 2024-09-19T09:21:28.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f588f7fe640 1 -- 172.21.15.46:0/2816418375 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb96a91a20 con 0x55eb96ba1730 2024-09-19T09:21:28.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f588f7fe640 10 client.25832 handle_command_reply: tid=0 2024-09-19T09:21:28.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 client.25832 shutdown 2024-09-19T09:21:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 msgr2=0x55eb96b2f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2f510 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f58a000c6a0 tx=0x7f58a0018420 comp rx=0 tx=0).stop 2024-09-19T09:21:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 shutdown_connections 2024-09-19T09:21:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55eb96ba1730 0x55eb96ba3b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55eb96b212e0 0x55eb96b2fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55eb96b26370 0x55eb96b30a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 --2- 172.21.15.46:0/2816418375 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb96b209a0 0x55eb96b2f510 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 >> 172.21.15.46:0/2816418375 conn(0x55eb96b1c010 msgr2=0x55eb96b1cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f588f7fe640 0 client.25832 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 shutdown_connections 2024-09-19T09:21:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 1 -- 172.21.15.46:0/2816418375 wait complete. 2024-09-19T09:21:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.781+0000 7f58b93cb740 20 client.25832 trim_cache size 0 max 16384 2024-09-19T09:21:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:21:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:21:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:21:28.793 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f58980a32f0 msgr2=0x7f58980a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f58980a32f0 0x7f58980a57b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f58a8004af0 tx=0x7f58a8004a40 comp rx=0 tx=0).stop 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 msgr2=0x7f58b0197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0197dd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9c0 tx=0x7f58a000ee80 comp rx=0 tx=0).stop 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 shutdown_connections 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f58980a32f0 0x7f58980a57b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f58b0102600 0x7f58b019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58b0101c40 0x7f58b0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 --2- 172.21.15.46:0/3686312402 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58b0100a50 0x7f58b0197dd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 >> 172.21.15.46:0/3686312402 conn(0x7f58b00fc1b0 msgr2=0x7f58b00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 shutdown_connections 2024-09-19T09:21:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:28.782+0000 7f58b6552640 1 -- 172.21.15.46:0/3686312402 wait complete. 2024-09-19T09:21:29.124 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:21:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: ignoring --setuser ceph since I am not root 2024-09-19T09:21:29.124 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:21:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: ignoring --setgroup ceph since I am not root 2024-09-19T09:21:29.124 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:21:28 smithi099 ceph-mds[64424]: -- 172.21.15.99:0/2395450368 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56007f3b1860 con 0x56007f38f400 2024-09-19T09:21:29.124 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:21:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: starting mds.e at 2024-09-19T09:21:29.220 INFO:tasks.workunit.client.0.smithi046.stdout:30000 trunc from 0x7bb2f to 0xcdf83 2024-09-19T09:21:29.302 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:29 smithi046 ceph-mon[31203]: daemon mds.e restarted 2024-09-19T09:21:29.336 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:21:29.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:29 smithi115 ceph-mon[35055]: daemon mds.e restarted 2024-09-19T09:21:29.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:29 smithi099 ceph-mon[35256]: daemon mds.e restarted 2024-09-19T09:21:29.607 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xffcdd 2024-09-19T09:21:29.631 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:30.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:30 smithi115 ceph-mon[35055]: pgmap v434: 97 pgs: 97 active+clean; 41 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 617 op/s 2024-09-19T09:21:30.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:30 smithi115 ceph-mon[35055]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:21:30.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:30 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6834/4168570416,v1:172.21.15.99:6835/4168570416] up:boot 2024-09-19T09:21:30.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:30 smithi115 ceph-mon[35055]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:21:30.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:30 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:21:30.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:30 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:21:30.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:30 smithi046 ceph-mon[31203]: pgmap v434: 97 pgs: 97 active+clean; 41 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 617 op/s 2024-09-19T09:21:30.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:30 smithi046 ceph-mon[31203]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:21:30.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:30 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6834/4168570416,v1:172.21.15.99:6835/4168570416] up:boot 2024-09-19T09:21:30.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:30 smithi046 ceph-mon[31203]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:21:30.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:30 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:21:30.482 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:30 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:21:30.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:30 smithi099 ceph-mon[35256]: pgmap v434: 97 pgs: 97 active+clean; 41 MiB data, 686 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.8 MiB/s wr, 617 op/s 2024-09-19T09:21:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:30 smithi099 ceph-mon[35256]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:21:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:30 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6834/4168570416,v1:172.21.15.99:6835/4168570416] up:boot 2024-09-19T09:21:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:30 smithi099 ceph-mon[35256]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:21:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:30 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:21:30.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:30 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:21:30.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 -- 172.21.15.46:0/9904280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 msgr2=0x7f21b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 --2- 172.21.15.46:0/9904280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0101200 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009900 tx=0x7f21ac02a480 comp rx=0 tx=0).stop 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 -- 172.21.15.46:0/9904280 shutdown_connections 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 --2- 172.21.15.46:0/9904280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21b0102ef0 0x7f21b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 --2- 172.21.15.46:0/9904280 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21b0102570 0x7f21b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 --2- 172.21.15.46:0/9904280 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0101200 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 -- 172.21.15.46:0/9904280 >> 172.21.15.46:0/9904280 conn(0x7f21b00fc7d0 msgr2=0x7f21b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 -- 172.21.15.46:0/9904280 shutdown_connections 2024-09-19T09:21:30.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.668+0000 7f21b783b640 1 -- 172.21.15.46:0/9904280 wait complete. 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.669+0000 7f21b783b640 1 Processor -- start 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.669+0000 7f21b783b640 1 -- start start 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b783b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b783b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21b0102570 0x7f21b0199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b783b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21b0102ef0 0x7f21b01a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b783b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0110f80 con 0x7f21b0100e20 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b783b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0110e00 con 0x7f21b0102ef0 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b783b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f21b0111100 con 0x7f21b0102570 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36626/0 (socket says 172.21.15.46:36626) 2024-09-19T09:21:30.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 -- 172.21.15.46:0/2414752166 learned_addr learned my addr 172.21.15.46:0/2414752166 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21b0102ef0 0x7f21b01a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21b0102570 0x7f21b0199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 -- 172.21.15.46:0/2414752166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21b0102570 msgr2=0x7f21b0199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21b0102570 0x7f21b0199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 -- 172.21.15.46:0/2414752166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21b0102ef0 msgr2=0x7f21b01a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21b0102ef0 0x7f21b01a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 -- 172.21.15.46:0/2414752166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21b01a4910 con 0x7f21b0100e20 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.670+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0199350 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006010 tx=0x7f21ac003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.671+0000 7f21a67fc640 1 -- 172.21.15.46:0/2414752166 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac03f070 con 0x7f21b0100e20 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.671+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21b01a4ae0 con 0x7f21b0100e20 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.671+0000 7f21a67fc640 1 -- 172.21.15.46:0/2414752166 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21ac031c30 con 0x7f21b0100e20 2024-09-19T09:21:30.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.671+0000 7f21a67fc640 1 -- 172.21.15.46:0/2414752166 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac035030 con 0x7f21b0100e20 2024-09-19T09:21:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.671+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21b01a4f90 con 0x7f21b0100e20 2024-09-19T09:21:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21a67fc640 1 -- 172.21.15.46:0/2414752166 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f21ac042070 con 0x7f21b0100e20 2024-09-19T09:21:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 Processor -- start 2024-09-19T09:21:30.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 -- start start 2024-09-19T09:21:30.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fc4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fc4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693fd5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d693f2a2f0 con 0x55d693fd3780 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d693ed1cf0 con 0x55d693fc5b40 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b9c14740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d693f262b0 con 0x55d693fc45d0 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.674+0000 7f21b5dd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fc4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fc4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52360/0 (socket says 172.21.15.46:52360) 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 -- 172.21.15.46:0/1513736504 learned_addr learned my addr 172.21.15.46:0/1513736504 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693fd5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21a67fc640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f219c0a32c0 0x7f219c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b55d7640 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fc4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 -- 172.21.15.46:0/1513736504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 msgr2=0x55d693fc4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fc4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 -- 172.21.15.46:0/1513736504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 msgr2=0x55d693fd5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693fd5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21a67fc640 1 -- 172.21.15.46:0/2414752166 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f21ac0efdf0 con 0x7f21b0100e20 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 -- 172.21.15.46:0/1513736504 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d693eb63a0 con 0x55d693fc5b40 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f219c0a32c0 0x7f219c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693fd5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.675+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fc4090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f21a80104a0 tx=0x7f21a8010960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd39a58fb2666182 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.676+0000 7f219b7fe640 1 -- 172.21.15.46:0/1513736504 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a801d910 con 0x55d693fc5b40 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.676+0000 7f219b7fe640 1 -- 172.21.15.46:0/1513736504 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a8011440 con 0x55d693fc5b40 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.676+0000 7f219b7fe640 1 -- 172.21.15.46:0/1513736504 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a801c6a0 con 0x55d693fc5b40 2024-09-19T09:21:30.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.676+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f219c0a32c0 0x7f219c0a5780 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f21a8021000 tx=0x7f21a801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 -- 172.21.15.46:0/1513736504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 msgr2=0x55d693fc4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fc4090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f21a80104a0 tx=0x7f21a8010960 comp rx=0 tx=0).stop 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 -- 172.21.15.46:0/1513736504 shutdown_connections 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693fd5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fc4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 --2- 172.21.15.46:0/1513736504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fc4090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 -- 172.21.15.46:0/1513736504 >> 172.21.15.46:0/1513736504 conn(0x55d693f8d310 msgr2=0x55d693fc0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 -- 172.21.15.46:0/1513736504 shutdown_connections 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 -- 172.21.15.46:0/1513736504 wait complete. 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 -- start start 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.677+0000 7f21b9c14740 1 Processor -- start 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 0x55d693fd3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fd0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 0x55d693fd3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 0x55d693fd3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36632/0 (socket says 172.21.15.46:36632) 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b55d7640 1 -- 172.21.15.46:0/932042 learned_addr learned my addr 172.21.15.46:0/932042 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fd3780 0x55d693fd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d693fd6480 con 0x55d693fc45d0 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d693ee5060 con 0x55d693fc5b40 2024-09-19T09:21:30.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d693fd6600 con 0x55d693fd3780 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.678+0000 7f21b9c14740 10 client.0 _ll_register_callbacks cb 0x55d693c388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fd3780 0x55d693fd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b55d7640 1 -- 172.21.15.46:0/932042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fd3780 msgr2=0x55d693fd09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b55d7640 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fd3780 0x55d693fd09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b55d7640 1 -- 172.21.15.46:0/932042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 msgr2=0x55d693fd0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b55d7640 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fd0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b55d7640 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d693c9b3c0 con 0x55d693fc45d0 2024-09-19T09:21:30.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f21b55d7640 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 0x55d693fd3150 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009a20 tx=0x7f21ac0bc2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22b605b92dc6714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f2198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.679+0000 7f2198ff9640 1 -- 172.21.15.46:0/932042 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac031de0 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f2198ff9640 1 -- 172.21.15.46:0/932042 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f21ac0c4c20 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a8011440 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f2198ff9640 1 -- 172.21.15.46:0/932042 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f21ac0bc4f0 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f21b9c14740 10 client.16338 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d693fe1f80 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f2198ff9640 1 -- 172.21.15.46:0/932042 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21ac0c07f0 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f2198ff9640 1 -- 172.21.15.46:0/932042 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f21ac03b580 con 0x55d693fc45d0 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.680+0000 7f21b9c14740 10 client.16338 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b9c14740 10 client.16338 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b9c14740 20 client.16338 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:30.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d693fe36d0 0x55d693fe5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b9c14740 4 client.16338 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f21a8011440 con 0x55d693fe36d0 2024-09-19T09:21:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d693fe36d0 0x55d693fe5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f2198ff9640 10 client.16338 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:21:30.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.681+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d693fe36d0 0x55d693fe5b70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=14d9038693892f6a server_cookie=b5c1f42d4a06a548 in_seq=0 out_seq=0 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f2198ff9640 1 -- 172.21.15.46:0/932042 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f21a8011440 con 0x55d693fe36d0 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f2198ff9640 10 client.16338 handle_command_reply: tid=0 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 client.16338 shutdown 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 msgr2=0x55d693fd3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 0x55d693fd3150 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f21ac009a20 tx=0x7f21ac0bc2c0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 shutdown_connections 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d693fe36d0 0x55d693fe5b70 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fd3780 0x55d693fd09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc5b40 0x55d693fd0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f2198ff9640 0 client.16338 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 --2- 172.21.15.46:0/932042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc45d0 0x55d693fd3150 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.682+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 >> 172.21.15.46:0/932042 conn(0x55d693f8d310 msgr2=0x55d693fc6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.683+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 shutdown_connections 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.683+0000 7f21b9c14740 1 -- 172.21.15.46:0/932042 wait complete. 2024-09-19T09:21:30.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.683+0000 7f21b9c14740 20 client.16338 trim_cache size 0 max 16384 2024-09-19T09:21:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.697+0000 7f21b9c14740 1 Processor -- start 2024-09-19T09:21:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.697+0000 7f21b9c14740 1 -- start start 2024-09-19T09:21:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc45d0 0x55d693fdf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 0x55d693feb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693feb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b9c14740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f219400e370 con 0x55d693fd3780 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b9c14740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f219400ff70 con 0x55d693fc45d0 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b9c14740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f219400ea40 con 0x55d693fc5b40 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 0x55d693feb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc45d0 0x55d693fdf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 0x55d693feb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:39572/0 (socket says 172.21.15.46:39572) 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 -- 172.21.15.46:0/2954846542 learned_addr learned my addr 172.21.15.46:0/2954846542 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693feb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 -- 172.21.15.46:0/2954846542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc45d0 msgr2=0x55d693fdf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc45d0 0x55d693fdf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 -- 172.21.15.46:0/2954846542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 msgr2=0x55d693feb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693feb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 -- 172.21.15.46:0/2954846542 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d693fd5ee0 con 0x55d693fc5b40 2024-09-19T09:21:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc45d0 0x55d693fdf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.698+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 0x55d693feb440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000c00 tx=0x7f21a000bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34464e0a9642a774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.699+0000 7f219affd640 1 -- 172.21.15.46:0/2954846542 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0003be0 con 0x55d693fc5b40 2024-09-19T09:21:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.699+0000 7f219affd640 1 -- 172.21.15.46:0/2954846542 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a0005500 con 0x55d693fc5b40 2024-09-19T09:21:30.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.699+0000 7f219affd640 1 -- 172.21.15.46:0/2954846542 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0011440 con 0x55d693fc5b40 2024-09-19T09:21:30.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.699+0000 7f21b9c14740 1 -- 172.21.15.46:0/2954846542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 msgr2=0x55d693feb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.699+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 0x55d693feb440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21a0000c00 tx=0x7f21a000bf80 comp rx=0 tx=0).stop 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 -- 172.21.15.46:0/2954846542 shutdown_connections 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fd3780 0x55d693feb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc5b40 0x55d693feb440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2954846542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fc45d0 0x55d693fdf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 -- 172.21.15.46:0/2954846542 >> 172.21.15.46:0/2954846542 conn(0x55d693f8d310 msgr2=0x55d693fcecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 -- 172.21.15.46:0/2954846542 shutdown_connections 2024-09-19T09:21:30.706 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 -- 172.21.15.46:0/2954846542 wait complete. 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 -- start start 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 Processor -- start 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.700+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fdc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc5b40 0x55d693fd7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b9c14740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 0x55d693fd7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b9c14740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f219400f8a0 con 0x55d693fc5b40 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b9c14740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f219400f110 con 0x55d693fd3780 2024-09-19T09:21:30.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b9c14740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f219400c350 con 0x55d693fc45d0 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b9c14740 10 client.0 _ll_register_callbacks cb 0x7f21ac005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fdc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b5dd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 0x55d693fd7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fdc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:39582/0 (socket says 172.21.15.46:39582) 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b5dd8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 0x55d693fd7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52384/0 (socket says 172.21.15.46:52384) 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 -- 172.21.15.46:0/2299332107 learned_addr learned my addr 172.21.15.46:0/2299332107 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc5b40 0x55d693fd7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 -- 172.21.15.46:0/2299332107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 msgr2=0x55d693fd7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 0x55d693fd7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 -- 172.21.15.46:0/2299332107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc5b40 msgr2=0x55d693fd7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:30.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc5b40 0x55d693fd7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 -- 172.21.15.46:0/2299332107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d693fd8070 con 0x55d693fc45d0 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b5dd8640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 0x55d693fd7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f21b55d7640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fdc020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0edc90 tx=0x7f21ac009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb0d598ce6b1d6d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.701+0000 7f2198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f2198ff9640 1 -- 172.21.15.46:0/2299332107 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac03b660 con 0x55d693fc45d0 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f2198ff9640 1 -- 172.21.15.46:0/2299332107 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f21ac0b8290 con 0x55d693fc45d0 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a0005500 con 0x55d693fc45d0 2024-09-19T09:21:30.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f2198ff9640 1 -- 172.21.15.46:0/2299332107 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f21ac0c4e30 con 0x55d693fc45d0 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 10 client.25795 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d693fd8070 con 0x55d693fc45d0 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f2198ff9640 1 -- 172.21.15.46:0/2299332107 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a0005500 con 0x55d693fc45d0 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f2198ff9640 1 -- 172.21.15.46:0/2299332107 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f21ac0bb3b0 con 0x55d693fc45d0 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 10 client.25795 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 10 client.25795 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 20 client.25795 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d69404e770 0x55d694050b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 4 client.25795 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.702+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 --> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d693f37860 con 0x55d69404e770 2024-09-19T09:21:30.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.703+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d69404e770 0x55d694050b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.703+0000 7f21b4dd6640 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d69404e770 0x55d694050b60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d719f1acf42ed023 server_cookie=8a3207d30c79954a in_seq=0 out_seq=0 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.703+0000 7f2198ff9640 10 client.25795 ms_handle_connect on v2:172.21.15.115:6836/1753777056 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f2198ff9640 1 -- 172.21.15.46:0/2299332107 <== mds.2 v2:172.21.15.115:6836/1753777056 1 ==== command_reply(tid 0: 0 ) ==== 8+0+48557 (crc 0 0 0) 0x55d693f37860 con 0x55d69404e770 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f2198ff9640 10 client.25795 handle_command_reply: tid=0 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 client.25795 shutdown 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 msgr2=0x55d693fdc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fdc020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0edc90 tx=0x7f21ac009600 comp rx=0 tx=0).stop 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 shutdown_connections 2024-09-19T09:21:30.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:6836/1753777056,v1:172.21.15.115:6837/1753777056] conn(0x55d69404e770 0x55d694050b60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d693fc5b40 0x55d693fd7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f2198ff9640 0 client.25795 ms_handle_reset on v2:172.21.15.115:6836/1753777056 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d693fd3780 0x55d693fd7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 --2- 172.21.15.46:0/2299332107 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d693fc45d0 0x55d693fdc020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.704+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 >> 172.21.15.46:0/2299332107 conn(0x55d693f8d310 msgr2=0x55d693fbf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 shutdown_connections 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b9c14740 1 -- 172.21.15.46:0/2299332107 wait complete. 2024-09-19T09:21:30.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b9c14740 20 client.25795 trim_cache size 0 max 16384 2024-09-19T09:21:30.713 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 5272566, 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630779, 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/632.out" 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.714 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 15193193, 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629562, 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/018.out" 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 15977392, 2024-09-19T09:21:30.715 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630221, 2024-09-19T09:21:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/345.out" 2024-09-19T09:21:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 20253063, 2024-09-19T09:21:30.716 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630731, 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/608.out" 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 43133393, 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630369, 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/427.out" 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.717 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 56135428, 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630061, 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/265.out" 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 56817432, 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630583, 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/534.out" 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.718 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 107045497, 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630749, 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/617.out" 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.719 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 120477680, 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629881, 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/175.out" 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 135309858, 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629572, 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/023.out" 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.720 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 143465802, 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629671, 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/070.out" 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 187427172, 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630059, 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/264.out" 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.721 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 273829265, 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630825, 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/655.out" 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 302850292, 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630883, 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/684.out" 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.722 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 305297490, 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630389, 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/437.out" 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 325239466, 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630355, 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/420.out" 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.723 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 333550571, 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629546, 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/010.out" 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 339438652, 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630851, 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/668.out" 2024-09-19T09:21:30.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 379393809, 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629771, 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/120.out" 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 384986679, 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630215, 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/342.out" 2024-09-19T09:21:30.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 435030259, 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629629, 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.default" 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.726 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 461565409, 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629606, 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/039.out" 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 466587738, 2024-09-19T09:21:30.727 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630227, 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/348.out" 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 486067843, 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630311, 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/398.out" 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.728 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 486647470, 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629624, 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/048.out" 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 524804733, 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630799, 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/642.out" 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.729 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 538591013, 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630565, 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/525.out" 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 549529177, 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629845, 2024-09-19T09:21:30.730 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/157.out" 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 601117410, 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629971, 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/220.out" 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 635342108, 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629618, 2024-09-19T09:21:30.731 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/045.out" 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 644323606, 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631217, 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/104.out" 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.732 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 709666250, 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630693, 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/589.out" 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 735145238, 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630593, 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/539.out" 2024-09-19T09:21:30.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 755443807, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630163, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/316.out" 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 769099802, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630075, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/272.out" 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.734 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 775883418, 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630093, 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/281.out" 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 782563466, 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630327, 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/406.out" 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.735 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 792780911, 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630041, 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/255.out" 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 805819317, 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630203, 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/336.out" 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.736 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 874547242, 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630673, 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/579.out" 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 928654731, 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629614, 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/043.out" 2024-09-19T09:21:30.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 958341057, 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630103, 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/286.out" 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1001641764, 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630507, 2024-09-19T09:21:30.738 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/496.out" 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1014586350, 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630009, 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/239.out" 2024-09-19T09:21:30.739 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1024056761, 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630713, 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/599.out" 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1037558251, 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629795, 2024-09-19T09:21:30.740 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/132.out" 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1039146765, 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630661, 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/573.out" 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.741 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1070414955, 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630927, 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/706.out" 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1123237179, 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630491, 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/488.out" 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.742 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1154852048, 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629554, 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/014.out" 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1154935697, 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630643, 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/564.out" 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.743 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1162413968, 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629735, 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/102.out" 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1213062158, 2024-09-19T09:21:30.744 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631099, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/032.out" 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1217042723, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630399, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/442.out" 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1235801617, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630515, 2024-09-19T09:21:30.745 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/500.out" 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1276293721, 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630707, 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/596.out" 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.746 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1282449922, 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630281, 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/383.out" 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1294092255, 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629663, 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/066.out" 2024-09-19T09:21:30.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1295720407, 2024-09-19T09:21:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630617, 2024-09-19T09:21:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/551.out" 2024-09-19T09:21:30.748 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1329489522, 2024-09-19T09:21:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630043, 2024-09-19T09:21:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/256.out" 2024-09-19T09:21:30.749 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1333360026, 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630137, 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/303.out" 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.750 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1354828550, 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630787, 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/636.out" 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1380337364, 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629610, 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/041.out" 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.751 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1384398284, 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630579, 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/532.out" 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1451435723, 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629544, 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/009.out" 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.752 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1456905148, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630623, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/554.out" 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1459708677, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629855, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/162.out" 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1493242195, 2024-09-19T09:21:30.753 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630675, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/580.out" 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1496561418, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630159, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/314.out" 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1547692019, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631185, 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/075.out" 2024-09-19T09:21:30.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1587023566, 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630401, 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/443.out" 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1589605043, 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629659, 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/064.out" 2024-09-19T09:21:30.755 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1630525487, 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629887, 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/178.out" 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f219c0a32c0 msgr2=0x7f219c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f219c0a32c0 0x7f219c0a5780 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f21a8021000 tx=0x7f21a801e000 comp rx=0 tx=0).stop 2024-09-19T09:21:30.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 msgr2=0x7f21b0199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0199350 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006010 tx=0x7f21ac003c10 comp rx=0 tx=0).stop 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 shutdown_connections 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f219c0a32c0 0x7f219c0a5780 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21b0102ef0 0x7f21b01a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f21b0102570 0x7f21b0199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 --2- 172.21.15.46:0/2414752166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21b0100e20 0x7f21b0199350 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.705+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 >> 172.21.15.46:0/2414752166 conn(0x7f21b00fc7d0 msgr2=0x7f21b00fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.706+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 shutdown_connections 2024-09-19T09:21:30.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:30.706+0000 7f21b783b640 1 -- 172.21.15.46:0/2414752166 wait complete. 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1637680827, 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630687, 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/586.out" 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.758 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1642053707, 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629801, 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/135.out" 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1644053511, 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630073, 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/271.out" 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.759 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1662931795, 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629815, 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/142.out" 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1673987826, 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630595, 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/540.out" 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.760 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1692911079, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629791, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/130.out" 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1717104460, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630431, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/458.out" 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1720170155, 2024-09-19T09:21:30.761 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630375, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/430.out" 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1777016053, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630535, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/510.out" 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1777782961, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630653, 2024-09-19T09:21:30.762 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/569.out" 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1790679340, 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630597, 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/541.out" 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1798528871, 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630385, 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/435.out" 2024-09-19T09:21:30.763 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1821938259, 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630349, 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/417.out" 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1825888641, 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629863, 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/166.out" 2024-09-19T09:21:30.764 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1833540723, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630925, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/705.out" 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1839603824, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629789, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/129.out" 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.765 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1852988753, 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630791, 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/638.out" 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1897229503, 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630011, 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/240.out" 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.766 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1970150274, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629981, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/225.out" 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2009001246, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630341, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/413.out" 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2035739104, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629620, 2024-09-19T09:21:30.767 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/046.out" 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2037884418, 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629921, 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/195.out" 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2054404471, 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631153, 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/059.out" 2024-09-19T09:21:30.768 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2075932554, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629731, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/100.out" 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2079558974, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630587, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/536.out" 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.769 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2096788082, 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630845, 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/665.out" 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2101327168, 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630467, 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/476.out" 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.770 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2127499046, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630539, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/512.out" 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2237323456, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630549, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/517.out" 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2254653839, 2024-09-19T09:21:30.771 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629538, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/006.out" 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2260869094, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631135, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/050.out" 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2287296717, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629707, 2024-09-19T09:21:30.772 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/088.out" 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2297752912, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630441, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/463.out" 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2323606464, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630997, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/741.out" 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.773 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2354273059, 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630045, 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/257.out" 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2375207768, 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630207, 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/338.out" 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.774 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2379946297, 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630422, 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454" 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2394001164, 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630183, 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/326.out" 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.775 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2404166264, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630003, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/236.out" 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2424469297, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629893, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/181.out" 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2441217336, 2024-09-19T09:21:30.776 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630651, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/568.out" 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2442830941, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630531, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/508.out" 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2469326402, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631091, 2024-09-19T09:21:30.777 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/028.out" 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2493425808, 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630027, 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/248.out" 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2506387756, 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630423, 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454.out" 2024-09-19T09:21:30.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2508282621, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630503, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/494.out" 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2510579709, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631037, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/001.out" 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.779 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2550783133, 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629604, 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/038.out" 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2553489303, 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630063, 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/266.out" 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.780 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2577427624, 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630439, 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/462.out" 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2602394486, 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630291, 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/388.out" 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.781 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2634813845, 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630493, 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/489.out" 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2636517837, 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629560, 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/017.out" 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.782 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2644648207, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630091, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/280.out" 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2658707724, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629649, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/059.out" 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2666491760, 2024-09-19T09:21:30.783 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629550, 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/012.out" 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2666890614, 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630295, 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/390.out" 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2685020639, 2024-09-19T09:21:30.784 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629721, 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/095.out" 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2698730274, 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631207, 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/086.out" 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.785 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2725549744, 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629827, 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/148.out" 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2740571846, 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630177, 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/323.out" 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.786 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2757478907, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630689, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/587.out" 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2788851663, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629594, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/034.out" 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2903274822, 2024-09-19T09:21:30.787 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631101, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/033.out" 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2954635888, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630025, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/247.out" 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2959279392, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630089, 2024-09-19T09:21:30.788 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/279.out" 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2982809712, 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630921, 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/703.out" 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3007976383, 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629997, 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/233.out" 2024-09-19T09:21:30.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3020506216, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630885, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/685.out" 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3066523748, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629715, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/092.out" 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.790 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3156322190, 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630993, 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/739.out" 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3164288017, 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630001, 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/235.out" 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.791 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3167039985, 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629697, 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/083.out" 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3167118783, 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629586, 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/030.out" 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.792 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3178020320, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630903, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/694.out" 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3201438776, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630527, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/506.out" 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3236609897, 2024-09-19T09:21:30.793 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629695, 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/082.out" 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3256173854, 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630085, 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/277.out" 2024-09-19T09:21:30.794 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3279335523, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629667, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/068.out" 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3287427379, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630419, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/452.out" 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.795 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3341734457, 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630499, 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/492.out" 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3345942607, 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629532, 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/003.out" 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.796 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3358649994, 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630719, 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/602.out" 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3373204508, 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630173, 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/321.out" 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.797 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3378149548, 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630793, 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/639.out" 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3406090193, 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630685, 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/585.out" 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.798 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3432166366, 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629805, 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/137.out" 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3459148223, 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630591, 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/538.out" 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3468397524, 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629983, 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/226.out" 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3479109397, 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629669, 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/069.out" 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.800 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3483316903, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630191, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/330.out" 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3484268920, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629673, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/071.out" 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3484561121, 2024-09-19T09:21:30.801 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630655, 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/570.out" 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3487265024, 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630781, 2024-09-19T09:21:30.802 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/633.out" 2024-09-19T09:21:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.804 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3491627419, 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629574, 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/024.out" 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3536051124, 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630931, 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/708.out" 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.805 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3552979878, 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631237, 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/114.out" 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3558995846, 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630247, 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/358.out" 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.806 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3609690919, 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629747, 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/108.out" 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3626282555, 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630609, 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/547.out" 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.807 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3633108972, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629859, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/164.out" 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3646069453, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629655, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/062.out" 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3655101590, 2024-09-19T09:21:30.808 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629584, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/029.out" 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3667052984, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630657, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/571.out" 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3714985996, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630053, 2024-09-19T09:21:30.809 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/261.out" 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3719601521, 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630699, 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/592.out" 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3721062397, 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629540, 2024-09-19T09:21:30.810 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/007.out" 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3723481142, 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630817, 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/651.out" 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3724290685, 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630153, 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/311.out" 2024-09-19T09:21:30.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3758294852, 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629651, 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/060.out" 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3794464253, 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630321, 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/403.out" 2024-09-19T09:21:30.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3799086358, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630443, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/464.out" 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3841424201, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630393, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/439.out" 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.813 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3848757740, 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630559, 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/522.out" 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3871634020, 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630877, 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/681.out" 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.814 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3916650202, 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630391, 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/438.out" 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3920926170, 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629596, 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.cfg" 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.815 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3924445539, 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629566, 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/020.out" 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3929708162, 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630429, 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/457.out" 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.816 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3949771508, 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629783, 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/126.out" 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3974867610, 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630813, 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/649.out" 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.817 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3990063884, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630469, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/477.out" 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4025557470, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630899, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/692.out" 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4026945098, 2024-09-19T09:21:30.818 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630765, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/625.out" 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4027945410, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630599, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/542.out" 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4047512631, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630835, 2024-09-19T09:21:30.819 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/660.out" 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4101856698, 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630975, 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/730.out" 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4105453794, 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629889, 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/179.out" 2024-09-19T09:21:30.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4109904833, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630315, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/400.out" 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4121180202, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630123, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/296.out" 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.821 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4166645294, 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630081, 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/275.out" 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4167627488, 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630313, 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/399.out" 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.822 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4170543128, 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629741, 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/105.out" 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4180039730, 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629773, 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/121.out" 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.823 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4186765383, 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630079, 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/274.out" 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4186770019, 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630433, 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/459.out" 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.824 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4232527329, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629861, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/165.out" 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4256839218, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630819, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/652.out" 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4261486696, 2024-09-19T09:21:30.825 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629687, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/078.out" 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4263795806, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630703, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/594.out" 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4265458199, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630985, 2024-09-19T09:21:30.826 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/735.out" 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4265923845, 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630893, 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/689.out" 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4270057145, 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630303, 2024-09-19T09:21:30.827 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/394.out" 2024-09-19T09:21:30.828 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:30.828 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-09-19T09:21:31.388 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xffd97 2024-09-19T09:21:31.810 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:21:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:32.391 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:32 smithi046 ceph-mon[31203]: pgmap v436: 97 pgs: 97 active+clean; 36 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 679 op/s 2024-09-19T09:21:32.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:32 smithi115 ceph-mon[35055]: pgmap v436: 97 pgs: 97 active+clean; 36 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 679 op/s 2024-09-19T09:21:32.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:32 smithi099 ceph-mon[35256]: pgmap v436: 97 pgs: 97 active+clean; 36 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 679 op/s 2024-09-19T09:21:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 -- 172.21.15.46:0/1434473160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5181082a0 msgr2=0x7fe51810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 --2- 172.21.15.46:0/1434473160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5181082a0 0x7fe51810ec40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe510009cd0 tx=0x7fe51002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 -- 172.21.15.46:0/1434473160 shutdown_connections 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 --2- 172.21.15.46:0/1434473160 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe5181082a0 0x7fe51810ec40 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 --2- 172.21.15.46:0/1434473160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5181036e0 0x7fe518107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 --2- 172.21.15.46:0/1434473160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe518102d30 0x7fe518103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 -- 172.21.15.46:0/1434473160 >> 172.21.15.46:0/1434473160 conn(0x7fe5180fc7d0 msgr2=0x7fe5180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 -- 172.21.15.46:0/1434473160 shutdown_connections 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.594+0000 7fe51f23f640 1 -- 172.21.15.46:0/1434473160 wait complete. 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 Processor -- start 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 -- start start 2024-09-19T09:21:32.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe518102d30 0x7fe518100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5181036e0 0x7fe518100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5181082a0 0x7fe518101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181120a0 con 0x7fe518102d30 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe518111f20 con 0x7fe5181036e0 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.595+0000 7fe51f23f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe518112220 con 0x7fe5181082a0 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe518102d30 0x7fe518100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5181036e0 0x7fe518100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe518102d30 0x7fe518100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36690/0 (socket says 172.21.15.46:36690) 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe51cfdb640 1 -- 172.21.15.46:0/3620387351 learned_addr learned my addr 172.21.15.46:0/3620387351 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5181082a0 0x7fe518101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 -- 172.21.15.46:0/3620387351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5181082a0 msgr2=0x7fe518101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5181082a0 0x7fe518101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 -- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe518102d30 msgr2=0x7fe518100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe518102d30 0x7fe518100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 -- 172.21.15.46:0/3620387351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5181a6a00 con 0x7fe5181036e0 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe517fff640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5181036e0 0x7fe518100ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5180697d0 tx=0x7fe50400db30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe515ffb640 1 -- 172.21.15.46:0/3620387351 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504017070 con 0x7fe5181036e0 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe515ffb640 1 -- 172.21.15.46:0/3620387351 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe504009820 con 0x7fe5181036e0 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.596+0000 7fe515ffb640 1 -- 172.21.15.46:0/3620387351 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504004cd0 con 0x7fe5181036e0 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.597+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5181a6cf0 con 0x7fe5181036e0 2024-09-19T09:21:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.597+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5181a7180 con 0x7fe5181036e0 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.599+0000 7fe515ffb640 1 -- 172.21.15.46:0/3620387351 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe5040099d0 con 0x7fe5181036e0 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 Processor -- start 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 -- start start 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e6b40 0x5588147e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e55d0 0x5588147e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55881474b2f0 con 0x5588147e6b40 2024-09-19T09:21:32.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5588146f2cf0 con 0x5588147e55d0 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe515ffb640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe5080a3240 0x7fe5080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe521618740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5588147472b0 con 0x5588147f0370 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe51d7dc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e6b40 0x5588147e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e55d0 0x5588147e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e55d0 0x5588147e5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52410/0 (socket says 172.21.15.46:52410) 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe51cfdb640 1 -- 172.21.15.46:0/2393032196 learned_addr learned my addr 172.21.15.46:0/2393032196 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe515ffb640 1 -- 172.21.15.46:0/3620387351 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fe5040cf160 con 0x7fe5181036e0 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.600+0000 7fe517fff640 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe5080a3240 0x7fe5080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe517fff640 1 -- 172.21.15.46:0/2393032196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e55d0 msgr2=0x5588147e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe517fff640 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e55d0 0x5588147e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe517fff640 1 -- 172.21.15.46:0/2393032196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e6b40 msgr2=0x5588147e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe517fff640 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e6b40 0x5588147e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe517fff640 1 -- 172.21.15.46:0/2393032196 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588146d73a0 con 0x5588147f0370 2024-09-19T09:21:32.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe517fff640 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147f2760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5040981d0 tx=0x7fe50409b220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62417a7ae89bc3f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:32.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe502ffd640 1 -- 172.21.15.46:0/2393032196 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504020070 con 0x5588147f0370 2024-09-19T09:21:32.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe502ffd640 1 -- 172.21.15.46:0/2393032196 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe504009cf0 con 0x5588147f0370 2024-09-19T09:21:32.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.601+0000 7fe502ffd640 1 -- 172.21.15.46:0/2393032196 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50409ccb0 con 0x5588147f0370 2024-09-19T09:21:32.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe5080a3240 0x7fe5080a5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe510005fe0 tx=0x7fe51002a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:32.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 -- 172.21.15.46:0/2393032196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 msgr2=0x5588147f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147f2760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe5040981d0 tx=0x7fe50409b220 comp rx=0 tx=0).stop 2024-09-19T09:21:32.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 -- 172.21.15.46:0/2393032196 shutdown_connections 2024-09-19T09:21:32.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147f2760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e55d0 0x5588147e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 --2- 172.21.15.46:0/2393032196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e6b40 0x5588147e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 -- 172.21.15.46:0/2393032196 >> 172.21.15.46:0/2393032196 conn(0x5588147ae310 msgr2=0x5588147e1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.602+0000 7fe521618740 1 -- 172.21.15.46:0/2393032196 shutdown_connections 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 -- 172.21.15.46:0/2393032196 wait complete. 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 -- start start 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 Processor -- start 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147efd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147ed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147ed630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5588147f3070 con 0x5588147e55d0 2024-09-19T09:21:32.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558814706060 con 0x5588147e6b40 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5588147f31f0 con 0x5588147f0370 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.603+0000 7fe521618740 10 client.0 _ll_register_callbacks cb 0x5588144598c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147efd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36696/0 (socket says 172.21.15.46:36696) 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe51cfdb640 1 -- 172.21.15.46:0/4087076697 learned_addr learned my addr 172.21.15.46:0/4087076697 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 -- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 msgr2=0x5588147ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 -- 172.21.15.46:0/4087076697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 msgr2=0x5588147efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147efd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 -- 172.21.15.46:0/4087076697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588144bc3c0 con 0x5588147e6b40 2024-09-19T09:21:32.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe517fff640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147ed020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe504000c00 tx=0x7fe5040a4610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65e7b97308e32504 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe4f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe4f7fff640 1 -- 172.21.15.46:0/4087076697 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504020040 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe4f7fff640 1 -- 172.21.15.46:0/4087076697 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fe50409c0a0 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.604+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558814758860 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe4f7fff640 1 -- 172.21.15.46:0/4087076697 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe5040ba170 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 10 client.25865 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5588147feae0 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe4f7fff640 1 -- 172.21.15.46:0/4087076697 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558814758860 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe4f7fff640 1 -- 172.21.15.46:0/4087076697 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fe504084b50 con 0x5588147e6b40 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 10 client.25865 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 10 client.25865 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:21:32.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 20 client.25865 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5588147ffe30 0x558814802220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 4 client.25865 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558814752d70 con 0x5588147ffe30 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.605+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5588147ffe30 0x558814802220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.606+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5588147ffe30 0x558814802220 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d76729e40e453558 server_cookie=d6a2f54ceea4bbe9 in_seq=0 out_seq=0 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.606+0000 7fe4f7fff640 10 client.25865 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.606+0000 7fe4f7fff640 1 -- 172.21.15.46:0/4087076697 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558814752d70 con 0x5588147ffe30 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.606+0000 7fe4f7fff640 10 client.25865 handle_command_reply: tid=0 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.606+0000 7fe521618740 1 client.25865 shutdown 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 msgr2=0x5588147ed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147ed020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe504000c00 tx=0x7fe5040a4610 comp rx=0 tx=0).stop 2024-09-19T09:21:32.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 shutdown_connections 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x5588147ffe30 0x558814802220 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588147ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147ed020 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 --2- 172.21.15.46:0/4087076697 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe4f7fff640 0 client.25865 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 >> 172.21.15.46:0/4087076697 conn(0x5588147ae310 msgr2=0x5588147e7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 shutdown_connections 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 1 -- 172.21.15.46:0/4087076697 wait complete. 2024-09-19T09:21:32.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.607+0000 7fe521618740 20 client.25865 trim_cache size 0 max 16384 2024-09-19T09:21:32.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 Processor -- start 2024-09-19T09:21:32.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 -- start start 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147fc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x558814804e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181af720 con 0x5588147e55d0 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181b1320 con 0x5588147e6b40 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe521618740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181afdf0 con 0x5588147f0370 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147fc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36698/0 (socket says 172.21.15.46:36698) 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe51cfdb640 1 -- 172.21.15.46:0/3065864945 learned_addr learned my addr 172.21.15.46:0/3065864945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.623+0000 7fe517fff640 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x558814804e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51cfdb640 1 -- 172.21.15.46:0/3065864945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 msgr2=0x558814804e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x558814804e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51cfdb640 1 -- 172.21.15.46:0/3065864945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 msgr2=0x5588147e1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147e1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51cfdb640 1 -- 172.21.15.46:0/3065864945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588147ee3a0 con 0x5588147e55d0 2024-09-19T09:21:32.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147fc490 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe50c005e00 tx=0x7fe50c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7c85b8286c822b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe5027fc640 1 -- 172.21.15.46:0/3065864945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c004050 con 0x5588147e55d0 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe5027fc640 1 -- 172.21.15.46:0/3065864945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe50c00fdd0 con 0x5588147e55d0 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.624+0000 7fe5027fc640 1 -- 172.21.15.46:0/3065864945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c003bb0 con 0x5588147e55d0 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 -- 172.21.15.46:0/3065864945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 msgr2=0x5588147fc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147fc490 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe50c005e00 tx=0x7fe50c005f90 comp rx=0 tx=0).stop 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 -- 172.21.15.46:0/3065864945 shutdown_connections 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x558814804e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x5588147e1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 --2- 172.21.15.46:0/3065864945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x5588147fc490 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 -- 172.21.15.46:0/3065864945 >> 172.21.15.46:0/3065864945 conn(0x5588147ae310 msgr2=0x5588147e1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 -- 172.21.15.46:0/3065864945 shutdown_connections 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.625+0000 7fe521618740 1 -- 172.21.15.46:0/3065864945 wait complete. 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 -- start start 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 Processor -- start 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x558814801c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x558814802180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588148026c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181b0c50 con 0x5588147e55d0 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181b04c0 con 0x5588147e6b40 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe5181ad700 con 0x5588147f0370 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe521618740 10 client.0 _ll_register_callbacks cb 0x7fe50409b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:32.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x558814801c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe51cfdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x558814801c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36700/0 (socket says 172.21.15.46:36700) 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.626+0000 7fe51cfdb640 1 -- 172.21.15.46:0/609768467 learned_addr learned my addr 172.21.15.46:0/609768467 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe517fff640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x558814802180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588148026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51cfdb640 1 -- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 msgr2=0x5588148026c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588148026c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51cfdb640 1 -- 172.21.15.46:0/609768467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 msgr2=0x558814802180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x558814802180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51cfdb640 1 -- 172.21.15.46:0/609768467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588148687e0 con 0x5588147e55d0 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51d7dc640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588148026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:32.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe517fff640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x558814802180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe51cfdb640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x558814801c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe50c000c00 tx=0x7fe50c012110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244c06cde575c86e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe4f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe4f7fff640 1 -- 172.21.15.46:0/609768467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c00f8f0 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe4f7fff640 1 -- 172.21.15.46:0/609768467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fe50c00fa90 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.627+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe50c00fdd0 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe4f7fff640 1 -- 172.21.15.46:0/609768467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe50c038070 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 10 client.16362 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558814869aa0 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe4f7fff640 1 -- 172.21.15.46:0/609768467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe50c00fdd0 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe4f7fff640 1 -- 172.21.15.46:0/609768467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fe50c031780 con 0x5588147e55d0 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 10 client.16362 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 10 client.16362 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:21:32.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 20 client.16362 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55881486a100 0x55881486c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 4 client.16362 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.628+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 --> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588146cf170 con 0x55881486a100 2024-09-19T09:21:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.629+0000 7fe517fff640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55881486a100 0x55881486c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.629+0000 7fe517fff640 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55881486a100 0x55881486c520 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf73e860a76da09d server_cookie=2cc14150d44a059f in_seq=0 out_seq=0 2024-09-19T09:21:32.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.629+0000 7fe4f7fff640 10 client.16362 ms_handle_connect on v2:172.21.15.115:6838/1737720182 2024-09-19T09:21:32.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe4f7fff640 1 -- 172.21.15.46:0/609768467 <== mds.1 v2:172.21.15.115:6838/1737720182 1 ==== command_reply(tid 0: 0 ) ==== 8+0+48522 (crc 0 0 0) 0x5588146cf170 con 0x55881486a100 2024-09-19T09:21:32.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe4f7fff640 10 client.16362 handle_command_reply: tid=0 2024-09-19T09:21:32.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 client.16362 shutdown 2024-09-19T09:21:32.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 msgr2=0x558814801c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x558814801c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe50c000c00 tx=0x7fe50c012110 comp rx=0 tx=0).stop 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 shutdown_connections 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:6838/1737720182,v1:172.21.15.115:6839/1737720182] conn(0x55881486a100 0x55881486c520 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5588147f0370 0x5588148026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5588147e6b40 0x558814802180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 --2- 172.21.15.46:0/609768467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5588147e55d0 0x558814801c40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 >> 172.21.15.46:0/609768467 conn(0x5588147ae310 msgr2=0x5588147eb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.630+0000 7fe4f7fff640 0 client.16362 ms_handle_reset on v2:172.21.15.115:6838/1737720182 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.631+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 shutdown_connections 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.631+0000 7fe521618740 1 -- 172.21.15.46:0/609768467 wait complete. 2024-09-19T09:21:32.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.631+0000 7fe521618740 20 client.16362 trim_cache size 0 max 16384 2024-09-19T09:21:32.637 INFO:teuthology.orchestra.run.smithi046.stdout:[ 2024-09-19T09:21:32.637 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.637 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.637 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 16286594, 2024-09-19T09:21:32.637 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629821, 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/145.out" 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 19214237, 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630759, 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/622.out" 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 61161432, 2024-09-19T09:21:32.638 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631069, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/017.out" 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 84969230, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629885, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/177.out" 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 91768639, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631221, 2024-09-19T09:21:32.639 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/106.out" 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 94281492, 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630021, 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/245.out" 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 108276402, 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628787, 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/038.out" 2024-09-19T09:21:32.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 124911620, 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629600, 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/036.out" 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.641 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 134677950, 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630097, 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/283.out" 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 142908021, 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630875, 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/680.out" 2024-09-19T09:21:32.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 189494146, 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629835, 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/152.out" 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 191270614, 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631121, 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/043.out" 2024-09-19T09:21:32.643 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 213486504, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628751, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/020.out" 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 215123352, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631065, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/015.out" 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.644 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 220688864, 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629797, 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/133.out" 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 237927763, 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628715, 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/002.out" 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.645 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 307560874, 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630201, 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/335.out" 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 316459016, 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630647, 2024-09-19T09:21:32.646 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/566.out" 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 322232801, 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630533, 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/509.out" 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.647 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 364912909, 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630225, 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/347.out" 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 465739455, 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630663, 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/574.out" 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.648 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 480451713, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629691, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/080.out" 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 491501953, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631105, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/035.out" 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 492908795, 2024-09-19T09:21:32.649 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630035, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/252.out" 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 498374991, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631231, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/111.out" 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 512054557, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630113, 2024-09-19T09:21:32.650 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/291.out" 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 517662835, 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629787, 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/128.out" 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 542246437, 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629711, 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/090.out" 2024-09-19T09:21:32.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 543782495, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629588, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/031.out" 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 572481226, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630387, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/436.out" 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.652 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 632344439, 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631039, 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/002.out" 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 653622159, 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630645, 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/565.out" 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.653 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 674475660, 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631191, 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/078.out" 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 697296428, 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630149, 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/309.out" 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.654 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 701470027, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629993, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/231.out" 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 724358175, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631244, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/Makefile" 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 725314304, 2024-09-19T09:21:32.655 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630305, 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/395.out" 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 730875592, 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631187, 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/076.out" 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 738992230, 2024-09-19T09:21:32.656 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631103, 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/034.out" 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 779218040, 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630293, 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/389.out" 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 805886072, 2024-09-19T09:21:32.657 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630383, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/434.out" 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 824405439, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628833, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/061.out" 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 855107067, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630889, 2024-09-19T09:21:32.658 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/687.out" 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 864783005, 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631169, 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/067.out" 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 874283677, 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630197, 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/333.out" 2024-09-19T09:21:32.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 884971144, 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631175, 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/070.out" 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 890708334, 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630285, 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/385.out" 2024-09-19T09:21:32.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 944747440, 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629851, 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/160.out" 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 979309073, 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630805, 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/645.out" 2024-09-19T09:21:32.661 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 994141427, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629639, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/054.out" 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1009360450, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630625, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/555.out" 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.662 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1072487574, 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631193, 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/079.out" 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1134005656, 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629719, 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/094.out" 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.663 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1154594649, 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629701, 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/085.out" 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1154921439, 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630185, 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/327.out" 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.664 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1183709514, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630167, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/318.out" 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1204687181, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630217, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/343.out" 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1233349725, 2024-09-19T09:21:32.665 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630083, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/276.out" 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1242756333, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630953, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/719.out" 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1248759556, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628789, 2024-09-19T09:21:32.666 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/039.out" 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1265415786, 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629558, 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/016.out" 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1268310137, 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631219, 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/105.out" 2024-09-19T09:21:32.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1318758101, 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629837, 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/153.out" 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.668 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1412871771, 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630033, 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/251.out" 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1447865542, 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630343, 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/414.out" 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.669 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1447871054, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628819, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/054.out" 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1449569551, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631205, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/085.out" 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1516049910, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630905, 2024-09-19T09:21:32.670 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/695.out" 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1529181410, 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630195, 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/332.out" 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1553324361, 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629975, 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/222.out" 2024-09-19T09:21:32.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1558632609, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629875, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/172.out" 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1651743700, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630711, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/598.out" 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.672 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1664871953, 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630741, 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/613.out" 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.631+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe5080a3240 msgr2=0x7fe5080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.631+0000 7fe51f23f640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe5080a3240 0x7fe5080a5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe510005fe0 tx=0x7fe51002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5181036e0 msgr2=0x7fe518100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5181036e0 0x7fe518100ed0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5180697d0 tx=0x7fe50400db30 comp rx=0 tx=0).stop 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 shutdown_connections 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fe5080a3240 0x7fe5080a5700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5181082a0 0x7fe518101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5181036e0 0x7fe518100ed0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 --2- 172.21.15.46:0/3620387351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe518102d30 0x7fe518100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:32.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.632+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 >> 172.21.15.46:0/3620387351 conn(0x7fe5180fc7d0 msgr2=0x7fe518105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1681522488, 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631081, 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/023.out" 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1688338165, 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630659, 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/572.out" 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.675 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1691483254, 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630821, 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/653.out" 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1705123986, 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629626, 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/049.out" 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.676 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1748930558, 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628783, 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/036.out" 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1776097099, 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631211, 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/101.out" 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1788164586, 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630853, 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/669.out" 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1788768016, 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630727, 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/606.out" 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1788936472, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631235, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/113.out" 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1800301516, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631093, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/029.out" 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1854605627, 2024-09-19T09:21:32.679 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629819, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/144.out" 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1856769573, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630357, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/421.out" 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1865105247, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630523, 2024-09-19T09:21:32.680 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/504.out" 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1885815494, 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631239, 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/115.out" 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1899998164, 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631077, 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/021.out" 2024-09-19T09:21:32.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1918221504, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629817, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/143.out" 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1925875487, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631151, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/058.out" 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.682 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1926470649, 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630067, 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/268.out" 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1956454230, 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631215, 2024-09-19T09:21:32.683 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/103.out" 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1959723229, 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628847, 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/068.out" 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1959730297, 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630763, 2024-09-19T09:21:32.684 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/624.out" 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1967205804, 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631225, 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/108.out" 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 1989657538, 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631229, 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/110.out" 2024-09-19T09:21:32.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2022048555, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630479, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/482.out" 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2036182818, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630807, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/646.out" 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.686 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2038122888, 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631083, 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/024.out" 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2039748186, 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630219, 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/344.out" 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.687 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2041802457, 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630809, 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/647.out" 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2066858522, 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630709, 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/597.out" 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.688 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2076413841, 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630505, 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/495.out" 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2096226505, 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630555, 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/520.out" 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.689 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2112748642, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631109, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/037.out" 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2126493549, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630667, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/576.out" 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2190971025, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631085, 2024-09-19T09:21:32.690 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/025.out" 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2215261592, 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631171, 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/068.out" 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2248375542, 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628835, 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/062.out" 2024-09-19T09:21:32.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2248866893, 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630619, 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/552.out" 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2257513595, 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629853, 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/161.out" 2024-09-19T09:21:32.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2257794286, 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630615, 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/550.out" 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2265432795, 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630751, 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/618.out" 2024-09-19T09:21:32.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2279536597, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631107, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/036.out" 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2306441100, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630641, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/563.out" 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.694 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2318815969, 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630425, 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/455.out" 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2343361208, 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628817, 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/053.out" 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.695 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2390440927, 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630363, 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/424.out" 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2391326485, 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631047, 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/006.out" 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.696 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2409036288, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629733, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/101.out" 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2418299441, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631159, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/062.out" 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2454514129, 2024-09-19T09:21:32.697 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631079, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/022.out" 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2470337466, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631063, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/014.out" 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2499088417, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629729, 2024-09-19T09:21:32.698 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/099.out" 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2569872381, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629843, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/156.out" 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2593642074, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630473, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/479.out" 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.699 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2606598840, 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630155, 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/312.out" 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2607534157, 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631201, 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/083.out" 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.700 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2628210102, 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631177, 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/071.out" 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2648415881, 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631049, 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/007.out" 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.701 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2662258013, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630879, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/682.out" 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2679169698, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630471, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/478.out" 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2681570870, 2024-09-19T09:21:32.702 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631087, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/026.out" 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2692055695, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630635, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/560.out" 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2699419759, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631143, 2024-09-19T09:21:32.703 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/054.out" 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2713296762, 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630365, 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/425.out" 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2793077158, 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629645, 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/057.out" 2024-09-19T09:21:32.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2802838571, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630407, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/446.out" 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2816700865, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630895, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/690.out" 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.705 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2833838493, 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630537, 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/511.out" 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2842668049, 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630677, 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/581.out" 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.706 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2862704263, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631199, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/082.out" 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2871087075, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631133, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/049.out" 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2877021368, 2024-09-19T09:21:32.707 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629883, 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/176.out" 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2899764453, 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630991, 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/738.out" 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2905686810, 2024-09-19T09:21:32.708 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630511, 2024-09-19T09:21:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.633+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 shutdown_connections 2024-09-19T09:21:32.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:32.633+0000 7fe51f23f640 1 -- 172.21.15.46:0/3620387351 wait complete. 2024-09-19T09:21:32.709 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/498.out" 2024-09-19T09:21:32.709 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2936418401, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630553, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/519.out" 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 2981346957, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630403, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/444.out" 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.710 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3049755357, 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630757, 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/621.out" 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3064089348, 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628813, 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/051.out" 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.711 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3094658518, 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630317, 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/401.out" 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3109166416, 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630039, 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/254.out" 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.712 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3111684737, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630213, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/341.out" 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3114757306, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630275, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/380.out" 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3116768881, 2024-09-19T09:21:32.713 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630873, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/679.out" 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3129780442, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629991, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/230.out" 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3149222397, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630229, 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/349.out" 2024-09-19T09:21:32.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3159298588, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631071, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/018.out" 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3194501102, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630135, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/302.out" 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.715 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3226577668, 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630867, 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/676.out" 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3260591332, 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630087, 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/278.out" 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.716 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3264489877, 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628849, 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/069.out" 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3265729423, 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631117, 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/041.out" 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.717 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3308432109, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629597, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.out.default" 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3321886446, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629641, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/055.out" 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3347321606, 2024-09-19T09:21:32.718 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628771, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/030.out" 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3400299464, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630705, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/595.out" 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3408612891, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630373, 2024-09-19T09:21:32.719 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/429.out" 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3418175564, 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629809, 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/139.out" 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3420363896, 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630211, 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/340.out" 2024-09-19T09:21:32.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3422315154, 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631119, 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/042.out" 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3423928655, 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630367, 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/426.out" 2024-09-19T09:21:32.721 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3441428838, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631127, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/046.out" 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3441849297, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628725, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/007.out" 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.722 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3448267031, 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629628, 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.cfg" 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3458097010, 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631053, 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/009.out" 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.723 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3476169493, 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630897, 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/691.out" 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3476371168, 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630329, 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/407.out" 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.724 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3484616674, 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630115, 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/292.out" 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3504466646, 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631141, 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/053.out" 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.725 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3520449987, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631097, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/031.out" 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3533824792, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629999, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/234.out" 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3565110967, 2024-09-19T09:21:32.726 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630461, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/473.out" 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3612338324, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628859, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/074.out" 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3613535406, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630455, 2024-09-19T09:21:32.727 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/470.out" 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3658075137, 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629953, 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/211.out" 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3735754908, 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630279, 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/382.out" 2024-09-19T09:21:32.728 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3771127411, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630119, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/294.out" 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3774484791, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631001, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/743.out" 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.729 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3779593146, 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631203, 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/084.out" 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3798870163, 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631157, 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/061.out" 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.730 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3816811514, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631139, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/052.out" 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3828128311, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631155, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/060.out" 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3851530285, 2024-09-19T09:21:32.731 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630671, 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/578.out" 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3865622879, 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631167, 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/066.out" 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3889072888, 2024-09-19T09:21:32.732 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631115, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/040.out" 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3905834404, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630495, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/490.out" 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3912057918, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631165, 2024-09-19T09:21:32.733 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/065.out" 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3925917896, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631241, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/116.out" 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 3985044420, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631131, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/048.out" 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.734 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4013769464, 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628809, 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/049.out" 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4018168918, 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631055, 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/010.out" 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.735 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4042736029, 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629911, 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/190.out" 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4070372888, 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630413, 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/449.out" 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.736 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4093358681, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630581, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/533.out" 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4093904996, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630717, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/601.out" 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4119720330, 2024-09-19T09:21:32.737 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629793, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/131.out" 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4127769307, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631125, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/045.out" 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4146062710, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631129, 2024-09-19T09:21:32.738 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/047.out" 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4181504964, 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511631195, 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/080.out" 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4219848601, 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630833, 2024-09-19T09:21:32.739 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/659.out" 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4226133206, 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630679, 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/582.out" 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4236873886, 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511628843, 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/066.out" 2024-09-19T09:21:32.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4260459292, 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511629829, 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/149.out" 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.741 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4280101435, 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630029, 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/249.out" 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: "damage_type": "backtrace", 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 4280643230, 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 1099511630979, 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: "path": "/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/732.out" 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:32.742 INFO:teuthology.orchestra.run.smithi046.stdout:] 2024-09-19T09:21:33.937 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:21:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:34 smithi046 ceph-mon[31203]: pgmap v437: 97 pgs: 97 active+clean; 36 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 609 op/s 2024-09-19T09:21:34.231 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:34 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:21:34.253 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:34.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:34 smithi115 ceph-mon[35055]: pgmap v437: 97 pgs: 97 active+clean; 36 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 609 op/s 2024-09-19T09:21:34.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:34 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:21:34.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:34 smithi099 ceph-mon[35256]: pgmap v437: 97 pgs: 97 active+clean; 36 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.0 MiB/s wr, 609 op/s 2024-09-19T09:21:34.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:34 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:21:34.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.740+0000 7f46fb54b640 1 -- 172.21.15.46:0/490780800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074f40 msgr2=0x7f46f410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.740+0000 7f46fb54b640 1 --2- 172.21.15.46:0/490780800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074f40 0x7f46f410de70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009900 tx=0x7f46e802a480 comp rx=0 tx=0).stop 2024-09-19T09:21:34.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 -- 172.21.15.46:0/490780800 shutdown_connections 2024-09-19T09:21:34.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 --2- 172.21.15.46:0/490780800 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074f40 0x7f46f410de70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 --2- 172.21.15.46:0/490780800 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 0x7f46f4110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 --2- 172.21.15.46:0/490780800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46f4074620 0x7f46f4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 -- 172.21.15.46:0/490780800 >> 172.21.15.46:0/490780800 conn(0x7f46f40fd8b0 msgr2=0x7f46f40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 -- 172.21.15.46:0/490780800 shutdown_connections 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 -- 172.21.15.46:0/490780800 wait complete. 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 Processor -- start 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.741+0000 7f46fb54b640 1 -- start start 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46fb54b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 0x7f46f419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46fb54b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46f4074f40 0x7f46f419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46fb54b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 0x7f46f419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46fb54b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4114130 con 0x7f46f4074620 2024-09-19T09:21:34.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46fb54b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f46f4113fb0 con 0x7f46f4074f40 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46fb54b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41142b0 con 0x7f46f410e3b0 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 0x7f46f419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 0x7f46f419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36714/0 (socket says 172.21.15.46:36714) 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 -- 172.21.15.46:0/2575858580 learned_addr learned my addr 172.21.15.46:0/2575858580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 0x7f46f419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 -- 172.21.15.46:0/2575858580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 msgr2=0x7f46f419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 0x7f46f419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 -- 172.21.15.46:0/2575858580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46f4074f40 msgr2=0x7f46f419ab90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46f4074f40 0x7f46f419ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 -- 172.21.15.46:0/2575858580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f419f600 con 0x7f46f4074620 2024-09-19T09:21:34.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 0x7f46f419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.742+0000 7f46f92e7640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 0x7f46f419a650 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e9f0 tx=0x7f46e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.743+0000 7f46f27fc640 1 -- 172.21.15.46:0/2575858580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e400cd80 con 0x7f46f4074620 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.743+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f419f8f0 con 0x7f46f4074620 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.743+0000 7f46f27fc640 1 -- 172.21.15.46:0/2575858580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46e4010910 con 0x7f46f4074620 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.743+0000 7f46f27fc640 1 -- 172.21.15.46:0/2575858580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40188f0 con 0x7f46f4074620 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.743+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f41a71d0 con 0x7f46f4074620 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 Processor -- start 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 -- start start 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46f27fc640 1 -- 172.21.15.46:0/2575858580 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f46e4010ac0 con 0x7f46f4074620 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d52a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a483cb82f0 con 0x55a483d5d370 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a483c5fcf0 con 0x55a483d53b40 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46fd924740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a483cb42b0 con 0x55a483d525d0 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46f9ae8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46f9ae8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d52090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52440/0 (socket says 172.21.15.46:52440) 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46f9ae8640 1 -- 172.21.15.46:0/905105859 learned_addr learned my addr 172.21.15.46:0/905105859 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.746+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f92e7640 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d52a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f9ae8640 1 -- 172.21.15.46:0/905105859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 msgr2=0x55a483d52a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d52a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f9ae8640 1 -- 172.21.15.46:0/905105859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 msgr2=0x55a483d5f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d5f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f9ae8640 1 -- 172.21.15.46:0/905105859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a483c443a0 con 0x55a483d53b40 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d52090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46ec011790 tx=0x7f46ec011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78014afed9c1ee0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f27fc640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46dc0a3240 0x7f46dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46db7fe640 1 -- 172.21.15.46:0/905105859 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec003c30 con 0x55a483d53b40 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46db7fe640 1 -- 172.21.15.46:0/905105859 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46ec00fe80 con 0x55a483d53b40 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46db7fe640 1 -- 172.21.15.46:0/905105859 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0193e0 con 0x55a483d53b40 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.747+0000 7f46f92e7640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46dc0a3240 0x7f46dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46f27fc640 1 -- 172.21.15.46:0/2575858580 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f46e40cfd90 con 0x7f46f4074620 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 -- 172.21.15.46:0/905105859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 msgr2=0x55a483d52090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46f92e7640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46dc0a3240 0x7f46dc0a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cdc30 tx=0x7f46e401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d52090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46ec011790 tx=0x7f46ec011c50 comp rx=0 tx=0).stop 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 -- 172.21.15.46:0/905105859 shutdown_connections 2024-09-19T09:21:34.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d5f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d52a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 --2- 172.21.15.46:0/905105859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d52090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.748+0000 7f46fd924740 1 -- 172.21.15.46:0/905105859 >> 172.21.15.46:0/905105859 conn(0x55a483d1b310 msgr2=0x55a483d4ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.749+0000 7f46fd924740 1 -- 172.21.15.46:0/905105859 shutdown_connections 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.749+0000 7f46fd924740 1 -- 172.21.15.46:0/905105859 wait complete. 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.749+0000 7f46fd924740 1 -- start start 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.749+0000 7f46fd924740 1 Processor -- start 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.749+0000 7f46fd924740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d5cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46fd924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d5a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46fd924740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d5a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46fd924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a483d60070 con 0x55a483d53b40 2024-09-19T09:21:34.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46fd924740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a483c73060 con 0x55a483d5d370 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46fd924740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a483d601f0 con 0x55a483d525d0 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46fd924740 10 client.0 _ll_register_callbacks cb 0x55a4839c68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f8ae6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d5a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f8ae6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d5a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36730/0 (socket says 172.21.15.46:36730) 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f8ae6640 1 -- 172.21.15.46:0/439286568 learned_addr learned my addr 172.21.15.46:0/439286568 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d5cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d5a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 -- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 msgr2=0x55a483d5a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d5a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 -- 172.21.15.46:0/439286568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 msgr2=0x55a483d5a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d5a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 -- 172.21.15.46:0/439286568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a483a293c0 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d5a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d5cd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009fd0 tx=0x7f46ec0045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a0d450c722c098c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.750+0000 7f46d8ff9640 1 -- 172.21.15.46:0/439286568 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ec02d060 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46d8ff9640 1 -- 172.21.15.46:0/439286568 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f46ec011260 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a483cc5860 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46d8ff9640 1 -- 172.21.15.46:0/439286568 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f46ec003a30 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 10 client.25825 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a483d6baf0 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46d8ff9640 1 -- 172.21.15.46:0/439286568 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a483cc5860 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46d8ff9640 1 -- 172.21.15.46:0/439286568 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f46ec018070 con 0x55a483d525d0 2024-09-19T09:21:34.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 10 client.25825 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 10 client.25825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 20 client.25825 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483d6cfb0 0x55a483d6f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 4 client.25825 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.751+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a483cbfd70 con 0x55a483d6cfb0 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.752+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483d6cfb0 0x55a483d6f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.752+0000 7f46d8ff9640 10 client.25825 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.752+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483d6cfb0 0x55a483d6f3a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a71a579cc88a6a3 server_cookie=4a8ff38f373fe76a in_seq=0 out_seq=0 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46d8ff9640 1 -- 172.21.15.46:0/439286568 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a483cbfd70 con 0x55a483d6cfb0 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46d8ff9640 10 client.25825 handle_command_reply: tid=0 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 client.25825 shutdown 2024-09-19T09:21:34.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 msgr2=0x55a483d5cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d5cd50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009fd0 tx=0x7f46ec0045c0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 shutdown_connections 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483d6cfb0 0x55a483d6f3a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d5a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46d8ff9640 0 client.25825 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d5a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 --2- 172.21.15.46:0/439286568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d5cd50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 >> 172.21.15.46:0/439286568 conn(0x55a483d1b310 msgr2=0x55a483d54960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 shutdown_connections 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 1 -- 172.21.15.46:0/439286568 wait complete. 2024-09-19T09:21:34.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.753+0000 7f46fd924740 20 client.25825 trim_cache size 0 max 16384 2024-09-19T09:21:34.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 Processor -- start 2024-09-19T09:21:34.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 -- start start 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d69310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d55660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41af870 con 0x55a483d53b40 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41b1470 con 0x55a483d5d370 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46fd924740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41aff40 con 0x55a483d525d0 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.770+0000 7f46f8ae6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d55120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36740/0 (socket says 172.21.15.46:36740) 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 -- 172.21.15.46:0/2659400219 learned_addr learned my addr 172.21.15.46:0/2659400219 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:34.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d55660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d69310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 -- 172.21.15.46:0/2659400219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 msgr2=0x55a483d69310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d69310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 -- 172.21.15.46:0/2659400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 msgr2=0x55a483d55660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d55660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 -- 172.21.15.46:0/2659400219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a483d58550 con 0x55a483d53b40 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d69310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d55120 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009850 tx=0x7f46e80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e5be97e2f18d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46daffd640 1 -- 172.21.15.46:0/2659400219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8049070 con 0x55a483d53b40 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46daffd640 1 -- 172.21.15.46:0/2659400219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46e8005040 con 0x55a483d53b40 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.771+0000 7f46daffd640 1 -- 172.21.15.46:0/2659400219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8035040 con 0x55a483d53b40 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 -- 172.21.15.46:0/2659400219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 msgr2=0x55a483d55120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d55120 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009850 tx=0x7f46e80058d0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 -- 172.21.15.46:0/2659400219 shutdown_connections 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d53b40 0x55a483d55120 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d5d370 0x55a483d55660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 --2- 172.21.15.46:0/2659400219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d69310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 -- 172.21.15.46:0/2659400219 >> 172.21.15.46:0/2659400219 conn(0x55a483d1b310 msgr2=0x55a483d49a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 -- 172.21.15.46:0/2659400219 shutdown_connections 2024-09-19T09:21:34.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.772+0000 7f46fd924740 1 -- 172.21.15.46:0/2659400219 wait complete. 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 -- start start 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 Processor -- start 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d65800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d65d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d60dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41b0da0 con 0x55a483d5d370 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41b0610 con 0x55a483d53b40 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f46f41ad850 con 0x55a483d525d0 2024-09-19T09:21:34.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.773+0000 7f46fd924740 10 client.0 _ll_register_callbacks cb 0x7f46e4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d65d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d65d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:52482/0 (socket says 172.21.15.46:52482) 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 -- 172.21.15.46:0/120733595 learned_addr learned my addr 172.21.15.46:0/120733595 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d60dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d65800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 -- 172.21.15.46:0/120733595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 msgr2=0x55a483d65800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d65800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 -- 172.21.15.46:0/120733595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 msgr2=0x55a483d60dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d60dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 -- 172.21.15.46:0/120733595 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a483d61600 con 0x55a483d53b40 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d65800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46f8ae6640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d65d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46e8006010 tx=0x7f46e8004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4352b6f149878051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:34.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46d8ff9640 1 -- 172.21.15.46:0/120733595 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8055030 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46d8ff9640 1 -- 172.21.15.46:0/120733595 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f46e80054c0 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.774+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e8005040 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46d8ff9640 1 -- 172.21.15.46:0/120733595 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f46e8035030 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 10 client.25886 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a483dd7740 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46d8ff9640 1 -- 172.21.15.46:0/120733595 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46e8005040 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46d8ff9640 1 -- 172.21.15.46:0/120733595 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f46e804e450 con 0x55a483d53b40 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 10 client.25886 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 10 client.25886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:34.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 20 client.25886 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483dd7fa0 0x55a483dda3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 4 client.25886 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a483c3c170 con 0x55a483dd7fa0 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.775+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483dd7fa0 0x55a483dda3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46f9ae8640 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483dd7fa0 0x55a483dda3c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2daa84db75476c17 server_cookie=20a8d71356dd894a in_seq=0 out_seq=0 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46d8ff9640 10 client.25886 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46d8ff9640 1 -- 172.21.15.46:0/120733595 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a483c3c170 con 0x55a483dd7fa0 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46d8ff9640 10 client.25886 handle_command_reply: tid=0 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 client.25886 shutdown 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 msgr2=0x55a483d65d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d65d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f46e8006010 tx=0x7f46e8004400 comp rx=0 tx=0).stop 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 shutdown_connections 2024-09-19T09:21:34.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a483dd7fa0 0x55a483dda3c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a483d5d370 0x55a483d60dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a483d53b40 0x55a483d65d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46d8ff9640 0 client.25886 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 --2- 172.21.15.46:0/120733595 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a483d525d0 0x55a483d65800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.776+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 >> 172.21.15.46:0/120733595 conn(0x55a483d1b310 msgr2=0x55a483d4d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 shutdown_connections 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fd924740 1 -- 172.21.15.46:0/120733595 wait complete. 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fd924740 20 client.25886 trim_cache size 0 max 16384 2024-09-19T09:21:34.782 INFO:teuthology.orchestra.run.smithi046.stdout:[] 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46dc0a3240 msgr2=0x7f46dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46dc0a3240 0x7f46dc0a5700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cdc30 tx=0x7f46e401f000 comp rx=0 tx=0).stop 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 msgr2=0x7f46f419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 0x7f46f419a650 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e9f0 tx=0x7f46e400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 shutdown_connections 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f46dc0a3240 0x7f46dc0a5700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f46f410e3b0 0x7f46f419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46f4074f40 0x7f46f419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 --2- 172.21.15.46:0/2575858580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46f4074620 0x7f46f419a650 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.777+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 >> 172.21.15.46:0/2575858580 conn(0x7f46f40fd8b0 msgr2=0x7f46f40ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.778+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 shutdown_connections 2024-09-19T09:21:34.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:34.778+0000 7f46fb54b640 1 -- 172.21.15.46:0/2575858580 wait complete. 2024-09-19T09:21:35.394 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:21:35.394 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:21:35.395 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:21:35.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:21:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:21:35.460 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:21:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:21:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:21:35.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:21:35.780 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 1983547, 'ino': 1099511631059, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/012.out'}, {'damage_type': 'backtrace', 'id': 19838189, 'ino': 1099511629536, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/005.out'}, {'damage_type': 'backtrace', 'id': 27736094, 'ino': 1099511630849, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/667.out'}, {'damage_type': 'backtrace', 'id': 55579749, 'ino': 1099511631884, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/303.out'}, {'damage_type': 'backtrace', 'id': 75079669, 'ino': 1099511631554, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/139.out'}, {'damage_type': 'backtrace', 'id': 80894984, 'ino': 1099511628669, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_writev_overlap.c'}, {'damage_type': 'backtrace', 'id': 99956931, 'ino': 1099511629973, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/221.out'}, {'damage_type': 'backtrace', 'id': 104799713, 'ino': 1099511630015, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/242.out'}, {'damage_type': 'backtrace', 'id': 108094591, 'ino': 1099511628686, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/unwritten_mmap.c'}, {'damage_type': 'backtrace', 'id': 109985901, 'ino': 1099511628533, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/attr_replace_test.c'}, {'damage_type': 'backtrace', 'id': 112950574, 'ino': 1099511630497, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/491.out'}, {'damage_type': 'backtrace', 'id': 116489588, 'ino': 1099511629873, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/171.out'}, {'damage_type': 'backtrace', 'id': 141774585, 'ino': 1099511629331, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/310.out'}, {'damage_type': 'backtrace', 'id': 168404998, 'ino': 1099511630273, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/379.out'}, {'damage_type': 'backtrace', 'id': 184470098, 'ino': 1099511629937, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/203.out'}, {'damage_type': 'backtrace', 'id': 192691359, 'ino': 1099511628397, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/filter'}, {'damage_type': 'backtrace', 'id': 209644946, 'ino': 1099511630637, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/561.out'}, {'damage_type': 'backtrace', 'id': 220867639, 'ino': 1099511628536, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/bulkstat_null_ocount.c'}, {'damage_type': 'backtrace', 'id': 221262267, 'ino': 1099511630161, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/315.out'}, {'damage_type': 'backtrace', 'id': 222002741, 'ino': 1099511631786, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/254.out'}, {'damage_type': 'backtrace', 'id': 225177787, 'ino': 1099511629763, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/116.out'}, {'damage_type': 'backtrace', 'id': 238784638, 'ino': 1099511628379, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/casefold'}, {'damage_type': 'backtrace', 'id': 239565162, 'ino': 1099511629149, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/219.out'}, {'damage_type': 'backtrace', 'id': 271351254, 'ino': 1099511628554, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/dumpfile'}, {'damage_type': 'backtrace', 'id': 284054586, 'ino': 1099511630863, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/674.out'}, {'damage_type': 'backtrace', 'id': 299232895, 'ino': 1099511628557, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ext4_resize.c'}, {'damage_type': 'backtrace', 'id': 312857639, 'ino': 1099511630761, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/623.out'}, {'damage_type': 'backtrace', 'id': 318266561, 'ino': 1099511629977, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/223.out'}, {'damage_type': 'backtrace', 'id': 338163677, 'ino': 1099511629031, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/160.out'}, {'damage_type': 'backtrace', 'id': 338228844, 'ino': 1099511630465, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/475.out'}, {'damage_type': 'backtrace', 'id': 338266926, 'ino': 1099511630451, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/468.out'}, {'damage_type': 'backtrace', 'id': 347909656, 'ino': 1099511629865, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/167.out'}, {'damage_type': 'backtrace', 'id': 350117864, 'ino': 1099511629275, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/282.out'}, {'damage_type': 'backtrace', 'id': 357315213, 'ino': 1099511630721, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/603.out'}, {'damage_type': 'backtrace', 'id': 363116514, 'ino': 1099511630031, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/250.out'}, {'damage_type': 'backtrace', 'id': 370291669, 'ino': 1099511631026, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/Makefile'}, {'damage_type': 'backtrace', 'id': 370421175, 'ino': 1099511630331, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/408.out'}, {'damage_type': 'backtrace', 'id': 383633379, 'ino': 1099511628409, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/perf'}, {'damage_type': 'backtrace', 'id': 390938337, 'ino': 1099511628638, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/soak_duration.awk'}, {'damage_type': 'backtrace', 'id': 404982829, 'ino': 1099511630769, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/627.out'}, {'damage_type': 'backtrace', 'id': 406733866, 'ino': 1099511630965, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/725.out'}, {'damage_type': 'backtrace', 'id': 409732069, 'ino': 1099511631606, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/165.out'}, {'damage_type': 'backtrace', 'id': 416419209, 'ino': 1099511628416, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/renameat2'}, {'damage_type': 'backtrace', 'id': 417352871, 'ino': 1099511628589, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/Makefile'}, {'damage_type': 'backtrace', 'id': 441500513, 'ino': 1099511629985, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/227.out'}, {'damage_type': 'backtrace', 'id': 480222235, 'ino': 1099511628576, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/genhashnames.c'}, {'damage_type': 'backtrace', 'id': 487654192, 'ino': 1099511629602, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/037.out'}, {'damage_type': 'backtrace', 'id': 489834051, 'ino': 1099511630971, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/728.out'}, {'damage_type': 'backtrace', 'id': 493388877, 'ino': 1099511629083, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/186.out'}, {'damage_type': 'backtrace', 'id': 497743489, 'ino': 1099511629959, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/214.out'}, {'damage_type': 'backtrace', 'id': 510091610, 'ino': 1099511629564, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/019.out'}, {'damage_type': 'backtrace', 'id': 512829905, 'ino': 1099511630453, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/469.out'}, {'damage_type': 'backtrace', 'id': 514621320, 'ino': 1099511630981, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/733.out'}, {'damage_type': 'backtrace', 'id': 523357984, 'ino': 1099511628646, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_attr_corruption.c'}, {'damage_type': 'backtrace', 'id': 531205742, 'ino': 1099511631826, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/274.out'}, {'damage_type': 'backtrace', 'id': 532612844, 'ino': 1099511630397, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/441.out'}, {'damage_type': 'backtrace', 'id': 539929666, 'ino': 1099511630669, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/577.out'}, {'damage_type': 'backtrace', 'id': 550271684, 'ino': 1099511629925, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/197.out'}, {'damage_type': 'backtrace', 'id': 556322172, 'ino': 1099511630681, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/583.out'}, {'damage_type': 'backtrace', 'id': 558536176, 'ino': 1099511631822, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/272.out'}, {'damage_type': 'backtrace', 'id': 561189804, 'ino': 1099511630501, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/493.out'}, {'damage_type': 'backtrace', 'id': 562389348, 'ino': 1099511628418, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/report'}, {'damage_type': 'backtrace', 'id': 590144422, 'ino': 1099511632004, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/363.out'}, {'damage_type': 'backtrace', 'id': 595239024, 'ino': 1099511629909, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/189.out'}, {'damage_type': 'backtrace', 'id': 602007310, 'ino': 1099511631718, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/220.out'}, {'damage_type': 'backtrace', 'id': 619975474, 'ino': 1099511628384, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdelay'}, {'damage_type': 'backtrace', 'id': 621410423, 'ino': 1099511630519, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/502.out'}, {'damage_type': 'backtrace', 'id': 646771724, 'ino': 1099511628385, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmdust'}, {'damage_type': 'backtrace', 'id': 663060340, 'ino': 1099511630977, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/731.out'}, {'damage_type': 'backtrace', 'id': 663301136, 'ino': 1099511629637, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/053.out'}, {'damage_type': 'backtrace', 'id': 682048764, 'ino': 1099511628406, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/nfs'}, {'damage_type': 'backtrace', 'id': 685676934, 'ino': 1099511631440, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/082.out'}, {'damage_type': 'backtrace', 'id': 688311461, 'ino': 1099511631357, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/041.out'}, {'damage_type': 'backtrace', 'id': 696305321, 'ino': 1099511630797, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/641.out'}, {'damage_type': 'backtrace', 'id': 722317105, 'ino': 1099511630773, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/629.out'}, {'damage_type': 'backtrace', 'id': 724295791, 'ino': 1099511630249, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/359.out'}, {'damage_type': 'backtrace', 'id': 734249863, 'ino': 1099511631399, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/062.out'}, {'damage_type': 'backtrace', 'id': 734944770, 'ino': 1099511630747, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/616.out'}, {'damage_type': 'backtrace', 'id': 739171275, 'ino': 1099511629590, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/032.out'}, {'damage_type': 'backtrace', 'id': 746866100, 'ino': 1099511628391, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dump'}, {'damage_type': 'backtrace', 'id': 748228988, 'ino': 1099511629556, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/015.out'}, {'damage_type': 'backtrace', 'id': 757069720, 'ino': 1099511630245, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/357.out'}, {'damage_type': 'backtrace', 'id': 758336564, 'ino': 1099511628564, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill.c'}, {'damage_type': 'backtrace', 'id': 760802624, 'ino': 1099511630715, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/600.out'}, {'damage_type': 'backtrace', 'id': 765048017, 'ino': 1099511630989, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/737.out'}, {'damage_type': 'backtrace', 'id': 778542999, 'ino': 1099511628593, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/replay-log.c'}, {'damage_type': 'backtrace', 'id': 823502865, 'ino': 1099511630967, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/726.out'}, {'damage_type': 'backtrace', 'id': 843931402, 'ino': 1099511628380, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ceph'}, {'damage_type': 'backtrace', 'id': 856361955, 'ino': 1099511628659, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_holes.c'}, {'damage_type': 'backtrace', 'id': 865830011, 'ino': 1099511630489, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/487.out'}, {'damage_type': 'backtrace', 'id': 875919047, 'ino': 1099511630259, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/372.out'}, {'damage_type': 'backtrace', 'id': 882279643, 'ino': 1099511628695, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.c'}, {'damage_type': 'backtrace', 'id': 919523326, 'ino': 1099511628587, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/locktest.c'}, {'damage_type': 'backtrace', 'id': 931637004, 'ino': 1099511629877, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/173.out'}, {'damage_type': 'backtrace', 'id': 952982373, 'ino': 1099511628388, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmhugedisk'}, {'damage_type': 'backtrace', 'id': 990447275, 'ino': 1099511630283, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/384.out'}, {'damage_type': 'backtrace', 'id': 997351303, 'ino': 1099511631073, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/019.out'}, {'damage_type': 'backtrace', 'id': 1030797390, 'ino': 1099511628693, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.c'}, {'damage_type': 'backtrace', 'id': 1056178712, 'ino': 1099511629143, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/216.out'}, {'damage_type': 'backtrace', 'id': 1065599427, 'ino': 1099511628823, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/056.out'}, {'damage_type': 'backtrace', 'id': 1075423902, 'ino': 1099511629879, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/174.out'}, {'damage_type': 'backtrace', 'id': 1086644848, 'ino': 1099511628392, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/encrypt'}, {'damage_type': 'backtrace', 'id': 1086658406, 'ino': 1099511629931, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/200.out'}, {'damage_type': 'backtrace', 'id': 1091637130, 'ino': 1099511630409, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/447.out'}, {'damage_type': 'backtrace', 'id': 1103375133, 'ino': 1099511630209, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/339.out'}, {'damage_type': 'backtrace', 'id': 1103704478, 'ino': 1099511630815, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/650.out'}, {'damage_type': 'backtrace', 'id': 1123559618, 'ino': 1099511630999, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/742.out'}, {'damage_type': 'backtrace', 'id': 1134527994, 'ino': 1099511629753, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/111.out'}, {'damage_type': 'backtrace', 'id': 1164355864, 'ino': 1099511628651, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_type.c'}, {'damage_type': 'backtrace', 'id': 1179765924, 'ino': 1099511628420, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/test_names'}, {'damage_type': 'backtrace', 'id': 1181693759, 'ino': 1099511631474, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/099.out'}, {'damage_type': 'backtrace', 'id': 1184353721, 'ino': 1099511629009, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/149.out'}, {'damage_type': 'backtrace', 'id': 1186268215, 'ino': 1099511630171, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/320.out'}, {'damage_type': 'backtrace', 'id': 1188722914, 'ino': 1099511628606, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/multi_open_unlink.c'}, {'damage_type': 'backtrace', 'id': 1191043540, 'ino': 1099511630907, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/696.out'}, {'damage_type': 'backtrace', 'id': 1204130103, 'ino': 1099511629580, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/027.out'}, {'damage_type': 'backtrace', 'id': 1208468288, 'ino': 1099511630319, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/402.out'}, {'damage_type': 'backtrace', 'id': 1208972594, 'ino': 1099511630795, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/640.out'}, {'damage_type': 'backtrace', 'id': 1220063801, 'ino': 1099511629823, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/146.out'}, {'damage_type': 'backtrace', 'id': 1225147956, 'ino': 1099511630729, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/607.out'}, {'damage_type': 'backtrace', 'id': 1237101106, 'ino': 1099511630237, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/353.out'}, {'damage_type': 'backtrace', 'id': 1240378851, 'ino': 1099511630855, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/670.out'}, {'damage_type': 'backtrace', 'id': 1249615543, 'ino': 1099511629528, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/001.out'}, {'damage_type': 'backtrace', 'id': 1255961814, 'ino': 1099511629871, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/170.out'}, {'damage_type': 'backtrace', 'id': 1262782086, 'ino': 1099511629616, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/044.out'}, {'damage_type': 'backtrace', 'id': 1291538456, 'ino': 1099511630333, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/409.out'}, {'damage_type': 'backtrace', 'id': 1301634369, 'ino': 1099511631123, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/044.out'}, {'damage_type': 'backtrace', 'id': 1306118241, 'ino': 1099511631045, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/005.out'}, {'damage_type': 'backtrace', 'id': 1307884033, 'ino': 1099511631994, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/358.out'}, {'damage_type': 'backtrace', 'id': 1308850662, 'ino': 1099511628642, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/stat_test.c'}, {'damage_type': 'backtrace', 'id': 1317279834, 'ino': 1099511628688, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/uring_read_fault.c'}, {'damage_type': 'backtrace', 'id': 1319011582, 'ino': 1099511628855, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/072.out'}, {'damage_type': 'backtrace', 'id': 1321839878, 'ino': 1099511628825, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/057.out'}, {'damage_type': 'backtrace', 'id': 1332468305, 'ino': 1099511628422, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/ubifs'}, {'damage_type': 'backtrace', 'id': 1340201755, 'ino': 1099511630477, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/481.out'}, {'damage_type': 'backtrace', 'id': 1360138572, 'ino': 1099511630485, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/485.out'}, {'damage_type': 'backtrace', 'id': 1368186127, 'ino': 1099511629907, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/188.out'}, {'damage_type': 'backtrace', 'id': 1370476372, 'ino': 1099511630963, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/724.out'}, {'damage_type': 'backtrace', 'id': 1387307529, 'ino': 1099511628401, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/inject'}, {'damage_type': 'backtrace', 'id': 1391832795, 'ino': 1099511630613, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/549.out'}, {'damage_type': 'backtrace', 'id': 1402080432, 'ino': 1099511628407, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/overlay'}, {'damage_type': 'backtrace', 'id': 1404096808, 'ino': 1099511630887, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/686.out'}, {'damage_type': 'backtrace', 'id': 1416428707, 'ino': 1099511630325, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/405.out'}, {'damage_type': 'backtrace', 'id': 1416746839, 'ino': 1099511631950, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/336.out'}, {'damage_type': 'backtrace', 'id': 1416948964, 'ino': 1099511631367, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/046.out'}, {'damage_type': 'backtrace', 'id': 1435611889, 'ino': 1099511629939, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/204.out'}, {'damage_type': 'backtrace', 'id': 1456412189, 'ino': 1099511629685, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/077.out'}, {'damage_type': 'backtrace', 'id': 1468240204, 'ino': 1099511630737, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/611.out'}, {'damage_type': 'backtrace', 'id': 1469971580, 'ino': 1099511628405, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/module'}, {'damage_type': 'backtrace', 'id': 1474142479, 'ino': 1099511630125, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/297.out'}, {'damage_type': 'backtrace', 'id': 1499087472, 'ino': 1099511630843, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/664.out'}, {'damage_type': 'backtrace', 'id': 1511832485, 'ino': 1099511630131, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/300.out'}, {'damage_type': 'backtrace', 'id': 1543100628, 'ino': 1099511629633, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/051.out'}, {'damage_type': 'backtrace', 'id': 1552074991, 'ino': 1099511628701, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.c'}, {'damage_type': 'backtrace', 'id': 1559169606, 'ino': 1099511631307, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/018.out'}, {'damage_type': 'backtrace', 'id': 1574309715, 'ino': 1099511628386, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmerror'}, {'damage_type': 'backtrace', 'id': 1574718284, 'ino': 1099511629897, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/183.out'}, {'damage_type': 'backtrace', 'id': 1583069073, 'ino': 1099511629957, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/213.out'}, {'damage_type': 'backtrace', 'id': 1583180307, 'ino': 1099511628529, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/allocstale.c'}, {'damage_type': 'backtrace', 'id': 1594131034, 'ino': 1099511630145, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/307.out'}, {'damage_type': 'backtrace', 'id': 1599567956, 'ino': 1099511630265, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/375.out'}, {'damage_type': 'backtrace', 'id': 1614448407, 'ino': 1099511629665, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/067.out'}, {'damage_type': 'backtrace', 'id': 1632960615, 'ino': 1099511628544, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/detached_mounts_propagation.c'}, {'damage_type': 'backtrace', 'id': 1647699225, 'ino': 1099511629799, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/134.out'}, {'damage_type': 'backtrace', 'id': 1672679893, 'ino': 1099511630961, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/723.out'}, {'damage_type': 'backtrace', 'id': 1684402052, 'ino': 1099511629831, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/150.out'}, {'damage_type': 'backtrace', 'id': 1686155182, 'ino': 1099511628628, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/readdir-while-renames.c'}, {'damage_type': 'backtrace', 'id': 1700626619, 'ino': 1099511629027, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/158.out'}, {'damage_type': 'backtrace', 'id': 1705745906, 'ino': 1099511629679, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/074.out'}, {'damage_type': 'backtrace', 'id': 1707376115, 'ino': 1099511630691, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/588.out'}, {'damage_type': 'backtrace', 'id': 1716435710, 'ino': 1099511628699, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.c'}, {'damage_type': 'backtrace', 'id': 1719320476, 'ino': 1099511630037, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/253.out'}, {'damage_type': 'backtrace', 'id': 1721058772, 'ino': 1099511628592, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.h'}, {'damage_type': 'backtrace', 'id': 1722840599, 'ino': 1099511632092, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/407.out'}, {'damage_type': 'backtrace', 'id': 1768935222, 'ino': 1099511628376, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/Makefile'}, {'damage_type': 'backtrace', 'id': 1804384767, 'ino': 1099511629775, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/122.out'}, {'damage_type': 'backtrace', 'id': 1817515167, 'ino': 1099511630839, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/662.out'}, {'damage_type': 'backtrace', 'id': 1826912121, 'ino': 1099511631748, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/235.out'}, {'damage_type': 'backtrace', 'id': 1835222004, 'ino': 1099511630783, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/634.out'}, {'damage_type': 'backtrace', 'id': 1836863931, 'ino': 1099511628531, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/append_writer.c'}, {'damage_type': 'backtrace', 'id': 1849938364, 'ino': 1099511629769, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/119.out'}, {'damage_type': 'backtrace', 'id': 1891957629, 'ino': 1099511628596, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/lstat64.c'}, {'damage_type': 'backtrace', 'id': 1910163955, 'ino': 1099511629643, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/056.out'}, {'damage_type': 'backtrace', 'id': 1921860884, 'ino': 1099511628419, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/scsi_debug'}, {'damage_type': 'backtrace', 'id': 1923071891, 'ino': 1099511628696, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/idmapped-mounts.h'}, {'damage_type': 'backtrace', 'id': 1953009123, 'ino': 1099511630269, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/377.out'}, {'damage_type': 'backtrace', 'id': 1955899982, 'ino': 1099511628555, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/e4compact.c'}, {'damage_type': 'backtrace', 'id': 1956754611, 'ino': 1099511630187, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/328.out'}, {'damage_type': 'backtrace', 'id': 1969493373, 'ino': 1099511631630, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/177.out'}, {'damage_type': 'backtrace', 'id': 2000956501, 'ino': 1099511628400, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/gcov'}, {'damage_type': 'backtrace', 'id': 2009223975, 'ino': 1099511630309, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/397.out'}, {'damage_type': 'backtrace', 'id': 2009723709, 'ino': 1099511629703, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/086.out'}, {'damage_type': 'backtrace', 'id': 2014976651, 'ino': 1099511629608, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/040.out'}, {'damage_type': 'backtrace', 'id': 2022033190, 'ino': 1099511628765, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/027.out'}, {'damage_type': 'backtrace', 'id': 2023941185, 'ino': 1099511630611, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/548.out'}, {'damage_type': 'backtrace', 'id': 2052205790, 'ino': 1099511630109, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/289.out'}, {'damage_type': 'backtrace', 'id': 2068221099, 'ino': 1099511631043, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/004.out'}, {'damage_type': 'backtrace', 'id': 2071571390, 'ino': 1099511628381, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/cgroup2'}, {'damage_type': 'backtrace', 'id': 2077345114, 'ino': 1099511630733, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/609.out'}, {'damage_type': 'backtrace', 'id': 2084533883, 'ino': 1099511628697, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/missing.h'}, {'damage_type': 'backtrace', 'id': 2085220381, 'ino': 1099511628821, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/055.out'}, {'damage_type': 'backtrace', 'id': 2109866677, 'ino': 1099511630353, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/419.out'}, {'damage_type': 'backtrace', 'id': 2113687892, 'ino': 1099511629045, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/167.out'}, {'damage_type': 'backtrace', 'id': 2122518499, 'ino': 1099511631810, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/266.out'}, {'damage_type': 'backtrace', 'id': 2126804815, 'ino': 1099511630947, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/716.out'}, {'damage_type': 'backtrace', 'id': 2152805971, 'ino': 1099511628702, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/utils.h'}, {'damage_type': 'backtrace', 'id': 2155872055, 'ino': 1099511628691, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs'}, {'damage_type': 'backtrace', 'id': 2164488162, 'ino': 1099511630739, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/612.out'}, {'damage_type': 'backtrace', 'id': 2231998967, 'ino': 1099511630841, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/663.out'}, {'damage_type': 'backtrace', 'id': 2235938705, 'ino': 1099511630969, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/727.out'}, {'damage_type': 'backtrace', 'id': 2239256749, 'ino': 1099511628389, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmlogwrites'}, {'damage_type': 'backtrace', 'id': 2243973620, 'ino': 1099511630919, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/702.out'}, {'damage_type': 'backtrace', 'id': 2265553640, 'ino': 1099511632010, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/366.out'}, {'damage_type': 'backtrace', 'id': 2268006249, 'ino': 1099511631067, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/016.out'}, {'damage_type': 'backtrace', 'id': 2293791490, 'ino': 1099511631285, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/007.out'}, {'damage_type': 'backtrace', 'id': 2301139406, 'ino': 1099511630481, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/483.out'}, {'damage_type': 'backtrace', 'id': 2309899984, 'ino': 1099511630301, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/393.out'}, {'damage_type': 'backtrace', 'id': 2320338881, 'ino': 1099511629935, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/202.out'}, {'damage_type': 'backtrace', 'id': 2336659578, 'ino': 1099511628649, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_dir_offset.c'}, {'damage_type': 'backtrace', 'id': 2356529969, 'ino': 1099511629765, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/117.out'}, {'damage_type': 'backtrace', 'id': 2364572655, 'ino': 1099511630133, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/301.out'}, {'damage_type': 'backtrace', 'id': 2373922691, 'ino': 1099511631343, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/034.out'}, {'damage_type': 'backtrace', 'id': 2385925699, 'ino': 1099511630121, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/295.out'}, {'damage_type': 'backtrace', 'id': 2395250002, 'ino': 1099511630339, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/412.out'}, {'damage_type': 'backtrace', 'id': 2399788975, 'ino': 1099511629903, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/186.out'}, {'damage_type': 'backtrace', 'id': 2415015983, 'ino': 1099511630175, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/322.out'}, {'damage_type': 'backtrace', 'id': 2427168867, 'ino': 1099511630785, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/635.out'}, {'damage_type': 'backtrace', 'id': 2437297714, 'ino': 1099511631550, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/137.out'}, {'damage_type': 'backtrace', 'id': 2442497547, 'ino': 1099511630023, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/246.out'}, {'damage_type': 'backtrace', 'id': 2477389048, 'ino': 1099511631181, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/073.out'}, {'damage_type': 'backtrace', 'id': 2492120688, 'ino': 1099511629568, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/021.out'}, {'damage_type': 'backtrace', 'id': 2524580111, 'ino': 1099511629713, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/091.out'}, {'damage_type': 'backtrace', 'id': 2559842733, 'ino': 1099511629761, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/115.out'}, {'damage_type': 'backtrace', 'id': 2562889429, 'ino': 1099511629725, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/097.out'}, {'damage_type': 'backtrace', 'id': 2574168154, 'ino': 1099511630909, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/697.out'}, {'damage_type': 'backtrace', 'id': 2583027034, 'ino': 1099511628987, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/138.out'}, {'damage_type': 'backtrace', 'id': 2587393327, 'ino': 1099511630601, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/543.out'}, {'damage_type': 'backtrace', 'id': 2588116803, 'ino': 1099511629653, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/061.out'}, {'damage_type': 'backtrace', 'id': 2590342404, 'ino': 1099511629989, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/229.out'}, {'damage_type': 'backtrace', 'id': 2621512045, 'ino': 1099511628583, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/holetest.c'}, {'damage_type': 'backtrace', 'id': 2651021073, 'ino': 1099511629267, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/278.out'}, {'damage_type': 'backtrace', 'id': 2657816492, 'ino': 1099511629759, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/114.out'}, {'damage_type': 'backtrace', 'id': 2658489631, 'ino': 1099511628584, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/iopat.c'}, {'damage_type': 'backtrace', 'id': 2663825435, 'ino': 1099511630107, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/288.out'}, {'damage_type': 'backtrace', 'id': 2667779742, 'ino': 1099511630147, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/308.out'}, {'damage_type': 'backtrace', 'id': 2711134032, 'ino': 1099511630911, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/698.out'}, {'damage_type': 'backtrace', 'id': 2712458223, 'ino': 1099511628395, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/fail_make_request'}, {'damage_type': 'backtrace', 'id': 2716162314, 'ino': 1099511628590, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/SOURCE'}, {'damage_type': 'backtrace', 'id': 2727753992, 'ino': 1099511628897, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/093.out'}, {'damage_type': 'backtrace', 'id': 2734677956, 'ino': 1099511630627, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/556.out'}, {'damage_type': 'backtrace', 'id': 2736796736, 'ino': 1099511630047, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/258.out'}, {'damage_type': 'backtrace', 'id': 2750680699, 'ino': 1099511628648, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_create_short_dirs.c'}, {'damage_type': 'backtrace', 'id': 2766537628, 'ino': 1099511628704, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.h'}, {'damage_type': 'backtrace', 'id': 2772243787, 'ino': 1099511630105, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/287.out'}, {'damage_type': 'backtrace', 'id': 2778339860, 'ino': 1099511629295, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/292.out'}, {'damage_type': 'backtrace', 'id': 2779341746, 'ino': 1099511631395, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/060.out'}, {'damage_type': 'backtrace', 'id': 2782396524, 'ino': 1099511629705, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/087.out'}, {'damage_type': 'backtrace', 'id': 2808476785, 'ino': 1099511628580, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/godown.c'}, {'damage_type': 'backtrace', 'id': 2809795931, 'ino': 1099511629919, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/194.out'}, {'damage_type': 'backtrace', 'id': 2819222284, 'ino': 1099511630575, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/530.out'}, {'damage_type': 'backtrace', 'id': 2828948808, 'ino': 1099511629825, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/147.out'}, {'damage_type': 'backtrace', 'id': 2840504770, 'ino': 1099511630525, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/505.out'}, {'damage_type': 'backtrace', 'id': 2843174967, 'ino': 1099511630057, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/263.out'}, {'damage_type': 'backtrace', 'id': 2864364168, 'ino': 1099511631814, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/268.out'}, {'damage_type': 'backtrace', 'id': 2880217543, 'ino': 1099511629699, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/084.out'}, {'damage_type': 'backtrace', 'id': 2917004806, 'ino': 1099511632038, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/380.out'}, {'damage_type': 'backtrace', 'id': 2924575085, 'ino': 1099511631057, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/011.out'}, {'damage_type': 'backtrace', 'id': 2926071852, 'ino': 1099511630771, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/628.out'}, {'damage_type': 'backtrace', 'id': 2942697113, 'ino': 1099511630629, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/557.out'}, {'damage_type': 'backtrace', 'id': 2947845526, 'ino': 1099511629739, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/104.out'}, {'damage_type': 'backtrace', 'id': 2952930204, 'ino': 1099511629530, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/002.out'}, {'damage_type': 'backtrace', 'id': 2962595167, 'ino': 1099511630297, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/391.out'}, {'damage_type': 'backtrace', 'id': 2991307201, 'ino': 1099511628656, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_futimens.c'}, {'damage_type': 'backtrace', 'id': 2998733845, 'ino': 1099511631189, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/077.out'}, {'damage_type': 'backtrace', 'id': 3002296244, 'ino': 1099511628415, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/reflink'}, {'damage_type': 'backtrace', 'id': 3021482085, 'ino': 1099511629681, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/075.out'}, {'damage_type': 'backtrace', 'id': 3029424191, 'ino': 1099511631518, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/121.out'}, {'damage_type': 'backtrace', 'id': 3032029894, 'ino': 1099511630379, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/432.out'}, {'damage_type': 'backtrace', 'id': 3038298043, 'ino': 1099511630755, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/620.out'}, {'damage_type': 'backtrace', 'id': 3072529580, 'ino': 1099511628658, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_getcwd.c'}, {'damage_type': 'backtrace', 'id': 3074226872, 'ino': 1099511629927, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/198.out'}, {'damage_type': 'backtrace', 'id': 3088091869, 'ino': 1099511631546, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/135.out'}, {'damage_type': 'backtrace', 'id': 3094701751, 'ino': 1099511630563, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/524.out'}, {'damage_type': 'backtrace', 'id': 3102748301, 'ino': 1099511631345, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/035.out'}, {'damage_type': 'backtrace', 'id': 3108055917, 'ino': 1099511631436, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/080.out'}, {'damage_type': 'backtrace', 'id': 3120254084, 'ino': 1099511631844, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/283.out'}, {'damage_type': 'backtrace', 'id': 3129641954, 'ino': 1099511629079, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/184.out'}, {'damage_type': 'backtrace', 'id': 3163403449, 'ino': 1099511631598, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/161.out'}, {'damage_type': 'backtrace', 'id': 3185077336, 'ino': 1099511631758, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/240.out'}, {'damage_type': 'backtrace', 'id': 3198931476, 'ino': 1099511628543, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/deduperace.c'}, {'damage_type': 'backtrace', 'id': 3218159413, 'ino': 1099511630605, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/545.out'}, {'damage_type': 'backtrace', 'id': 3256864680, 'ino': 1099511631041, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/003.out'}, {'damage_type': 'backtrace', 'id': 3257541485, 'ino': 1099511630959, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/722.out'}, {'damage_type': 'backtrace', 'id': 3264362997, 'ino': 1099511630307, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/396.out'}, {'damage_type': 'backtrace', 'id': 3265505246, 'ino': 1099511629159, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/224.out'}, {'damage_type': 'backtrace', 'id': 3283304622, 'ino': 1099511630789, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/637.out'}, {'damage_type': 'backtrace', 'id': 3285354893, 'ino': 1099511631243, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/117.out'}, {'damage_type': 'backtrace', 'id': 3326050394, 'ino': 1099511630483, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/484.out'}, {'damage_type': 'backtrace', 'id': 3332629391, 'ino': 1099511631163, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/064.out'}, {'damage_type': 'backtrace', 'id': 3367123445, 'ino': 1099511629995, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/232.out'}, {'damage_type': 'backtrace', 'id': 3392219660, 'ino': 1099511628602, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mkswap.c'}, {'damage_type': 'backtrace', 'id': 3421105633, 'ino': 1099511628621, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/popattr.py'}, {'damage_type': 'backtrace', 'id': 3440179750, 'ino': 1099511628404, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/metadump'}, {'damage_type': 'backtrace', 'id': 3464532869, 'ino': 1099511630777, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/631.out'}, {'damage_type': 'backtrace', 'id': 3469009900, 'ino': 1099511628402, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/locktest'}, {'damage_type': 'backtrace', 'id': 3475765983, 'ino': 1099511629661, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/065.out'}, {'damage_type': 'backtrace', 'id': 3485652998, 'ino': 1099511630017, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/243.out'}, {'damage_type': 'backtrace', 'id': 3486168358, 'ino': 1099511630289, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/387.out'}, {'damage_type': 'backtrace', 'id': 3527522091, 'ino': 1099511629813, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/141.out'}, {'damage_type': 'backtrace', 'id': 3531317800, 'ino': 1099511631958, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/340.out'}, {'damage_type': 'backtrace', 'id': 3535577167, 'ino': 1099511628703, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/vfstest.c'}, {'damage_type': 'backtrace', 'id': 3546869363, 'ino': 1099511629913, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/191.out'}, {'damage_type': 'backtrace', 'id': 3560695342, 'ino': 1099511628591, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes/log-writes.c'}, {'damage_type': 'backtrace', 'id': 3561457802, 'ino': 1099511631456, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/090.out'}, {'damage_type': 'backtrace', 'id': 3566097524, 'ino': 1099511630019, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/244.out'}, {'damage_type': 'backtrace', 'id': 3579193413, 'ino': 1099511630051, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/260.out'}, {'damage_type': 'backtrace', 'id': 3612876037, 'ino': 1099511630257, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/371.out'}, {'damage_type': 'backtrace', 'id': 3637600621, 'ino': 1099511629779, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/124.out'}, {'damage_type': 'backtrace', 'id': 3638180700, 'ino': 1099511630901, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/693.out'}, {'damage_type': 'backtrace', 'id': 3639160923, 'ino': 1099511631774, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/248.out'}, {'damage_type': 'backtrace', 'id': 3645342993, 'ino': 1099511629949, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/209.out'}, {'damage_type': 'backtrace', 'id': 3655161277, 'ino': 1099511630457, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/471.out'}, {'damage_type': 'backtrace', 'id': 3664806460, 'ino': 1099511628837, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/063.out'}, {'damage_type': 'backtrace', 'id': 3679169902, 'ino': 1099511629631, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.xfsquota'}, {'damage_type': 'backtrace', 'id': 3696214357, 'ino': 1099511629987, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/228.out'}, {'damage_type': 'backtrace', 'id': 3707241464, 'ino': 1099511631780, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/251.out'}, {'damage_type': 'backtrace', 'id': 3730737836, 'ino': 1099511630463, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/474.out'}, {'damage_type': 'backtrace', 'id': 3737922019, 'ino': 1099511628662, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_cow_memory_failure.c'}, {'damage_type': 'backtrace', 'id': 3741156188, 'ino': 1099511628387, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmflakey'}, {'damage_type': 'backtrace', 'id': 3760082736, 'ino': 1099511631776, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/249.out'}, {'damage_type': 'backtrace', 'id': 3773555599, 'ino': 1099511631538, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/131.out'}, {'damage_type': 'backtrace', 'id': 3773740104, 'ino': 1099511629689, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/079.out'}, {'damage_type': 'backtrace', 'id': 3786100262, 'ino': 1099511629657, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/063.out'}, {'damage_type': 'backtrace', 'id': 3790297542, 'ino': 1099511630569, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/527.out'}, {'damage_type': 'backtrace', 'id': 3796426126, 'ino': 1099511631361, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/043.out'}, {'damage_type': 'backtrace', 'id': 3801375767, 'ino': 1099511630437, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/461.out'}, {'damage_type': 'backtrace', 'id': 3803179246, 'ino': 1099511628425, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/zoned'}, {'damage_type': 'backtrace', 'id': 3804350804, 'ino': 1099511631411, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/068.out'}, {'damage_type': 'backtrace', 'id': 3814741785, 'ino': 1099511629945, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/207.out'}, {'damage_type': 'backtrace', 'id': 3823797240, 'ino': 1099511628947, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/118.out'}, {'damage_type': 'backtrace', 'id': 3828858109, 'ino': 1099511631738, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/230.out'}, {'damage_type': 'backtrace', 'id': 3857400796, 'ino': 1099511629941, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/205.out'}, {'damage_type': 'backtrace', 'id': 3858469361, 'ino': 1099511628603, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmap-rw-fault.c'}, {'damage_type': 'backtrace', 'id': 3873403394, 'ino': 1099511629961, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/215.out'}, {'damage_type': 'backtrace', 'id': 3881489172, 'ino': 1099511631566, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/145.out'}, {'damage_type': 'backtrace', 'id': 3901560625, 'ino': 1099511628665, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_fallocate.c'}, {'damage_type': 'backtrace', 'id': 3923688910, 'ino': 1099511629693, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/081.out'}, {'damage_type': 'backtrace', 'id': 3942536228, 'ino': 1099511628694, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/btrfs-idmapped-mounts.h'}, {'damage_type': 'backtrace', 'id': 3947077325, 'ino': 1099511628632, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/rewinddir-test.c'}, {'damage_type': 'backtrace', 'id': 3966929318, 'ino': 1099511631976, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/349.out'}, {'damage_type': 'backtrace', 'id': 3997530035, 'ino': 1099511628664, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/t_mmap_dio.c'}, {'damage_type': 'backtrace', 'id': 4021930359, 'ino': 1099511630865, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/675.out'}, {'damage_type': 'backtrace', 'id': 4035530804, 'ino': 1099511630725, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/605.out'}, {'damage_type': 'backtrace', 'id': 4048063029, 'ino': 1099511631051, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/008.out'}, {'damage_type': 'backtrace', 'id': 4067277756, 'ino': 1099511628705, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/writemod.c'}, {'damage_type': 'backtrace', 'id': 4071930612, 'ino': 1099511631534, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/129.out'}, {'damage_type': 'backtrace', 'id': 4074717111, 'ino': 1099511628565, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/fill2.c'}, {'damage_type': 'backtrace', 'id': 4075605839, 'ino': 1099511630585, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/535.out'}, {'damage_type': 'backtrace', 'id': 4087399099, 'ino': 1099511628620, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/permname.c'}, {'damage_type': 'backtrace', 'id': 4092389739, 'ino': 1099511631768, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/245.out'}, {'damage_type': 'backtrace', 'id': 4102593370, 'ino': 1099511629727, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/098.out'}, {'damage_type': 'backtrace', 'id': 4112179752, 'ino': 1099511628698, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/mount-idmapped.c'}, {'damage_type': 'backtrace', 'id': 4122013487, 'ino': 1099511629751, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/110.out'}, {'damage_type': 'backtrace', 'id': 4135969111, 'ino': 1099511629757, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/113.out'}, {'damage_type': 'backtrace', 'id': 4140767556, 'ino': 1099511630239, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/354.out'}, {'damage_type': 'backtrace', 'id': 4152476035, 'ino': 1099511629867, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/168.out'}, {'damage_type': 'backtrace', 'id': 4154575273, 'ino': 1099511628411, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/preamble'}, {'damage_type': 'backtrace', 'id': 4160524048, 'ino': 1099511630695, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/590.out'}, {'damage_type': 'backtrace', 'id': 4165313233, 'ino': 1099511628588, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes'}, {'damage_type': 'backtrace', 'id': 4179296692, 'ino': 1099511628575, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/ftrunc.c'}, {'damage_type': 'backtrace', 'id': 4179446753, 'ino': 1099511629677, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/073.out'}, {'damage_type': 'backtrace', 'id': 4188891051, 'ino': 1099511630803, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/644.out'}, {'damage_type': 'backtrace', 'id': 4192904266, 'ino': 1099511630199, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/334.out'}, {'damage_type': 'backtrace', 'id': 4196606126, 'ino': 1099511628605, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/mmapcat.c'}, {'damage_type': 'backtrace', 'id': 4203622148, 'ino': 1099511629755, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/112.out'}, {'damage_type': 'backtrace', 'id': 4203999690, 'ino': 1099511630049, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/259.out'}, {'damage_type': 'backtrace', 'id': 4217823709, 'ino': 1099511628700, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/vfs/tmpfs-idmapped-mounts.h'}, {'damage_type': 'backtrace', 'id': 4220545250, 'ino': 1099511630241, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/355.out'}, {'damage_type': 'backtrace', 'id': 4229020158, 'ino': 1099511630487, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/486.out'}, {'damage_type': 'backtrace', 'id': 4229356429, 'ino': 1099511629291, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/290.out'}, {'damage_type': 'backtrace', 'id': 4231743754, 'ino': 1099511628394, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/f2fs'}, {'damage_type': 'backtrace', 'id': 4239658667, 'ino': 1099511631942, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/xfs/332.out'}, {'damage_type': 'backtrace', 'id': 4264598217, 'ino': 1099511629965, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/217.out'}, {'damage_type': 'backtrace', 'id': 4273099177, 'ino': 1099511628417, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/repair'}, {'damage_type': 'backtrace', 'id': 4273543800, 'ino': 1099511630157, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/313.out'}, {'damage_type': 'backtrace', 'id': 4278994028, 'ino': 1099511628737, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/013.out'}, {'damage_type': 'backtrace', 'id': 4285533103, 'ino': 1099511628390, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/common/dmthin'}, {'damage_type': 'backtrace', 'id': 4293441296, 'ino': 1099511630561, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/523.out'}] 2024-09-19T09:21:35.781 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 5272566, 'ino': 1099511630779, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/632.out'}, {'damage_type': 'backtrace', 'id': 15193193, 'ino': 1099511629562, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/018.out'}, {'damage_type': 'backtrace', 'id': 15977392, 'ino': 1099511630221, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/345.out'}, {'damage_type': 'backtrace', 'id': 20253063, 'ino': 1099511630731, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/608.out'}, {'damage_type': 'backtrace', 'id': 43133393, 'ino': 1099511630369, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/427.out'}, {'damage_type': 'backtrace', 'id': 56135428, 'ino': 1099511630061, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/265.out'}, {'damage_type': 'backtrace', 'id': 56817432, 'ino': 1099511630583, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/534.out'}, {'damage_type': 'backtrace', 'id': 107045497, 'ino': 1099511630749, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/617.out'}, {'damage_type': 'backtrace', 'id': 120477680, 'ino': 1099511629881, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/175.out'}, {'damage_type': 'backtrace', 'id': 135309858, 'ino': 1099511629572, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/023.out'}, {'damage_type': 'backtrace', 'id': 143465802, 'ino': 1099511629671, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/070.out'}, {'damage_type': 'backtrace', 'id': 187427172, 'ino': 1099511630059, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/264.out'}, {'damage_type': 'backtrace', 'id': 273829265, 'ino': 1099511630825, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/655.out'}, {'damage_type': 'backtrace', 'id': 302850292, 'ino': 1099511630883, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/684.out'}, {'damage_type': 'backtrace', 'id': 305297490, 'ino': 1099511630389, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/437.out'}, {'damage_type': 'backtrace', 'id': 325239466, 'ino': 1099511630355, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/420.out'}, {'damage_type': 'backtrace', 'id': 333550571, 'ino': 1099511629546, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/010.out'}, {'damage_type': 'backtrace', 'id': 339438652, 'ino': 1099511630851, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/668.out'}, {'damage_type': 'backtrace', 'id': 379393809, 'ino': 1099511629771, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/120.out'}, {'damage_type': 'backtrace', 'id': 384986679, 'ino': 1099511630215, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/342.out'}, {'damage_type': 'backtrace', 'id': 435030259, 'ino': 1099511629629, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.out.default'}, {'damage_type': 'backtrace', 'id': 461565409, 'ino': 1099511629606, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/039.out'}, {'damage_type': 'backtrace', 'id': 466587738, 'ino': 1099511630227, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/348.out'}, {'damage_type': 'backtrace', 'id': 486067843, 'ino': 1099511630311, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/398.out'}, {'damage_type': 'backtrace', 'id': 486647470, 'ino': 1099511629624, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/048.out'}, {'damage_type': 'backtrace', 'id': 524804733, 'ino': 1099511630799, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/642.out'}, {'damage_type': 'backtrace', 'id': 538591013, 'ino': 1099511630565, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/525.out'}, {'damage_type': 'backtrace', 'id': 549529177, 'ino': 1099511629845, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/157.out'}, {'damage_type': 'backtrace', 'id': 601117410, 'ino': 1099511629971, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/220.out'}, {'damage_type': 'backtrace', 'id': 635342108, 'ino': 1099511629618, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/045.out'}, {'damage_type': 'backtrace', 'id': 644323606, 'ino': 1099511631217, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/104.out'}, {'damage_type': 'backtrace', 'id': 709666250, 'ino': 1099511630693, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/589.out'}, {'damage_type': 'backtrace', 'id': 735145238, 'ino': 1099511630593, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/539.out'}, {'damage_type': 'backtrace', 'id': 755443807, 'ino': 1099511630163, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/316.out'}, {'damage_type': 'backtrace', 'id': 769099802, 'ino': 1099511630075, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/272.out'}, {'damage_type': 'backtrace', 'id': 775883418, 'ino': 1099511630093, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/281.out'}, {'damage_type': 'backtrace', 'id': 782563466, 'ino': 1099511630327, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/406.out'}, {'damage_type': 'backtrace', 'id': 792780911, 'ino': 1099511630041, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/255.out'}, {'damage_type': 'backtrace', 'id': 805819317, 'ino': 1099511630203, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/336.out'}, {'damage_type': 'backtrace', 'id': 874547242, 'ino': 1099511630673, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/579.out'}, {'damage_type': 'backtrace', 'id': 928654731, 'ino': 1099511629614, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/043.out'}, {'damage_type': 'backtrace', 'id': 958341057, 'ino': 1099511630103, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/286.out'}, {'damage_type': 'backtrace', 'id': 1001641764, 'ino': 1099511630507, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/496.out'}, {'damage_type': 'backtrace', 'id': 1014586350, 'ino': 1099511630009, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/239.out'}, {'damage_type': 'backtrace', 'id': 1024056761, 'ino': 1099511630713, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/599.out'}, {'damage_type': 'backtrace', 'id': 1037558251, 'ino': 1099511629795, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/132.out'}, {'damage_type': 'backtrace', 'id': 1039146765, 'ino': 1099511630661, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/573.out'}, {'damage_type': 'backtrace', 'id': 1070414955, 'ino': 1099511630927, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/706.out'}, {'damage_type': 'backtrace', 'id': 1123237179, 'ino': 1099511630491, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/488.out'}, {'damage_type': 'backtrace', 'id': 1154852048, 'ino': 1099511629554, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/014.out'}, {'damage_type': 'backtrace', 'id': 1154935697, 'ino': 1099511630643, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/564.out'}, {'damage_type': 'backtrace', 'id': 1162413968, 'ino': 1099511629735, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/102.out'}, {'damage_type': 'backtrace', 'id': 1213062158, 'ino': 1099511631099, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/032.out'}, {'damage_type': 'backtrace', 'id': 1217042723, 'ino': 1099511630399, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/442.out'}, {'damage_type': 'backtrace', 'id': 1235801617, 'ino': 1099511630515, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/500.out'}, {'damage_type': 'backtrace', 'id': 1276293721, 'ino': 1099511630707, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/596.out'}, {'damage_type': 'backtrace', 'id': 1282449922, 'ino': 1099511630281, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/383.out'}, {'damage_type': 'backtrace', 'id': 1294092255, 'ino': 1099511629663, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/066.out'}, {'damage_type': 'backtrace', 'id': 1295720407, 'ino': 1099511630617, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/551.out'}, {'damage_type': 'backtrace', 'id': 1329489522, 'ino': 1099511630043, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/256.out'}, {'damage_type': 'backtrace', 'id': 1333360026, 'ino': 1099511630137, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/303.out'}, {'damage_type': 'backtrace', 'id': 1354828550, 'ino': 1099511630787, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/636.out'}, {'damage_type': 'backtrace', 'id': 1380337364, 'ino': 1099511629610, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/041.out'}, {'damage_type': 'backtrace', 'id': 1384398284, 'ino': 1099511630579, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/532.out'}, {'damage_type': 'backtrace', 'id': 1451435723, 'ino': 1099511629544, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/009.out'}, {'damage_type': 'backtrace', 'id': 1456905148, 'ino': 1099511630623, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/554.out'}, {'damage_type': 'backtrace', 'id': 1459708677, 'ino': 1099511629855, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/162.out'}, {'damage_type': 'backtrace', 'id': 1493242195, 'ino': 1099511630675, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/580.out'}, {'damage_type': 'backtrace', 'id': 1496561418, 'ino': 1099511630159, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/314.out'}, {'damage_type': 'backtrace', 'id': 1547692019, 'ino': 1099511631185, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/075.out'}, {'damage_type': 'backtrace', 'id': 1587023566, 'ino': 1099511630401, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/443.out'}, {'damage_type': 'backtrace', 'id': 1589605043, 'ino': 1099511629659, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/064.out'}, {'damage_type': 'backtrace', 'id': 1630525487, 'ino': 1099511629887, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/178.out'}, {'damage_type': 'backtrace', 'id': 1637680827, 'ino': 1099511630687, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/586.out'}, {'damage_type': 'backtrace', 'id': 1642053707, 'ino': 1099511629801, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/135.out'}, {'damage_type': 'backtrace', 'id': 1644053511, 'ino': 1099511630073, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/271.out'}, {'damage_type': 'backtrace', 'id': 1662931795, 'ino': 1099511629815, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/142.out'}, {'damage_type': 'backtrace', 'id': 1673987826, 'ino': 1099511630595, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/540.out'}, {'damage_type': 'backtrace', 'id': 1692911079, 'ino': 1099511629791, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/130.out'}, {'damage_type': 'backtrace', 'id': 1717104460, 'ino': 1099511630431, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/458.out'}, {'damage_type': 'backtrace', 'id': 1720170155, 'ino': 1099511630375, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/430.out'}, {'damage_type': 'backtrace', 'id': 1777016053, 'ino': 1099511630535, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/510.out'}, {'damage_type': 'backtrace', 'id': 1777782961, 'ino': 1099511630653, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/569.out'}, {'damage_type': 'backtrace', 'id': 1790679340, 'ino': 1099511630597, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/541.out'}, {'damage_type': 'backtrace', 'id': 1798528871, 'ino': 1099511630385, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/435.out'}, {'damage_type': 'backtrace', 'id': 1821938259, 'ino': 1099511630349, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/417.out'}, {'damage_type': 'backtrace', 'id': 1825888641, 'ino': 1099511629863, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/166.out'}, {'damage_type': 'backtrace', 'id': 1833540723, 'ino': 1099511630925, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/705.out'}, {'damage_type': 'backtrace', 'id': 1839603824, 'ino': 1099511629789, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/129.out'}, {'damage_type': 'backtrace', 'id': 1852988753, 'ino': 1099511630791, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/638.out'}, {'damage_type': 'backtrace', 'id': 1897229503, 'ino': 1099511630011, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/240.out'}, {'damage_type': 'backtrace', 'id': 1970150274, 'ino': 1099511629981, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/225.out'}, {'damage_type': 'backtrace', 'id': 2009001246, 'ino': 1099511630341, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/413.out'}, {'damage_type': 'backtrace', 'id': 2035739104, 'ino': 1099511629620, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/046.out'}, {'damage_type': 'backtrace', 'id': 2037884418, 'ino': 1099511629921, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/195.out'}, {'damage_type': 'backtrace', 'id': 2054404471, 'ino': 1099511631153, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/059.out'}, {'damage_type': 'backtrace', 'id': 2075932554, 'ino': 1099511629731, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/100.out'}, {'damage_type': 'backtrace', 'id': 2079558974, 'ino': 1099511630587, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/536.out'}, {'damage_type': 'backtrace', 'id': 2096788082, 'ino': 1099511630845, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/665.out'}, {'damage_type': 'backtrace', 'id': 2101327168, 'ino': 1099511630467, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/476.out'}, {'damage_type': 'backtrace', 'id': 2127499046, 'ino': 1099511630539, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/512.out'}, {'damage_type': 'backtrace', 'id': 2237323456, 'ino': 1099511630549, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/517.out'}, {'damage_type': 'backtrace', 'id': 2254653839, 'ino': 1099511629538, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/006.out'}, {'damage_type': 'backtrace', 'id': 2260869094, 'ino': 1099511631135, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/050.out'}, {'damage_type': 'backtrace', 'id': 2287296717, 'ino': 1099511629707, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/088.out'}, {'damage_type': 'backtrace', 'id': 2297752912, 'ino': 1099511630441, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/463.out'}, {'damage_type': 'backtrace', 'id': 2323606464, 'ino': 1099511630997, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/741.out'}, {'damage_type': 'backtrace', 'id': 2354273059, 'ino': 1099511630045, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/257.out'}, {'damage_type': 'backtrace', 'id': 2375207768, 'ino': 1099511630207, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/338.out'}, {'damage_type': 'backtrace', 'id': 2379946297, 'ino': 1099511630422, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454'}, {'damage_type': 'backtrace', 'id': 2394001164, 'ino': 1099511630183, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/326.out'}, {'damage_type': 'backtrace', 'id': 2404166264, 'ino': 1099511630003, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/236.out'}, {'damage_type': 'backtrace', 'id': 2424469297, 'ino': 1099511629893, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/181.out'}, {'damage_type': 'backtrace', 'id': 2441217336, 'ino': 1099511630651, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/568.out'}, {'damage_type': 'backtrace', 'id': 2442830941, 'ino': 1099511630531, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/508.out'}, {'damage_type': 'backtrace', 'id': 2469326402, 'ino': 1099511631091, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/028.out'}, {'damage_type': 'backtrace', 'id': 2493425808, 'ino': 1099511630027, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/248.out'}, {'damage_type': 'backtrace', 'id': 2506387756, 'ino': 1099511630423, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/454.out'}, {'damage_type': 'backtrace', 'id': 2508282621, 'ino': 1099511630503, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/494.out'}, {'damage_type': 'backtrace', 'id': 2510579709, 'ino': 1099511631037, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/001.out'}, {'damage_type': 'backtrace', 'id': 2550783133, 'ino': 1099511629604, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/038.out'}, {'damage_type': 'backtrace', 'id': 2553489303, 'ino': 1099511630063, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/266.out'}, {'damage_type': 'backtrace', 'id': 2577427624, 'ino': 1099511630439, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/462.out'}, {'damage_type': 'backtrace', 'id': 2602394486, 'ino': 1099511630291, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/388.out'}, {'damage_type': 'backtrace', 'id': 2634813845, 'ino': 1099511630493, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/489.out'}, {'damage_type': 'backtrace', 'id': 2636517837, 'ino': 1099511629560, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/017.out'}, {'damage_type': 'backtrace', 'id': 2644648207, 'ino': 1099511630091, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/280.out'}, {'damage_type': 'backtrace', 'id': 2658707724, 'ino': 1099511629649, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/059.out'}, {'damage_type': 'backtrace', 'id': 2666491760, 'ino': 1099511629550, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/012.out'}, {'damage_type': 'backtrace', 'id': 2666890614, 'ino': 1099511630295, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/390.out'}, {'damage_type': 'backtrace', 'id': 2685020639, 'ino': 1099511629721, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/095.out'}, {'damage_type': 'backtrace', 'id': 2698730274, 'ino': 1099511631207, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/086.out'}, {'damage_type': 'backtrace', 'id': 2725549744, 'ino': 1099511629827, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/148.out'}, {'damage_type': 'backtrace', 'id': 2740571846, 'ino': 1099511630177, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/323.out'}, {'damage_type': 'backtrace', 'id': 2757478907, 'ino': 1099511630689, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/587.out'}, {'damage_type': 'backtrace', 'id': 2788851663, 'ino': 1099511629594, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/034.out'}, {'damage_type': 'backtrace', 'id': 2903274822, 'ino': 1099511631101, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/033.out'}, {'damage_type': 'backtrace', 'id': 2954635888, 'ino': 1099511630025, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/247.out'}, {'damage_type': 'backtrace', 'id': 2959279392, 'ino': 1099511630089, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/279.out'}, {'damage_type': 'backtrace', 'id': 2982809712, 'ino': 1099511630921, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/703.out'}, {'damage_type': 'backtrace', 'id': 3007976383, 'ino': 1099511629997, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/233.out'}, {'damage_type': 'backtrace', 'id': 3020506216, 'ino': 1099511630885, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/685.out'}, {'damage_type': 'backtrace', 'id': 3066523748, 'ino': 1099511629715, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/092.out'}, {'damage_type': 'backtrace', 'id': 3156322190, 'ino': 1099511630993, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/739.out'}, {'damage_type': 'backtrace', 'id': 3164288017, 'ino': 1099511630001, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/235.out'}, {'damage_type': 'backtrace', 'id': 3167039985, 'ino': 1099511629697, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/083.out'}, {'damage_type': 'backtrace', 'id': 3167118783, 'ino': 1099511629586, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/030.out'}, {'damage_type': 'backtrace', 'id': 3178020320, 'ino': 1099511630903, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/694.out'}, {'damage_type': 'backtrace', 'id': 3201438776, 'ino': 1099511630527, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/506.out'}, {'damage_type': 'backtrace', 'id': 3236609897, 'ino': 1099511629695, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/082.out'}, {'damage_type': 'backtrace', 'id': 3256173854, 'ino': 1099511630085, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/277.out'}, {'damage_type': 'backtrace', 'id': 3279335523, 'ino': 1099511629667, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/068.out'}, {'damage_type': 'backtrace', 'id': 3287427379, 'ino': 1099511630419, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/452.out'}, {'damage_type': 'backtrace', 'id': 3341734457, 'ino': 1099511630499, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/492.out'}, {'damage_type': 'backtrace', 'id': 3345942607, 'ino': 1099511629532, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/003.out'}, {'damage_type': 'backtrace', 'id': 3358649994, 'ino': 1099511630719, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/602.out'}, {'damage_type': 'backtrace', 'id': 3373204508, 'ino': 1099511630173, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/321.out'}, {'damage_type': 'backtrace', 'id': 3378149548, 'ino': 1099511630793, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/639.out'}, {'damage_type': 'backtrace', 'id': 3406090193, 'ino': 1099511630685, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/585.out'}, {'damage_type': 'backtrace', 'id': 3432166366, 'ino': 1099511629805, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/137.out'}, {'damage_type': 'backtrace', 'id': 3459148223, 'ino': 1099511630591, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/538.out'}, {'damage_type': 'backtrace', 'id': 3468397524, 'ino': 1099511629983, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/226.out'}, {'damage_type': 'backtrace', 'id': 3479109397, 'ino': 1099511629669, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/069.out'}, {'damage_type': 'backtrace', 'id': 3483316903, 'ino': 1099511630191, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/330.out'}, {'damage_type': 'backtrace', 'id': 3484268920, 'ino': 1099511629673, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/071.out'}, {'damage_type': 'backtrace', 'id': 3484561121, 'ino': 1099511630655, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/570.out'}, {'damage_type': 'backtrace', 'id': 3487265024, 'ino': 1099511630781, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/633.out'}, {'damage_type': 'backtrace', 'id': 3491627419, 'ino': 1099511629574, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/024.out'}, {'damage_type': 'backtrace', 'id': 3536051124, 'ino': 1099511630931, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/708.out'}, {'damage_type': 'backtrace', 'id': 3552979878, 'ino': 1099511631237, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/114.out'}, {'damage_type': 'backtrace', 'id': 3558995846, 'ino': 1099511630247, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/358.out'}, {'damage_type': 'backtrace', 'id': 3609690919, 'ino': 1099511629747, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/108.out'}, {'damage_type': 'backtrace', 'id': 3626282555, 'ino': 1099511630609, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/547.out'}, {'damage_type': 'backtrace', 'id': 3633108972, 'ino': 1099511629859, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/164.out'}, {'damage_type': 'backtrace', 'id': 3646069453, 'ino': 1099511629655, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/062.out'}, {'damage_type': 'backtrace', 'id': 3655101590, 'ino': 1099511629584, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/029.out'}, {'damage_type': 'backtrace', 'id': 3667052984, 'ino': 1099511630657, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/571.out'}, {'damage_type': 'backtrace', 'id': 3714985996, 'ino': 1099511630053, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/261.out'}, {'damage_type': 'backtrace', 'id': 3719601521, 'ino': 1099511630699, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/592.out'}, {'damage_type': 'backtrace', 'id': 3721062397, 'ino': 1099511629540, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/007.out'}, {'damage_type': 'backtrace', 'id': 3723481142, 'ino': 1099511630817, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/651.out'}, {'damage_type': 'backtrace', 'id': 3724290685, 'ino': 1099511630153, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/311.out'}, {'damage_type': 'backtrace', 'id': 3758294852, 'ino': 1099511629651, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/060.out'}, {'damage_type': 'backtrace', 'id': 3794464253, 'ino': 1099511630321, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/403.out'}, {'damage_type': 'backtrace', 'id': 3799086358, 'ino': 1099511630443, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/464.out'}, {'damage_type': 'backtrace', 'id': 3841424201, 'ino': 1099511630393, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/439.out'}, {'damage_type': 'backtrace', 'id': 3848757740, 'ino': 1099511630559, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/522.out'}, {'damage_type': 'backtrace', 'id': 3871634020, 'ino': 1099511630877, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/681.out'}, {'damage_type': 'backtrace', 'id': 3916650202, 'ino': 1099511630391, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/438.out'}, {'damage_type': 'backtrace', 'id': 3920926170, 'ino': 1099511629596, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.cfg'}, {'damage_type': 'backtrace', 'id': 3924445539, 'ino': 1099511629566, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/020.out'}, {'damage_type': 'backtrace', 'id': 3929708162, 'ino': 1099511630429, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/457.out'}, {'damage_type': 'backtrace', 'id': 3949771508, 'ino': 1099511629783, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/126.out'}, {'damage_type': 'backtrace', 'id': 3974867610, 'ino': 1099511630813, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/649.out'}, {'damage_type': 'backtrace', 'id': 3990063884, 'ino': 1099511630469, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/477.out'}, {'damage_type': 'backtrace', 'id': 4025557470, 'ino': 1099511630899, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/692.out'}, {'damage_type': 'backtrace', 'id': 4026945098, 'ino': 1099511630765, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/625.out'}, {'damage_type': 'backtrace', 'id': 4027945410, 'ino': 1099511630599, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/542.out'}, {'damage_type': 'backtrace', 'id': 4047512631, 'ino': 1099511630835, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/660.out'}, {'damage_type': 'backtrace', 'id': 4101856698, 'ino': 1099511630975, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/730.out'}, {'damage_type': 'backtrace', 'id': 4105453794, 'ino': 1099511629889, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/179.out'}, {'damage_type': 'backtrace', 'id': 4109904833, 'ino': 1099511630315, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/400.out'}, {'damage_type': 'backtrace', 'id': 4121180202, 'ino': 1099511630123, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/296.out'}, {'damage_type': 'backtrace', 'id': 4166645294, 'ino': 1099511630081, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/275.out'}, {'damage_type': 'backtrace', 'id': 4167627488, 'ino': 1099511630313, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/399.out'}, {'damage_type': 'backtrace', 'id': 4170543128, 'ino': 1099511629741, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/105.out'}, {'damage_type': 'backtrace', 'id': 4180039730, 'ino': 1099511629773, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/121.out'}, {'damage_type': 'backtrace', 'id': 4186765383, 'ino': 1099511630079, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/274.out'}, {'damage_type': 'backtrace', 'id': 4186770019, 'ino': 1099511630433, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/459.out'}, {'damage_type': 'backtrace', 'id': 4232527329, 'ino': 1099511629861, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/165.out'}, {'damage_type': 'backtrace', 'id': 4256839218, 'ino': 1099511630819, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/652.out'}, {'damage_type': 'backtrace', 'id': 4261486696, 'ino': 1099511629687, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/078.out'}, {'damage_type': 'backtrace', 'id': 4263795806, 'ino': 1099511630703, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/594.out'}, {'damage_type': 'backtrace', 'id': 4265458199, 'ino': 1099511630985, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/735.out'}, {'damage_type': 'backtrace', 'id': 4265923845, 'ino': 1099511630893, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/689.out'}, {'damage_type': 'backtrace', 'id': 4270057145, 'ino': 1099511630303, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/394.out'}] 2024-09-19T09:21:35.781 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 16286594, 'ino': 1099511629821, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/145.out'}, {'damage_type': 'backtrace', 'id': 19214237, 'ino': 1099511630759, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/622.out'}, {'damage_type': 'backtrace', 'id': 61161432, 'ino': 1099511631069, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/017.out'}, {'damage_type': 'backtrace', 'id': 84969230, 'ino': 1099511629885, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/177.out'}, {'damage_type': 'backtrace', 'id': 91768639, 'ino': 1099511631221, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/106.out'}, {'damage_type': 'backtrace', 'id': 94281492, 'ino': 1099511630021, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/245.out'}, {'damage_type': 'backtrace', 'id': 108276402, 'ino': 1099511628787, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/038.out'}, {'damage_type': 'backtrace', 'id': 124911620, 'ino': 1099511629600, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/036.out'}, {'damage_type': 'backtrace', 'id': 134677950, 'ino': 1099511630097, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/283.out'}, {'damage_type': 'backtrace', 'id': 142908021, 'ino': 1099511630875, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/680.out'}, {'damage_type': 'backtrace', 'id': 189494146, 'ino': 1099511629835, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/152.out'}, {'damage_type': 'backtrace', 'id': 191270614, 'ino': 1099511631121, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/043.out'}, {'damage_type': 'backtrace', 'id': 213486504, 'ino': 1099511628751, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/020.out'}, {'damage_type': 'backtrace', 'id': 215123352, 'ino': 1099511631065, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/015.out'}, {'damage_type': 'backtrace', 'id': 220688864, 'ino': 1099511629797, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/133.out'}, {'damage_type': 'backtrace', 'id': 237927763, 'ino': 1099511628715, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/002.out'}, {'damage_type': 'backtrace', 'id': 307560874, 'ino': 1099511630201, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/335.out'}, {'damage_type': 'backtrace', 'id': 316459016, 'ino': 1099511630647, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/566.out'}, {'damage_type': 'backtrace', 'id': 322232801, 'ino': 1099511630533, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/509.out'}, {'damage_type': 'backtrace', 'id': 364912909, 'ino': 1099511630225, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/347.out'}, {'damage_type': 'backtrace', 'id': 465739455, 'ino': 1099511630663, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/574.out'}, {'damage_type': 'backtrace', 'id': 480451713, 'ino': 1099511629691, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/080.out'}, {'damage_type': 'backtrace', 'id': 491501953, 'ino': 1099511631105, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/035.out'}, {'damage_type': 'backtrace', 'id': 492908795, 'ino': 1099511630035, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/252.out'}, {'damage_type': 'backtrace', 'id': 498374991, 'ino': 1099511631231, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/111.out'}, {'damage_type': 'backtrace', 'id': 512054557, 'ino': 1099511630113, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/291.out'}, {'damage_type': 'backtrace', 'id': 517662835, 'ino': 1099511629787, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/128.out'}, {'damage_type': 'backtrace', 'id': 542246437, 'ino': 1099511629711, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/090.out'}, {'damage_type': 'backtrace', 'id': 543782495, 'ino': 1099511629588, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/031.out'}, {'damage_type': 'backtrace', 'id': 572481226, 'ino': 1099511630387, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/436.out'}, {'damage_type': 'backtrace', 'id': 632344439, 'ino': 1099511631039, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/002.out'}, {'damage_type': 'backtrace', 'id': 653622159, 'ino': 1099511630645, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/565.out'}, {'damage_type': 'backtrace', 'id': 674475660, 'ino': 1099511631191, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/078.out'}, {'damage_type': 'backtrace', 'id': 697296428, 'ino': 1099511630149, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/309.out'}, {'damage_type': 'backtrace', 'id': 701470027, 'ino': 1099511629993, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/231.out'}, {'damage_type': 'backtrace', 'id': 724358175, 'ino': 1099511631244, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/Makefile'}, {'damage_type': 'backtrace', 'id': 725314304, 'ino': 1099511630305, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/395.out'}, {'damage_type': 'backtrace', 'id': 730875592, 'ino': 1099511631187, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/076.out'}, {'damage_type': 'backtrace', 'id': 738992230, 'ino': 1099511631103, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/034.out'}, {'damage_type': 'backtrace', 'id': 779218040, 'ino': 1099511630293, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/389.out'}, {'damage_type': 'backtrace', 'id': 805886072, 'ino': 1099511630383, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/434.out'}, {'damage_type': 'backtrace', 'id': 824405439, 'ino': 1099511628833, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/061.out'}, {'damage_type': 'backtrace', 'id': 855107067, 'ino': 1099511630889, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/687.out'}, {'damage_type': 'backtrace', 'id': 864783005, 'ino': 1099511631169, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/067.out'}, {'damage_type': 'backtrace', 'id': 874283677, 'ino': 1099511630197, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/333.out'}, {'damage_type': 'backtrace', 'id': 884971144, 'ino': 1099511631175, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/070.out'}, {'damage_type': 'backtrace', 'id': 890708334, 'ino': 1099511630285, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/385.out'}, {'damage_type': 'backtrace', 'id': 944747440, 'ino': 1099511629851, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/160.out'}, {'damage_type': 'backtrace', 'id': 979309073, 'ino': 1099511630805, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/645.out'}, {'damage_type': 'backtrace', 'id': 994141427, 'ino': 1099511629639, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/054.out'}, {'damage_type': 'backtrace', 'id': 1009360450, 'ino': 1099511630625, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/555.out'}, {'damage_type': 'backtrace', 'id': 1072487574, 'ino': 1099511631193, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/079.out'}, {'damage_type': 'backtrace', 'id': 1134005656, 'ino': 1099511629719, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/094.out'}, {'damage_type': 'backtrace', 'id': 1154594649, 'ino': 1099511629701, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/085.out'}, {'damage_type': 'backtrace', 'id': 1154921439, 'ino': 1099511630185, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/327.out'}, {'damage_type': 'backtrace', 'id': 1183709514, 'ino': 1099511630167, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/318.out'}, {'damage_type': 'backtrace', 'id': 1204687181, 'ino': 1099511630217, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/343.out'}, {'damage_type': 'backtrace', 'id': 1233349725, 'ino': 1099511630083, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/276.out'}, {'damage_type': 'backtrace', 'id': 1242756333, 'ino': 1099511630953, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/719.out'}, {'damage_type': 'backtrace', 'id': 1248759556, 'ino': 1099511628789, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/039.out'}, {'damage_type': 'backtrace', 'id': 1265415786, 'ino': 1099511629558, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/016.out'}, {'damage_type': 'backtrace', 'id': 1268310137, 'ino': 1099511631219, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/105.out'}, {'damage_type': 'backtrace', 'id': 1318758101, 'ino': 1099511629837, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/153.out'}, {'damage_type': 'backtrace', 'id': 1412871771, 'ino': 1099511630033, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/251.out'}, {'damage_type': 'backtrace', 'id': 1447865542, 'ino': 1099511630343, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/414.out'}, {'damage_type': 'backtrace', 'id': 1447871054, 'ino': 1099511628819, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/054.out'}, {'damage_type': 'backtrace', 'id': 1449569551, 'ino': 1099511631205, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/085.out'}, {'damage_type': 'backtrace', 'id': 1516049910, 'ino': 1099511630905, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/695.out'}, {'damage_type': 'backtrace', 'id': 1529181410, 'ino': 1099511630195, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/332.out'}, {'damage_type': 'backtrace', 'id': 1553324361, 'ino': 1099511629975, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/222.out'}, {'damage_type': 'backtrace', 'id': 1558632609, 'ino': 1099511629875, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/172.out'}, {'damage_type': 'backtrace', 'id': 1651743700, 'ino': 1099511630711, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/598.out'}, {'damage_type': 'backtrace', 'id': 1664871953, 'ino': 1099511630741, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/613.out'}, {'damage_type': 'backtrace', 'id': 1681522488, 'ino': 1099511631081, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/023.out'}, {'damage_type': 'backtrace', 'id': 1688338165, 'ino': 1099511630659, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/572.out'}, {'damage_type': 'backtrace', 'id': 1691483254, 'ino': 1099511630821, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/653.out'}, {'damage_type': 'backtrace', 'id': 1705123986, 'ino': 1099511629626, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/049.out'}, {'damage_type': 'backtrace', 'id': 1748930558, 'ino': 1099511628783, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/036.out'}, {'damage_type': 'backtrace', 'id': 1776097099, 'ino': 1099511631211, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/101.out'}, {'damage_type': 'backtrace', 'id': 1788164586, 'ino': 1099511630853, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/669.out'}, {'damage_type': 'backtrace', 'id': 1788768016, 'ino': 1099511630727, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/606.out'}, {'damage_type': 'backtrace', 'id': 1788936472, 'ino': 1099511631235, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/113.out'}, {'damage_type': 'backtrace', 'id': 1800301516, 'ino': 1099511631093, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/029.out'}, {'damage_type': 'backtrace', 'id': 1854605627, 'ino': 1099511629819, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/144.out'}, {'damage_type': 'backtrace', 'id': 1856769573, 'ino': 1099511630357, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/421.out'}, {'damage_type': 'backtrace', 'id': 1865105247, 'ino': 1099511630523, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/504.out'}, {'damage_type': 'backtrace', 'id': 1885815494, 'ino': 1099511631239, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/115.out'}, {'damage_type': 'backtrace', 'id': 1899998164, 'ino': 1099511631077, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/021.out'}, {'damage_type': 'backtrace', 'id': 1918221504, 'ino': 1099511629817, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/143.out'}, {'damage_type': 'backtrace', 'id': 1925875487, 'ino': 1099511631151, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/058.out'}, {'damage_type': 'backtrace', 'id': 1926470649, 'ino': 1099511630067, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/268.out'}, {'damage_type': 'backtrace', 'id': 1956454230, 'ino': 1099511631215, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/103.out'}, {'damage_type': 'backtrace', 'id': 1959723229, 'ino': 1099511628847, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/068.out'}, {'damage_type': 'backtrace', 'id': 1959730297, 'ino': 1099511630763, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/624.out'}, {'damage_type': 'backtrace', 'id': 1967205804, 'ino': 1099511631225, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/108.out'}, {'damage_type': 'backtrace', 'id': 1989657538, 'ino': 1099511631229, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/110.out'}, {'damage_type': 'backtrace', 'id': 2022048555, 'ino': 1099511630479, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/482.out'}, {'damage_type': 'backtrace', 'id': 2036182818, 'ino': 1099511630807, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/646.out'}, {'damage_type': 'backtrace', 'id': 2038122888, 'ino': 1099511631083, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/024.out'}, {'damage_type': 'backtrace', 'id': 2039748186, 'ino': 1099511630219, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/344.out'}, {'damage_type': 'backtrace', 'id': 2041802457, 'ino': 1099511630809, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/647.out'}, {'damage_type': 'backtrace', 'id': 2066858522, 'ino': 1099511630709, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/597.out'}, {'damage_type': 'backtrace', 'id': 2076413841, 'ino': 1099511630505, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/495.out'}, {'damage_type': 'backtrace', 'id': 2096226505, 'ino': 1099511630555, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/520.out'}, {'damage_type': 'backtrace', 'id': 2112748642, 'ino': 1099511631109, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/037.out'}, {'damage_type': 'backtrace', 'id': 2126493549, 'ino': 1099511630667, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/576.out'}, {'damage_type': 'backtrace', 'id': 2190971025, 'ino': 1099511631085, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/025.out'}, {'damage_type': 'backtrace', 'id': 2215261592, 'ino': 1099511631171, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/068.out'}, {'damage_type': 'backtrace', 'id': 2248375542, 'ino': 1099511628835, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/062.out'}, {'damage_type': 'backtrace', 'id': 2248866893, 'ino': 1099511630619, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/552.out'}, {'damage_type': 'backtrace', 'id': 2257513595, 'ino': 1099511629853, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/161.out'}, {'damage_type': 'backtrace', 'id': 2257794286, 'ino': 1099511630615, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/550.out'}, {'damage_type': 'backtrace', 'id': 2265432795, 'ino': 1099511630751, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/618.out'}, {'damage_type': 'backtrace', 'id': 2279536597, 'ino': 1099511631107, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/036.out'}, {'damage_type': 'backtrace', 'id': 2306441100, 'ino': 1099511630641, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/563.out'}, {'damage_type': 'backtrace', 'id': 2318815969, 'ino': 1099511630425, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/455.out'}, {'damage_type': 'backtrace', 'id': 2343361208, 'ino': 1099511628817, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/053.out'}, {'damage_type': 'backtrace', 'id': 2390440927, 'ino': 1099511630363, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/424.out'}, {'damage_type': 'backtrace', 'id': 2391326485, 'ino': 1099511631047, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/006.out'}, {'damage_type': 'backtrace', 'id': 2409036288, 'ino': 1099511629733, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/101.out'}, {'damage_type': 'backtrace', 'id': 2418299441, 'ino': 1099511631159, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/062.out'}, {'damage_type': 'backtrace', 'id': 2454514129, 'ino': 1099511631079, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/022.out'}, {'damage_type': 'backtrace', 'id': 2470337466, 'ino': 1099511631063, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/014.out'}, {'damage_type': 'backtrace', 'id': 2499088417, 'ino': 1099511629729, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/099.out'}, {'damage_type': 'backtrace', 'id': 2569872381, 'ino': 1099511629843, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/156.out'}, {'damage_type': 'backtrace', 'id': 2593642074, 'ino': 1099511630473, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/479.out'}, {'damage_type': 'backtrace', 'id': 2606598840, 'ino': 1099511630155, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/312.out'}, {'damage_type': 'backtrace', 'id': 2607534157, 'ino': 1099511631201, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/083.out'}, {'damage_type': 'backtrace', 'id': 2628210102, 'ino': 1099511631177, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/071.out'}, {'damage_type': 'backtrace', 'id': 2648415881, 'ino': 1099511631049, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/007.out'}, {'damage_type': 'backtrace', 'id': 2662258013, 'ino': 1099511630879, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/682.out'}, {'damage_type': 'backtrace', 'id': 2679169698, 'ino': 1099511630471, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/478.out'}, {'damage_type': 'backtrace', 'id': 2681570870, 'ino': 1099511631087, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/026.out'}, {'damage_type': 'backtrace', 'id': 2692055695, 'ino': 1099511630635, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/560.out'}, {'damage_type': 'backtrace', 'id': 2699419759, 'ino': 1099511631143, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/054.out'}, {'damage_type': 'backtrace', 'id': 2713296762, 'ino': 1099511630365, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/425.out'}, {'damage_type': 'backtrace', 'id': 2793077158, 'ino': 1099511629645, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/057.out'}, {'damage_type': 'backtrace', 'id': 2802838571, 'ino': 1099511630407, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/446.out'}, {'damage_type': 'backtrace', 'id': 2816700865, 'ino': 1099511630895, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/690.out'}, {'damage_type': 'backtrace', 'id': 2833838493, 'ino': 1099511630537, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/511.out'}, {'damage_type': 'backtrace', 'id': 2842668049, 'ino': 1099511630677, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/581.out'}, {'damage_type': 'backtrace', 'id': 2862704263, 'ino': 1099511631199, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/082.out'}, {'damage_type': 'backtrace', 'id': 2871087075, 'ino': 1099511631133, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/049.out'}, {'damage_type': 'backtrace', 'id': 2877021368, 'ino': 1099511629883, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/176.out'}, {'damage_type': 'backtrace', 'id': 2899764453, 'ino': 1099511630991, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/738.out'}, {'damage_type': 'backtrace', 'id': 2905686810, 'ino': 1099511630511, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/498.out'}, {'damage_type': 'backtrace', 'id': 2936418401, 'ino': 1099511630553, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/519.out'}, {'damage_type': 'backtrace', 'id': 2981346957, 'ino': 1099511630403, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/444.out'}, {'damage_type': 'backtrace', 'id': 3049755357, 'ino': 1099511630757, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/621.out'}, {'damage_type': 'backtrace', 'id': 3064089348, 'ino': 1099511628813, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/051.out'}, {'damage_type': 'backtrace', 'id': 3094658518, 'ino': 1099511630317, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/401.out'}, {'damage_type': 'backtrace', 'id': 3109166416, 'ino': 1099511630039, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/254.out'}, {'damage_type': 'backtrace', 'id': 3111684737, 'ino': 1099511630213, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/341.out'}, {'damage_type': 'backtrace', 'id': 3114757306, 'ino': 1099511630275, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/380.out'}, {'damage_type': 'backtrace', 'id': 3116768881, 'ino': 1099511630873, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/679.out'}, {'damage_type': 'backtrace', 'id': 3129780442, 'ino': 1099511629991, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/230.out'}, {'damage_type': 'backtrace', 'id': 3149222397, 'ino': 1099511630229, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/349.out'}, {'damage_type': 'backtrace', 'id': 3159298588, 'ino': 1099511631071, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/018.out'}, {'damage_type': 'backtrace', 'id': 3194501102, 'ino': 1099511630135, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/302.out'}, {'damage_type': 'backtrace', 'id': 3226577668, 'ino': 1099511630867, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/676.out'}, {'damage_type': 'backtrace', 'id': 3260591332, 'ino': 1099511630087, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/278.out'}, {'damage_type': 'backtrace', 'id': 3264489877, 'ino': 1099511628849, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/069.out'}, {'damage_type': 'backtrace', 'id': 3265729423, 'ino': 1099511631117, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/041.out'}, {'damage_type': 'backtrace', 'id': 3308432109, 'ino': 1099511629597, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/035.out.default'}, {'damage_type': 'backtrace', 'id': 3321886446, 'ino': 1099511629641, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/055.out'}, {'damage_type': 'backtrace', 'id': 3347321606, 'ino': 1099511628771, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/030.out'}, {'damage_type': 'backtrace', 'id': 3400299464, 'ino': 1099511630705, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/595.out'}, {'damage_type': 'backtrace', 'id': 3408612891, 'ino': 1099511630373, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/429.out'}, {'damage_type': 'backtrace', 'id': 3418175564, 'ino': 1099511629809, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/139.out'}, {'damage_type': 'backtrace', 'id': 3420363896, 'ino': 1099511630211, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/340.out'}, {'damage_type': 'backtrace', 'id': 3422315154, 'ino': 1099511631119, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/042.out'}, {'damage_type': 'backtrace', 'id': 3423928655, 'ino': 1099511630367, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/426.out'}, {'damage_type': 'backtrace', 'id': 3441428838, 'ino': 1099511631127, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/046.out'}, {'damage_type': 'backtrace', 'id': 3441849297, 'ino': 1099511628725, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/007.out'}, {'damage_type': 'backtrace', 'id': 3448267031, 'ino': 1099511629628, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/050.cfg'}, {'damage_type': 'backtrace', 'id': 3458097010, 'ino': 1099511631053, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/009.out'}, {'damage_type': 'backtrace', 'id': 3476169493, 'ino': 1099511630897, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/691.out'}, {'damage_type': 'backtrace', 'id': 3476371168, 'ino': 1099511630329, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/407.out'}, {'damage_type': 'backtrace', 'id': 3484616674, 'ino': 1099511630115, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/292.out'}, {'damage_type': 'backtrace', 'id': 3504466646, 'ino': 1099511631141, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/053.out'}, {'damage_type': 'backtrace', 'id': 3520449987, 'ino': 1099511631097, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/031.out'}, {'damage_type': 'backtrace', 'id': 3533824792, 'ino': 1099511629999, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/234.out'}, {'damage_type': 'backtrace', 'id': 3565110967, 'ino': 1099511630461, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/473.out'}, {'damage_type': 'backtrace', 'id': 3612338324, 'ino': 1099511628859, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/074.out'}, {'damage_type': 'backtrace', 'id': 3613535406, 'ino': 1099511630455, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/470.out'}, {'damage_type': 'backtrace', 'id': 3658075137, 'ino': 1099511629953, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/211.out'}, {'damage_type': 'backtrace', 'id': 3735754908, 'ino': 1099511630279, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/382.out'}, {'damage_type': 'backtrace', 'id': 3771127411, 'ino': 1099511630119, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/294.out'}, {'damage_type': 'backtrace', 'id': 3774484791, 'ino': 1099511631001, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/743.out'}, {'damage_type': 'backtrace', 'id': 3779593146, 'ino': 1099511631203, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/084.out'}, {'damage_type': 'backtrace', 'id': 3798870163, 'ino': 1099511631157, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/061.out'}, {'damage_type': 'backtrace', 'id': 3816811514, 'ino': 1099511631139, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/052.out'}, {'damage_type': 'backtrace', 'id': 3828128311, 'ino': 1099511631155, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/060.out'}, {'damage_type': 'backtrace', 'id': 3851530285, 'ino': 1099511630671, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/578.out'}, {'damage_type': 'backtrace', 'id': 3865622879, 'ino': 1099511631167, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/066.out'}, {'damage_type': 'backtrace', 'id': 3889072888, 'ino': 1099511631115, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/040.out'}, {'damage_type': 'backtrace', 'id': 3905834404, 'ino': 1099511630495, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/490.out'}, {'damage_type': 'backtrace', 'id': 3912057918, 'ino': 1099511631165, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/065.out'}, {'damage_type': 'backtrace', 'id': 3925917896, 'ino': 1099511631241, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/116.out'}, {'damage_type': 'backtrace', 'id': 3985044420, 'ino': 1099511631131, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/048.out'}, {'damage_type': 'backtrace', 'id': 4013769464, 'ino': 1099511628809, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/049.out'}, {'damage_type': 'backtrace', 'id': 4018168918, 'ino': 1099511631055, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/010.out'}, {'damage_type': 'backtrace', 'id': 4042736029, 'ino': 1099511629911, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/190.out'}, {'damage_type': 'backtrace', 'id': 4070372888, 'ino': 1099511630413, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/449.out'}, {'damage_type': 'backtrace', 'id': 4093358681, 'ino': 1099511630581, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/533.out'}, {'damage_type': 'backtrace', 'id': 4093904996, 'ino': 1099511630717, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/601.out'}, {'damage_type': 'backtrace', 'id': 4119720330, 'ino': 1099511629793, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/131.out'}, {'damage_type': 'backtrace', 'id': 4127769307, 'ino': 1099511631125, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/045.out'}, {'damage_type': 'backtrace', 'id': 4146062710, 'ino': 1099511631129, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/047.out'}, {'damage_type': 'backtrace', 'id': 4181504964, 'ino': 1099511631195, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/overlay/080.out'}, {'damage_type': 'backtrace', 'id': 4219848601, 'ino': 1099511630833, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/659.out'}, {'damage_type': 'backtrace', 'id': 4226133206, 'ino': 1099511630679, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/582.out'}, {'damage_type': 'backtrace', 'id': 4236873886, 'ino': 1099511628843, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/btrfs/066.out'}, {'damage_type': 'backtrace', 'id': 4260459292, 'ino': 1099511629829, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/149.out'}, {'damage_type': 'backtrace', 'id': 4280101435, 'ino': 1099511630029, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/249.out'}, {'damage_type': 'backtrace', 'id': 4280643230, 'ino': 1099511630979, 'path': '/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/tests/generic/732.out'}] 2024-09-19T09:21:35.781 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-19T09:21:36.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:36 smithi046 ceph-mon[31203]: pgmap v438: 97 pgs: 97 active+clean; 40 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 705 op/s 2024-09-19T09:21:36.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:36 smithi099 ceph-mon[35256]: pgmap v438: 97 pgs: 97 active+clean; 40 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 705 op/s 2024-09-19T09:21:36.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:36 smithi115 ceph-mon[35055]: pgmap v438: 97 pgs: 97 active+clean; 40 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.4 MiB/s wr, 705 op/s 2024-09-19T09:21:38.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:38 smithi046 ceph-mon[31203]: pgmap v439: 97 pgs: 97 active+clean; 40 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 547 op/s 2024-09-19T09:21:38.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:38 smithi099 ceph-mon[35256]: pgmap v439: 97 pgs: 97 active+clean; 40 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 547 op/s 2024-09-19T09:21:38.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:38 smithi115 ceph-mon[35055]: pgmap v439: 97 pgs: 97 active+clean; 40 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 547 op/s 2024-09-19T09:21:39.977 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0xffdb8 2024-09-19T09:21:40.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:40 smithi046 ceph-mon[31203]: pgmap v440: 97 pgs: 97 active+clean; 41 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 549 op/s 2024-09-19T09:21:40.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:40 smithi099 ceph-mon[35256]: pgmap v440: 97 pgs: 97 active+clean; 41 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 549 op/s 2024-09-19T09:21:40.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:40 smithi115 ceph-mon[35055]: pgmap v440: 97 pgs: 97 active+clean; 41 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.8 MiB/s wr, 549 op/s 2024-09-19T09:21:41.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 -- 172.21.15.46:0/1040473098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14681025d0 msgr2=0x7f14681049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 --2- 172.21.15.46:0/1040473098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14681025d0 0x7f14681049c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1458009900 tx=0x7f145802a410 comp rx=0 tx=0).stop 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 -- 172.21.15.46:0/1040473098 shutdown_connections 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 --2- 172.21.15.46:0/1040473098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1468107830 0x7f1468109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 --2- 172.21.15.46:0/1040473098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1468104f00 0x7f14681072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 --2- 172.21.15.46:0/1040473098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f14681025d0 0x7f14681049c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 -- 172.21.15.46:0/1040473098 >> 172.21.15.46:0/1040473098 conn(0x7f14680fc1b0 msgr2=0x7f14680fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.880+0000 7f146e368640 1 -- 172.21.15.46:0/1040473098 shutdown_connections 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 -- 172.21.15.46:0/1040473098 wait complete. 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 Processor -- start 2024-09-19T09:21:41.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 -- start start 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 0x7f1468197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1468104f00 0x7f14681983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 0x7f146819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f146810d830 con 0x7f1468107830 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f146810d6b0 con 0x7f1468104f00 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.881+0000 7f146e368640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f146810d9b0 con 0x7f14681025d0 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f146c905640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 0x7f146819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 0x7f1468197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f146c905640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 0x7f146819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60970/0 (socket says 172.21.15.46:60970) 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 0x7f1468197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:35054/0 (socket says 172.21.15.46:35054) 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f146c905640 1 -- 172.21.15.46:0/1966928491 learned_addr learned my addr 172.21.15.46:0/1966928491 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f14677fe640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1468104f00 0x7f14681983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.885 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 -- 172.21.15.46:0/1966928491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1468104f00 msgr2=0x7f14681983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1468104f00 0x7f14681983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 -- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 msgr2=0x7f146819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 0x7f146819f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 -- 172.21.15.46:0/1966928491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146819fad0 con 0x7f14681025d0 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f146c905640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 0x7f146819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f1467fff640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 0x7f1468197eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1458006010 tx=0x7f1458004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f14657fa640 1 -- 172.21.15.46:0/1966928491 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145803f030 con 0x7f14681025d0 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f14657fa640 1 -- 172.21.15.46:0/1966928491 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1458031a20 con 0x7f14681025d0 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146819fd60 con 0x7f14681025d0 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.882+0000 7f14657fa640 1 -- 172.21.15.46:0/1966928491 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458035070 con 0x7f14681025d0 2024-09-19T09:21:41.886 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.883+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14681a01a0 con 0x7f14681025d0 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.885+0000 7f14657fa640 1 -- 172.21.15.46:0/1966928491 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1458042030 con 0x7f14681025d0 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 Processor -- start 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 -- start start 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 0x5631b5246da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b524bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b524e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5631b51aa2f0 con 0x5631b524c370 2024-09-19T09:21:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631b5152270 con 0x5631b52469a0 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14711da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5631b51a62b0 con 0x5631b52472e0 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 0x5631b5246da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 0x5631b5246da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:47262/0 (socket says 172.21.15.46:47262) 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f1467fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b524bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 -- 172.21.15.46:0/3892108004 learned_addr learned my addr 172.21.15.46:0/3892108004 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f14677fe640 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b524e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 -- 172.21.15.46:0/3892108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 msgr2=0x5631b524bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b524bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 -- 172.21.15.46:0/3892108004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 msgr2=0x5631b524e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b524e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.886+0000 7f146c905640 1 -- 172.21.15.46:0/3892108004 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b5151340 con 0x5631b52469a0 2024-09-19T09:21:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f14657fa640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14500a32f0 0x7f14500a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f146c905640 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 0x5631b5246da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1460011880 tx=0x7f1460011d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe9d3fb69112e735 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f1467fff640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14500a32f0 0x7f14500a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f144e7fc640 1 -- 172.21.15.46:0/3892108004 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460011130 con 0x5631b52469a0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f144e7fc640 1 -- 172.21.15.46:0/3892108004 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14600112d0 con 0x5631b52469a0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f144e7fc640 1 -- 172.21.15.46:0/3892108004 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460010e20 con 0x5631b52469a0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.887+0000 7f14657fa640 1 -- 172.21.15.46:0/1966928491 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f14580efaa0 con 0x7f14681025d0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 -- 172.21.15.46:0/3892108004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 msgr2=0x5631b5246da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 0x5631b5246da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1460011880 tx=0x7f1460011d40 comp rx=0 tx=0).stop 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f1467fff640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14500a32f0 0x7f14500a57b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14580bbea0 tx=0x7f14580f1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 -- 172.21.15.46:0/3892108004 shutdown_connections 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b524e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b524bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 --2- 172.21.15.46:0/3892108004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52469a0 0x5631b5246da0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 -- 172.21.15.46:0/3892108004 >> 172.21.15.46:0/3892108004 conn(0x5631b5242010 msgr2=0x5631b5242410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 -- 172.21.15.46:0/3892108004 shutdown_connections 2024-09-19T09:21:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 -- 172.21.15.46:0/3892108004 wait complete. 2024-09-19T09:21:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 -- start start 2024-09-19T09:21:41.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.888+0000 7f14711da740 1 Processor -- start 2024-09-19T09:21:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b52469a0 0x5631b5250b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b5251070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b524c370 0x5631b5258040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5631b524f340 con 0x5631b52469a0 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5631b5133290 con 0x5631b524c370 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5631b524f4c0 con 0x5631b52472e0 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14711da740 10 client.0 _ll_register_callbacks cb 0x5631b5164140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f146c905640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b52469a0 0x5631b5250b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b5251070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f146c905640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b52469a0 0x5631b5250b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60998/0 (socket says 172.21.15.46:60998) 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b5251070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:35082/0 (socket says 172.21.15.46:35082) 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f146c905640 1 -- 172.21.15.46:0/1659682960 learned_addr learned my addr 172.21.15.46:0/1659682960 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f146c905640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b524c370 0x5631b5258040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 -- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b524c370 msgr2=0x5631b5258040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b524c370 0x5631b5258040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 -- 172.21.15.46:0/1659682960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b52469a0 msgr2=0x5631b5250b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b52469a0 0x5631b5250b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 -- 172.21.15.46:0/1659682960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631b4ebd210 con 0x5631b52472e0 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f146c905640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b524c370 0x5631b5258040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14677fe640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b5251070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14681993c0 tx=0x7f145c012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=912229b1ef3883de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.889+0000 7f14477fe640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14477fe640 1 -- 172.21.15.46:0/1659682960 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c004020 con 0x5631b52472e0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14477fe640 1 -- 172.21.15.46:0/1659682960 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f145c0041c0 con 0x5631b52472e0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14600112d0 con 0x5631b52472e0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14477fe640 1 -- 172.21.15.46:0/1659682960 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f145c023070 con 0x5631b52472e0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 10 client.25843 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5631b4f89620 con 0x5631b52472e0 2024-09-19T09:21:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14477fe640 1 -- 172.21.15.46:0/1659682960 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14600112d0 con 0x5631b52472e0 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14477fe640 1 -- 172.21.15.46:0/1659682960 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f145c003a30 con 0x5631b52472e0 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 10 client.25843 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 10 client.25843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 20 client.25843 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b525c870 0x5631b525ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 4 client.25843 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.890+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631b51b7a20 con 0x5631b525c870 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.891+0000 7f146c905640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b525c870 0x5631b525ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.891+0000 7f14477fe640 10 client.25843 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.891+0000 7f146c905640 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b525c870 0x5631b525ecb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=274b58c4ea35238d server_cookie=77993ebd7d68de33 in_seq=0 out_seq=0 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14477fe640 1 -- 172.21.15.46:0/1659682960 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631b51b7a20 con 0x5631b525c870 2024-09-19T09:21:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14477fe640 10 client.25843 handle_command_reply: tid=0 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 client.25843 shutdown 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 msgr2=0x5631b5251070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b5251070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14681993c0 tx=0x7f145c012b60 comp rx=0 tx=0).stop 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 shutdown_connections 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b525c870 0x5631b525ecb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b524c370 0x5631b5258040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52472e0 0x5631b5251070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14477fe640 0 client.25843 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 --2- 172.21.15.46:0/1659682960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b52469a0 0x5631b5250b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.892+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 >> 172.21.15.46:0/1659682960 conn(0x5631b5242010 msgr2=0x5631b5243820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.893+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 shutdown_connections 2024-09-19T09:21:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.893+0000 7f14711da740 1 -- 172.21.15.46:0/1659682960 wait complete. 2024-09-19T09:21:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.893+0000 7f14711da740 20 client.25843 trim_cache size 0 max 16384 2024-09-19T09:21:41.909 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 Processor -- start 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 -- start start 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b524f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5258000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b52410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14681a8f30 con 0x5631b524c370 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14681aab30 con 0x5631b52472e0 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14711da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f14681a9600 con 0x5631b52469a0 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f146c905640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b524f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f146c905640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b524f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:35098/0 (socket says 172.21.15.46:35098) 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f146c905640 1 -- 172.21.15.46:0/3051032884 learned_addr learned my addr 172.21.15.46:0/3051032884 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f14677fe640 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5258000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.908+0000 7f146c905640 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b52410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.910 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f146c905640 1 -- 172.21.15.46:0/3051032884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 msgr2=0x5631b5258000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f146c905640 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5258000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f146c905640 1 -- 172.21.15.46:0/3051032884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 msgr2=0x5631b52410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f146c905640 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b52410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f146c905640 1 -- 172.21.15.46:0/3051032884 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631b5250670 con 0x5631b52469a0 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f146c905640 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b524f890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1460009340 tx=0x7f1460005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27880d560c2788b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f144dffb640 1 -- 172.21.15.46:0/3051032884 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600111f0 con 0x5631b52469a0 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f144dffb640 1 -- 172.21.15.46:0/3051032884 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1460020040 con 0x5631b52469a0 2024-09-19T09:21:41.911 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.909+0000 7f144dffb640 1 -- 172.21.15.46:0/3051032884 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460003970 con 0x5631b52469a0 2024-09-19T09:21:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 -- 172.21.15.46:0/3051032884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 msgr2=0x5631b524f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b524f890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1460009340 tx=0x7f1460005bd0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 -- 172.21.15.46:0/3051032884 shutdown_connections 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b52410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5258000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 --2- 172.21.15.46:0/3051032884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b524f890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 -- 172.21.15.46:0/3051032884 >> 172.21.15.46:0/3051032884 conn(0x5631b5242010 msgr2=0x5631b52409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 -- 172.21.15.46:0/3051032884 shutdown_connections 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 -- 172.21.15.46:0/3051032884 wait complete. 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.910+0000 7f14711da740 1 -- start start 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 Processor -- start 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b52554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5255a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b5256a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f14681aa460 con 0x5631b524c370 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f14681a9cd0 con 0x5631b52472e0 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f14681a6f10 con 0x5631b52469a0 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14711da740 10 client.0 _ll_register_callbacks cb 0x7f145c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f146c905640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b52554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14677fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5255a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f146c905640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b52554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:35104/0 (socket says 172.21.15.46:35104) 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f146c905640 1 -- 172.21.15.46:0/2309931062 learned_addr learned my addr 172.21.15.46:0/2309931062 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f146c905640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b5256a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14677fe640 1 -- 172.21.15.46:0/2309931062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 msgr2=0x5631b52554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14677fe640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b52554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14677fe640 1 -- 172.21.15.46:0/2309931062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 msgr2=0x5631b5256a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:41.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14677fe640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b5256a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f14677fe640 1 -- 172.21.15.46:0/2309931062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631b5257030 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.911+0000 7f146c905640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b52554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14677fe640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5255a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f145c003e20 tx=0x7f145c0096b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4786d734ad48432 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14477fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14477fe640 1 -- 172.21.15.46:0/2309931062 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c0035f0 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14477fe640 1 -- 172.21.15.46:0/2309931062 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f145c018030 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1460020040 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14477fe640 1 -- 172.21.15.46:0/2309931062 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f145c003790 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14711da740 10 client.25904 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5631b52583b0 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.912+0000 7f14477fe640 1 -- 172.21.15.46:0/2309931062 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1460020040 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14477fe640 1 -- 172.21.15.46:0/2309931062 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f145c005400 con 0x5631b52472e0 2024-09-19T09:21:41.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14711da740 10 client.25904 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14711da740 10 client.25904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14711da740 20 client.25904 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14711da740 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b52c7d00 0x5631b52ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14711da740 4 client.25904 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631b51b1d70 con 0x5631b52c7d00 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f146c905640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b52c7d00 0x5631b52ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f14477fe640 10 client.25904 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:41.918 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.913+0000 7f146c905640 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b52c7d00 0x5631b52ca120 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117dfa9d05a91bfa server_cookie=4cadbe6692a8d261 in_seq=0 out_seq=0 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.927+0000 7f14477fe640 1 -- 172.21.15.46:0/2309931062 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631b51b1d70 con 0x5631b52c7d00 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.927+0000 7f14477fe640 10 client.25904 handle_command_reply: tid=0 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 client.25904 shutdown 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 msgr2=0x5631b5255a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5255a10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f145c003e20 tx=0x7f145c0096b0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 shutdown_connections 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5631b52c7d00 0x5631b52ca120 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.929 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5631b524c370 0x5631b5256a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14477fe640 0 client.25904 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5631b52472e0 0x5631b5255a10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 --2- 172.21.15.46:0/2309931062 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5631b52469a0 0x5631b52554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 >> 172.21.15.46:0/2309931062 conn(0x5631b5242010 msgr2=0x5631b52411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 shutdown_connections 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 1 -- 172.21.15.46:0/2309931062 wait complete. 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.928+0000 7f14711da740 20 client.25904 trim_cache size 0 max 16384 2024-09-19T09:21:41.930 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:21:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:21:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:21:41.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14500a32f0 msgr2=0x7f14500a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14500a32f0 0x7f14500a57b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14580bbea0 tx=0x7f14580f1040 comp rx=0 tx=0).stop 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 msgr2=0x7f1468197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 0x7f1468197eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1458006010 tx=0x7f1458004270 comp rx=0 tx=0).stop 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 shutdown_connections 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f14500a32f0 0x7f14500a57b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1468107830 0x7f146819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1468104f00 0x7f14681983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 --2- 172.21.15.46:0/1966928491 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14681025d0 0x7f1468197eb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 >> 172.21.15.46:0/1966928491 conn(0x7f14680fc1b0 msgr2=0x7f1468103090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:41.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 shutdown_connections 2024-09-19T09:21:41.933 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:41.929+0000 7f146e368640 1 -- 172.21.15.46:0/1966928491 wait complete. 2024-09-19T09:21:42.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:42 smithi046 ceph-mon[31203]: pgmap v441: 97 pgs: 97 active+clean; 47 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 539 op/s 2024-09-19T09:21:42.511 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:42 smithi115 ceph-mon[35055]: pgmap v441: 97 pgs: 97 active+clean; 47 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 539 op/s 2024-09-19T09:21:42.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:42 smithi099 ceph-mon[35256]: pgmap v441: 97 pgs: 97 active+clean; 47 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 539 op/s 2024-09-19T09:21:42.827 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T09:21:42.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:43.117 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 -- 172.21.15.46:0/857158714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 msgr2=0x7f402810df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:43.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 --2- 172.21.15.46:0/857158714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402810df90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4018009900 tx=0x7f401802a410 comp rx=0 tx=0).stop 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 -- 172.21.15.46:0/857158714 shutdown_connections 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 --2- 172.21.15.46:0/857158714 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402810df90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 --2- 172.21.15.46:0/857158714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f402810e4d0 0x7f40281108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 --2- 172.21.15.46:0/857158714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40281009b0 0x7f4028100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 -- 172.21.15.46:0/857158714 >> 172.21.15.46:0/857158714 conn(0x7f40280fc7d0 msgr2=0x7f40280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 -- 172.21.15.46:0/857158714 shutdown_connections 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.607+0000 7f402f76d640 1 -- 172.21.15.46:0/857158714 wait complete. 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 Processor -- start 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 -- start start 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40281009b0 0x7f402819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:43.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f402810e4d0 0x7f402819f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4028114220 con 0x7f4028101360 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f40281140a0 con 0x7f40281009b0 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402f76d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f40281143a0 con 0x7f402810e4d0 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402cd08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402cd08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402819ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32778/0 (socket says 172.21.15.46:32778) 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402cd08640 1 -- 172.21.15.46:0/3239790509 learned_addr learned my addr 172.21.15.46:0/3239790509 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402dd0a640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f402810e4d0 0x7f402819f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.608+0000 7f402d509640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40281009b0 0x7f402819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402cd08640 1 -- 172.21.15.46:0/3239790509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f402810e4d0 msgr2=0x7f402819f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402cd08640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f402810e4d0 0x7f402819f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402cd08640 1 -- 172.21.15.46:0/3239790509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40281009b0 msgr2=0x7f402819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402cd08640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40281009b0 0x7f402819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402cd08640 1 -- 172.21.15.46:0/3239790509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402819f6f0 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402cd08640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402819ac80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4018006010 tx=0x7f40180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401803f030 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4018003ce0 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018035070 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402819f980 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.609+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f402819fe10 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.611+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402806a7f0 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.612+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4018042030 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.612+0000 7f401e7fc640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40140a32c0 0x7f40140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.613+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f40180eff50 con 0x7f4028101360 2024-09-19T09:21:43.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.613+0000 7f402d509640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40140a32c0 0x7f40140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.613+0000 7f402d509640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40140a32c0 0x7f40140a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4024005fd0 tx=0x7f402400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:43.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.617+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40180bc710 con 0x7f4028101360 2024-09-19T09:21:43.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.860+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4028109660 con 0x7f4028101360 2024-09-19T09:21:43.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.860+0000 7f401e7fc640 1 -- 172.21.15.46:0/3239790509 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11967 (secure 0 0 0) 0x7f40180c0a10 con 0x7f4028101360 2024-09-19T09:21:43.861 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:21:43.861 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-19T09:21:29:130184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:21:29.130168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:21:43.862 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-19T09:21:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40140a32c0 msgr2=0x7f40140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:43.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40140a32c0 0x7f40140a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4024005fd0 tx=0x7f402400b390 comp rx=0 tx=0).stop 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 msgr2=0x7f402819ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402819ac80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4018006010 tx=0x7f40180042f0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 shutdown_connections 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f40140a32c0 0x7f40140a5780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4028101360 0x7f402819ac80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f402810e4d0 0x7f402819f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 --2- 172.21.15.46:0/3239790509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40281009b0 0x7f402819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 >> 172.21.15.46:0/3239790509 conn(0x7f40280fc7d0 msgr2=0x7f40280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 shutdown_connections 2024-09-19T09:21:43.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:43.863+0000 7f402f76d640 1 -- 172.21.15.46:0/3239790509 wait complete. 2024-09-19T09:21:44.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:44 smithi046 ceph-mon[31203]: pgmap v442: 97 pgs: 97 active+clean; 48 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.7 MiB/s wr, 605 op/s 2024-09-19T09:21:44.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:44 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3239790509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:44.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:44 smithi099 ceph-mon[35256]: pgmap v442: 97 pgs: 97 active+clean; 48 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.7 MiB/s wr, 605 op/s 2024-09-19T09:21:44.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:44 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3239790509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:44.663 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T09:21:44.663 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T09:21:44.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:44 smithi115 ceph-mon[35055]: pgmap v442: 97 pgs: 97 active+clean; 48 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.7 MiB/s wr, 605 op/s 2024-09-19T09:21:44.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:44 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3239790509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:21:44.952 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:21:45.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 -- 172.21.15.46:0/3937603190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 msgr2=0x7fb65c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3937603190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c107b90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb650009930 tx=0x7fb65002a420 comp rx=0 tx=0).stop 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 -- 172.21.15.46:0/3937603190 shutdown_connections 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3937603190 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c107b90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3937603190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb65c1082a0 0x7fb65c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3937603190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb65c102d30 0x7fb65c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 -- 172.21.15.46:0/3937603190 >> 172.21.15.46:0/3937603190 conn(0x7fb65c0fc7d0 msgr2=0x7fb65c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 -- 172.21.15.46:0/3937603190 shutdown_connections 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.456+0000 7fb6624c4640 1 -- 172.21.15.46:0/3937603190 wait complete. 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 Processor -- start 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 -- start start 2024-09-19T09:21:45.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb65c102d30 0x7fb65c1a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c1a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb65c1082a0 0x7fb65c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c112090 con 0x7fb65c1036e0 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c111f10 con 0x7fb65c1082a0 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb6624c4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c112210 con 0x7fb65c102d30 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c1a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c1a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32806/0 (socket says 172.21.15.46:32806) 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb65b7fe640 1 -- 172.21.15.46:0/3317711898 learned_addr learned my addr 172.21.15.46:0/3317711898 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:45.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb660a61640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb65c1082a0 0x7fb65c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.457+0000 7fb65bfff640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb65c102d30 0x7fb65c1a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb65b7fe640 1 -- 172.21.15.46:0/3317711898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb65c102d30 msgr2=0x7fb65c1a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb65c102d30 0x7fb65c1a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb65b7fe640 1 -- 172.21.15.46:0/3317711898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb65c1082a0 msgr2=0x7fb65c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb65c1082a0 0x7fb65c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb65b7fe640 1 -- 172.21.15.46:0/3317711898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65c19aeb0 con 0x7fb65c1036e0 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c1a0ab0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb65002a940 tx=0x7fb650003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb6597fa640 1 -- 172.21.15.46:0/3317711898 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65003f070 con 0x7fb65c1036e0 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65c19b140 con 0x7fb65c1036e0 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb6597fa640 1 -- 172.21.15.46:0/3317711898 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb650031c90 con 0x7fb65c1036e0 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb6597fa640 1 -- 172.21.15.46:0/3317711898 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650035030 con 0x7fb65c1036e0 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.458+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65c1a7320 con 0x7fb65c1036e0 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.460+0000 7fb6597fa640 1 -- 172.21.15.46:0/3317711898 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb650042070 con 0x7fb65c1036e0 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb66489d740 1 Processor -- start 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb66489d740 1 -- start start 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb6597fa640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb6440a3240 0x7fb6440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb66489d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c53760 0x562420c53b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb66489d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c54080 0x562420c5e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb66489d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c60d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb66489d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x562420bb92a0 con 0x562420c53760 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb660a61640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb6440a3240 0x7fb6440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb66489d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562420b60b10 con 0x562420c54080 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb66489d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562420bb5260 con 0x562420c5e940 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.461+0000 7fb6597fa640 1 -- 172.21.15.46:0/3317711898 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb6500eff60 con 0x7fb65c1036e0 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb660a61640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c60d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c53760 0x562420c53b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c53760 0x562420c53b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32820/0 (socket says 172.21.15.46:32820) 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb660a61640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c60d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:35150/0 (socket says 172.21.15.46:35150) 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65bfff640 1 -- 172.21.15.46:0/75839000 learned_addr learned my addr 172.21.15.46:0/75839000 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c54080 0x562420c5e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65b7fe640 1 -- 172.21.15.46:0/75839000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 msgr2=0x562420c60d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c60d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb660a61640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb6440a3240 0x7fb6440a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb654009fd0 tx=0x7fb654014bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65b7fe640 1 -- 172.21.15.46:0/75839000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c53760 msgr2=0x562420c53b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c53760 0x562420c53b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.462+0000 7fb65b7fe640 1 -- 172.21.15.46:0/75839000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242092ab90 con 0x562420c54080 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.463+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c54080 0x562420c5e400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6500edae0 tx=0x7fb650003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20a5fd8a60b98cad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.463+0000 7fb6427fc640 1 -- 172.21.15.46:0/75839000 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650049070 con 0x562420c54080 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.463+0000 7fb6427fc640 1 -- 172.21.15.46:0/75839000 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6500bc660 con 0x562420c54080 2024-09-19T09:21:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.463+0000 7fb6427fc640 1 -- 172.21.15.46:0/75839000 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500c4d90 con 0x562420c54080 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 -- 172.21.15.46:0/75839000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c54080 msgr2=0x562420c5e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c54080 0x562420c5e400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6500edae0 tx=0x7fb650003f90 comp rx=0 tx=0).stop 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 -- 172.21.15.46:0/75839000 shutdown_connections 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c60d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c54080 0x562420c5e400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 --2- 172.21.15.46:0/75839000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c53760 0x562420c53b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 -- 172.21.15.46:0/75839000 >> 172.21.15.46:0/75839000 conn(0x562420c4fcf0 msgr2=0x562420c500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 -- 172.21.15.46:0/75839000 shutdown_connections 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 -- 172.21.15.46:0/75839000 wait complete. 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.464+0000 7fb66489d740 1 -- start start 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb66489d740 1 Processor -- start 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb66489d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c5b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb66489d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c5bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb66489d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c5c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb66489d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x562420c612d0 con 0x562420c54080 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb66489d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562420b416e0 con 0x562420c53760 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c5b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c5bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c5bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32824/0 (socket says 172.21.15.46:32824) 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65b7fe640 1 -- 172.21.15.46:0/2592184430 learned_addr learned my addr 172.21.15.46:0/2592184430 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.465+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c5b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:47364/0 (socket says 172.21.15.46:47364) 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562420c61450 con 0x562420c5e940 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb660a61640 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c5c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb66489d740 10 client.0 _ll_register_callbacks cb 0x562420b65a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65bfff640 1 -- 172.21.15.46:0/2592184430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 msgr2=0x562420c5c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65bfff640 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c5c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65bfff640 1 -- 172.21.15.46:0/2592184430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 msgr2=0x562420c5bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65bfff640 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c5bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65bfff640 1 -- 172.21.15.46:0/2592184430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562420c6a6b0 con 0x562420c53760 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb65bfff640 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c5b7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb64c012700 tx=0x7fb64c012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2362c8e8c75db44d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb63b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb63b7fe640 1 -- 172.21.15.46:0/2592184430 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64c00f8c0 con 0x562420c53760 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb63b7fe640 1 -- 172.21.15.46:0/2592184430 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb64c00fa60 con 0x562420c53760 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.466+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6500bc660 con 0x562420c53760 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb63b7fe640 1 -- 172.21.15.46:0/2592184430 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb64c00fc60 con 0x562420c53760 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 10 client.25922 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:45.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562420c6d020 con 0x562420c53760 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb63b7fe640 1 -- 172.21.15.46:0/2592184430 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6500bc660 con 0x562420c53760 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb63b7fe640 1 -- 172.21.15.46:0/2592184430 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fb64c027420 con 0x562420c53760 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 10 client.25922 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 10 client.25922 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 20 client.25922 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420c70a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 4 client.25922 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562420bc69d0 con 0x562420c6e550 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.467+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420c70a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.468+0000 7fb63b7fe640 10 client.25922 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.468+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420c70a10 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4d30a0e43291a5d server_cookie=1d87354cb95d778 in_seq=0 out_seq=0 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.468+0000 7fb63b7fe640 1 -- 172.21.15.46:0/2592184430 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562420bc69d0 con 0x562420c6e550 2024-09-19T09:21:45.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.469+0000 7fb63b7fe640 10 client.25922 handle_command_reply: tid=0 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.469+0000 7fb66489d740 1 client.25922 shutdown 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.469+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 msgr2=0x562420c5b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.469+0000 7fb66489d740 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c5b7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb64c012700 tx=0x7fb64c012bc0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 shutdown_connections 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420c70a10 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb63b7fe640 0 client.25922 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c5bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c5c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 --2- 172.21.15.46:0/2592184430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c5b7a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 >> 172.21.15.46:0/2592184430 conn(0x562420c4fcf0 msgr2=0x562420c4ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 shutdown_connections 2024-09-19T09:21:45.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 1 -- 172.21.15.46:0/2592184430 wait complete. 2024-09-19T09:21:45.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.471+0000 7fb66489d740 20 client.25922 trim_cache size 0 max 16384 2024-09-19T09:21:45.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 Processor -- start 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 -- start start 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c76820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c58a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1af760 con 0x562420c54080 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1b1360 con 0x562420c53760 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb66489d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1afe30 con 0x562420c5e940 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c762e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:47372/0 (socket says 172.21.15.46:47372) 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65bfff640 1 -- 172.21.15.46:0/1901525096 learned_addr learned my addr 172.21.15.46:0/1901525096 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c76820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb660a61640 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c58a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65b7fe640 1 -- 172.21.15.46:0/1901525096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 msgr2=0x562420c58a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c58a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65b7fe640 1 -- 172.21.15.46:0/1901525096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 msgr2=0x562420c762e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.490+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c762e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.491+0000 7fb65b7fe640 1 -- 172.21.15.46:0/1901525096 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562420c4f790 con 0x562420c54080 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.491+0000 7fb65bfff640 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c762e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.491+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c76820 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb6500bc5f0 tx=0x7fb650005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c7f4d82c1bfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.491+0000 7fb641ffb640 1 -- 172.21.15.46:0/1901525096 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6500d4070 con 0x562420c54080 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.491+0000 7fb641ffb640 1 -- 172.21.15.46:0/1901525096 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6500bc660 con 0x562420c54080 2024-09-19T09:21:45.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.491+0000 7fb641ffb640 1 -- 172.21.15.46:0/1901525096 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650049040 con 0x562420c54080 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 -- 172.21.15.46:0/1901525096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 msgr2=0x562420c76820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c76820 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb6500bc5f0 tx=0x7fb650005dc0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 -- 172.21.15.46:0/1901525096 shutdown_connections 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c76820 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c5e940 0x562420c58a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 --2- 172.21.15.46:0/1901525096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c53760 0x562420c762e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 -- 172.21.15.46:0/1901525096 >> 172.21.15.46:0/1901525096 conn(0x562420c4fcf0 msgr2=0x562420c5d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:45.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 -- 172.21.15.46:0/1901525096 shutdown_connections 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 -- 172.21.15.46:0/1901525096 wait complete. 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.492+0000 7fb66489d740 1 -- start start 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 Processor -- start 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c53760 0x562420c625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c62b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c5e940 0x562420cd82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c62b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c62b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:32838/0 (socket says 172.21.15.46:32838) 2024-09-19T09:21:45.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c53760 0x562420c625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 -- 172.21.15.46:0/625754306 learned_addr learned my addr 172.21.15.46:0/625754306 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1b0c90 con 0x562420c54080 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1b0500 con 0x562420c5e940 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb65c1ad740 con 0x562420c53760 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb660a61640 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c5e940 0x562420cd82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb66489d740 10 client.0 _ll_register_callbacks cb 0x7fb64c009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 -- 172.21.15.46:0/625754306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c53760 msgr2=0x562420c625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c53760 0x562420c625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 -- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c5e940 msgr2=0x562420cd82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.493+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c5e940 0x562420cd82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb65b7fe640 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562420cd87f0 con 0x562420c54080 2024-09-19T09:21:45.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb65b7fe640 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c62b30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb6500bc130 tx=0x7fb65002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfb18d0d44aed6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb63b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb63b7fe640 1 -- 172.21.15.46:0/625754306 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650049040 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb63b7fe640 1 -- 172.21.15.46:0/625754306 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb6500ba960 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6500bc660 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb63b7fe640 1 -- 172.21.15.46:0/625754306 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb6500d4040 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb66489d740 10 client.16422 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562420cd9970 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.494+0000 7fb63b7fe640 1 -- 172.21.15.46:0/625754306 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6500bc660 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb63b7fe640 1 -- 172.21.15.46:0/625754306 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fb6500bbbb0 con 0x562420c54080 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb66489d740 10 client.16422 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb66489d740 10 client.16422 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:21:45.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb66489d740 20 client.16422 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb66489d740 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420cdbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb66489d740 4 client.16422 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T09:21:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x562420bc0d20 con 0x562420c6e550 2024-09-19T09:21:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb65bfff640 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420cdbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb63b7fe640 10 client.16422 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:45.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:45.495+0000 7fb65bfff640 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420cdbf50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=646b8d30905850c5 server_cookie=111edb7ebd3dc2ed in_seq=0 out_seq=0 2024-09-19T09:21:46.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.038+0000 7fb63b7fe640 1 -- 172.21.15.46:0/625754306 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562420bc0d20 con 0x562420c6e550 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.038+0000 7fb63b7fe640 10 client.16422 handle_command_reply: tid=0 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.038+0000 7fb66489d740 1 client.16422 shutdown 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.038+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 msgr2=0x562420c62b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c62b30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb6500bc130 tx=0x7fb65002a420 comp rx=0 tx=0).stop 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 shutdown_connections 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562420c6e550 0x562420cdbf50 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562420c54080 0x562420c62b30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562420c5e940 0x562420cd82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb63b7fe640 0 client.16422 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:46.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 --2- 172.21.15.46:0/625754306 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562420c53760 0x562420c625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 >> 172.21.15.46:0/625754306 conn(0x562420c4fcf0 msgr2=0x562420c4e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 shutdown_connections 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 1 -- 172.21.15.46:0/625754306 wait complete. 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb66489d740 20 client.16422 trim_cache size 0 max 16384 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-09-19T09:21:46.041 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 14, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "6eab7a3d": { 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 14, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 136.6, 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:21:46.042 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:21:46.043 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb6440a3240 msgr2=0x7fb6440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb6440a3240 0x7fb6440a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb654009fd0 tx=0x7fb654014bd0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 msgr2=0x7fb65c1a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.039+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c1a0ab0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb65002a940 tx=0x7fb650003b90 comp rx=0 tx=0).stop 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 shutdown_connections 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb6440a3240 0x7fb6440a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb65c1036e0 0x7fb65c1a0ab0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb65c1082a0 0x7fb65c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 --2- 172.21.15.46:0/3317711898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb65c102d30 0x7fb65c1a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 >> 172.21.15.46:0/3317711898 conn(0x7fb65c0fc7d0 msgr2=0x7fb65c10cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 shutdown_connections 2024-09-19T09:21:46.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:21:46.040+0000 7fb6624c4640 1 -- 172.21.15.46:0/3317711898 wait complete. 2024-09-19T09:21:46.425 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:46 smithi046 ceph-mon[31203]: pgmap v443: 97 pgs: 97 active+clean; 46 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 527 op/s 2024-09-19T09:21:46.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:46 smithi099 ceph-mon[35256]: pgmap v443: 97 pgs: 97 active+clean; 46 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 527 op/s 2024-09-19T09:21:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:46 smithi115 ceph-mon[35055]: pgmap v443: 97 pgs: 97 active+clean; 46 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 527 op/s 2024-09-19T09:21:46.860 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6eab7a3d', quiesce took 4.0 seconds. Will release after: 12.600000000000001 2024-09-19T09:21:48.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:48 smithi046 ceph-mon[31203]: pgmap v444: 97 pgs: 97 active+clean; 48 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 559 op/s 2024-09-19T09:21:48.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:48 smithi099 ceph-mon[35256]: pgmap v444: 97 pgs: 97 active+clean; 48 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 559 op/s 2024-09-19T09:21:48.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:48 smithi115 ceph-mon[35055]: pgmap v444: 97 pgs: 97 active+clean; 48 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 559 op/s 2024-09-19T09:21:50.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:50 smithi046 ceph-mon[31203]: pgmap v445: 97 pgs: 97 active+clean; 48 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 416 op/s 2024-09-19T09:21:50.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:50 smithi099 ceph-mon[35256]: pgmap v445: 97 pgs: 97 active+clean; 48 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 416 op/s 2024-09-19T09:21:50.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:50 smithi115 ceph-mon[35055]: pgmap v445: 97 pgs: 97 active+clean; 48 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 416 op/s 2024-09-19T09:21:52.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:52 smithi046 ceph-mon[31203]: pgmap v446: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 435 op/s 2024-09-19T09:21:52.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:52 smithi099 ceph-mon[35256]: pgmap v446: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 435 op/s 2024-09-19T09:21:52.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:52 smithi115 ceph-mon[35055]: pgmap v446: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 435 op/s 2024-09-19T09:21:54.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:54 smithi099 ceph-mon[35256]: pgmap v447: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 360 op/s 2024-09-19T09:21:54.582 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:54 smithi046 ceph-mon[31203]: pgmap v447: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 360 op/s 2024-09-19T09:21:54.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:54 smithi115 ceph-mon[35055]: pgmap v447: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 360 op/s 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 -- 172.21.15.46:0/1858582383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 msgr2=0x7f2a4c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 --2- 172.21.15.46:0/1858582383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c109fa0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009ca0 tx=0x7f2a4402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 -- 172.21.15.46:0/1858582383 shutdown_connections 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 --2- 172.21.15.46:0/1858582383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c109fa0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 --2- 172.21.15.46:0/1858582383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a4c102d50 0x7f2a4c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 --2- 172.21.15.46:0/1858582383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 0x7f2a4c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 -- 172.21.15.46:0/1858582383 >> 172.21.15.46:0/1858582383 conn(0x7f2a4c0fd2e0 msgr2=0x7f2a4c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.021+0000 7f2a52082640 1 -- 172.21.15.46:0/1858582383 shutdown_connections 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 -- 172.21.15.46:0/1858582383 wait complete. 2024-09-19T09:21:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 Processor -- start 2024-09-19T09:21:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 -- start start 2024-09-19T09:21:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 0x7f2a4c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a4c102d50 0x7f2a4c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c19f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10d890 con 0x7f2a4c103710 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10d710 con 0x7f2a4c101b60 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.022+0000 7f2a52082640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c10da10 con 0x7f2a4c102d50 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c19f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c19f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47784/0 (socket says 172.21.15.46:47784) 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 -- 172.21.15.46:0/3496751388 learned_addr learned my addr 172.21.15.46:0/3496751388 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 0x7f2a4c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 -- 172.21.15.46:0/3496751388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a4c102d50 msgr2=0x7f2a4c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a4c102d50 0x7f2a4c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 -- 172.21.15.46:0/3496751388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 msgr2=0x7f2a4c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 0x7f2a4c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 -- 172.21.15.46:0/3496751388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c19f9d0 con 0x7f2a4c103710 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 0x7f2a4c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a4bfff640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c19f360 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2a44003ba0 tx=0x7f2a44003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a497fa640 1 -- 172.21.15.46:0/3496751388 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44004040 con 0x7f2a4c103710 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c19fc60 con 0x7f2a4c103710 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a497fa640 1 -- 172.21.15.46:0/3496751388 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a440046c0 con 0x7f2a4c103710 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a497fa640 1 -- 172.21.15.46:0/3496751388 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4402fea0 con 0x7f2a4c103710 2024-09-19T09:21:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.023+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1a0280 con 0x7f2a4c103710 2024-09-19T09:21:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a497fa640 1 -- 172.21.15.46:0/3496751388 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2a4402f610 con 0x7f2a4c103710 2024-09-19T09:21:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 Processor -- start 2024-09-19T09:21:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 -- start start 2024-09-19T09:21:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476d61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 0x5629476db1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5629476352f0 con 0x5629476d66f0 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5629475dd270 con 0x5629476db780 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a54e22740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5629476312b0 con 0x5629476d5db0 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a4b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 0x5629476db1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a4b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 0x5629476db1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47796/0 (socket says 172.21.15.46:47796) 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a4b7fe640 1 -- 172.21.15.46:0/3646966469 learned_addr learned my addr 172.21.15.46:0/3646966469 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.026+0000 7f2a497fa640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2a380a32f0 0x7f2a380a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476d61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4b7fe640 1 -- 172.21.15.46:0/3646966469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 msgr2=0x5629476d61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476d61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4b7fe640 1 -- 172.21.15.46:0/3646966469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 msgr2=0x5629476ddc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476ddc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4b7fe640 1 -- 172.21.15.46:0/3646966469 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629475dc340 con 0x5629476d66f0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476ddc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4bfff640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2a380a32f0 0x7f2a380a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a497fa640 1 -- 172.21.15.46:0/3496751388 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f2a440f1120 con 0x7f2a4c103710 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 0x5629476db1b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00cc50 tx=0x7f2a3c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35b8b5830c81b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a41ffb640 1 -- 172.21.15.46:0/3646966469 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c014070 con 0x5629476d66f0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a41ffb640 1 -- 172.21.15.46:0/3646966469 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a3c0047a0 con 0x5629476d66f0 2024-09-19T09:21:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.027+0000 7f2a41ffb640 1 -- 172.21.15.46:0/3646966469 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c010760 con 0x5629476d66f0 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 -- 172.21.15.46:0/3646966469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 msgr2=0x5629476db1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a4bfff640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2a380a32f0 0x7f2a380a57b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2a440bd700 tx=0x7f2a440a8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 0x5629476db1b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00cc50 tx=0x7f2a3c00e720 comp rx=0 tx=0).stop 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 -- 172.21.15.46:0/3646966469 shutdown_connections 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d66f0 0x5629476db1b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476ddc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 --2- 172.21.15.46:0/3646966469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476d61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 -- 172.21.15.46:0/3646966469 >> 172.21.15.46:0/3646966469 conn(0x5629476cd010 msgr2=0x5629476cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 -- 172.21.15.46:0/3646966469 shutdown_connections 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 -- 172.21.15.46:0/3646966469 wait complete. 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 -- start start 2024-09-19T09:21:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.028+0000 7f2a54e22740 1 Processor -- start 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476dffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d66f0 0x5629476e0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476e7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5629476de750 con 0x5629476d5db0 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5629475be290 con 0x5629476db780 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5629476de8d0 con 0x5629476d66f0 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 10 client.0 _ll_register_callbacks cb 0x5629475ef140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476dffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476dffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47800/0 (socket says 172.21.15.46:47800) 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 -- 172.21.15.46:0/1093386629 learned_addr learned my addr 172.21.15.46:0/1093386629 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d66f0 0x5629476e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476e7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 -- 172.21.15.46:0/1093386629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d66f0 msgr2=0x5629476e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d66f0 0x5629476e0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 -- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 msgr2=0x5629476e7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476e7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 -- 172.21.15.46:0/1093386629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562947348210 con 0x5629476d5db0 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476dffe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009fd0 tx=0x7f2a34009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fef5a2cb6557a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a2affd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a2affd640 1 -- 172.21.15.46:0/1093386629 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34012490 con 0x5629476d5db0 2024-09-19T09:21:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a3c0047a0 con 0x5629476d5db0 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.029+0000 7f2a2affd640 1 -- 172.21.15.46:0/1093386629 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f2a34012630 con 0x5629476d5db0 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a2affd640 1 -- 172.21.15.46:0/1093386629 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2a34012830 con 0x5629476d5db0 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 10 client.16434 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562947414620 con 0x5629476d5db0 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a2affd640 1 -- 172.21.15.46:0/1093386629 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a3c0047a0 con 0x5629476d5db0 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a2affd640 1 -- 172.21.15.46:0/1093386629 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f2a34025be0 con 0x5629476d5db0 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 10 client.16434 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 10 client.16434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 20 client.16434 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5629476ebf20 0x5629476ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 4 client.16434 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562947642a20 con 0x5629476ebf20 2024-09-19T09:21:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.030+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5629476ebf20 0x5629476ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.031+0000 7f2a2affd640 10 client.16434 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.031+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5629476ebf20 0x5629476ee3a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac8ec704f1640c server_cookie=43b5eeed2bdba38f in_seq=0 out_seq=0 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.031+0000 7f2a2affd640 1 -- 172.21.15.46:0/1093386629 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562947642a20 con 0x5629476ebf20 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.031+0000 7f2a2affd640 10 client.16434 handle_command_reply: tid=0 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.031+0000 7f2a54e22740 1 client.16434 shutdown 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 msgr2=0x5629476dffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476dffe0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009fd0 tx=0x7f2a34009a30 comp rx=0 tx=0).stop 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 shutdown_connections 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5629476ebf20 0x5629476ee3a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476db780 0x5629476e7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d66f0 0x5629476e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 --2- 172.21.15.46:0/1093386629 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476dffe0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a2affd640 0 client.16434 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 >> 172.21.15.46:0/1093386629 conn(0x5629476cd010 msgr2=0x5629476ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 shutdown_connections 2024-09-19T09:21:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 1 -- 172.21.15.46:0/1093386629 wait complete. 2024-09-19T09:21:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.032+0000 7f2a54e22740 20 client.16434 trim_cache size 0 max 16384 2024-09-19T09:21:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 Processor -- start 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 -- start start 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476db780 0x5629476cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a6ca0 con 0x5629476d5db0 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a88a0 con 0x5629476d66f0 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a54e22740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a7370 con 0x5629476db780 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.046+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476e05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47812/0 (socket says 172.21.15.46:47812) 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 -- 172.21.15.46:0/716574374 learned_addr learned my addr 172.21.15.46:0/716574374 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 -- 172.21.15.46:0/716574374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476db780 msgr2=0x5629476cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476db780 0x5629476cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 -- 172.21.15.46:0/716574374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 msgr2=0x5629476e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 -- 172.21.15.46:0/716574374 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629476dfb20 con 0x5629476d5db0 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476e05b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001eb0 tx=0x7f2a34012120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230887effe07c29c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a417fa640 1 -- 172.21.15.46:0/716574374 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34007160 con 0x5629476d5db0 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a417fa640 1 -- 172.21.15.46:0/716574374 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a34029070 con 0x5629476d5db0 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.047+0000 7f2a417fa640 1 -- 172.21.15.46:0/716574374 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34008e40 con 0x5629476d5db0 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- 172.21.15.46:0/716574374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 msgr2=0x5629476e05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476e05b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001eb0 tx=0x7f2a34012120 comp rx=0 tx=0).stop 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- 172.21.15.46:0/716574374 shutdown_connections 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476db780 0x5629476cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- 172.21.15.46:0/716574374 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476d5db0 0x5629476e05b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- 172.21.15.46:0/716574374 >> 172.21.15.46:0/716574374 conn(0x5629476cd010 msgr2=0x5629476cdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- 172.21.15.46:0/716574374 shutdown_connections 2024-09-19T09:21:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- 172.21.15.46:0/716574374 wait complete. 2024-09-19T09:21:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- start start 2024-09-19T09:21:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 Processor -- start 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476e4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 0x5629476e5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a81d0 con 0x5629476db780 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.048+0000 7f2a54e22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a7a40 con 0x5629476d66f0 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a54e22740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a4c80 con 0x5629476d5db0 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a54e22740 10 client.0 _ll_register_callbacks cb 0x7f2a34009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 0x5629476e5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 0x5629476e5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47816/0 (socket says 172.21.15.46:47816) 2024-09-19T09:21:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 -- 172.21.15.46:0/878094061 learned_addr learned my addr 172.21.15.46:0/878094061 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 -- 172.21.15.46:0/878094061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 msgr2=0x5629476e4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476e4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 -- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 msgr2=0x5629476e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 -- 172.21.15.46:0/878094061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629476d7380 con 0x5629476db780 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a42ffd640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 0x5629476e5d70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000fc0 tx=0x7f2a34009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faed4255f18b0262 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a2affd640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a2affd640 1 -- 172.21.15.46:0/878094061 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34012bd0 con 0x5629476db780 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a2affd640 1 -- 172.21.15.46:0/878094061 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f2a34012d70 con 0x5629476db780 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a34029070 con 0x5629476db780 2024-09-19T09:21:55.055 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a2affd640 1 -- 172.21.15.46:0/878094061 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2a34004480 con 0x5629476db780 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a54e22740 10 client.16440 fetch_fsmap learned FSMap version 37 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.049+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5629476e74c0 con 0x5629476db780 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a2affd640 1 -- 172.21.15.46:0/878094061 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a34029070 con 0x5629476db780 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a2affd640 1 -- 172.21.15.46:0/878094061 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f2a3401a6a0 con 0x5629476db780 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a54e22740 10 client.16440 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a54e22740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a54e22740 20 client.16440 populate_metadata read hostname 'smithi046' 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a54e22740 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562947756fd0 0x5629477593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a54e22740 4 client.16440 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56294763cd70 con 0x562947756fd0 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562947756fd0 0x5629477593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:21:55.056 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a4b7fe640 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562947756fd0 0x5629477593c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=979bff3d26b6a756 server_cookie=c1c2b94f27205513 in_seq=0 out_seq=0 2024-09-19T09:21:55.057 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.050+0000 7f2a2affd640 10 client.16440 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a2affd640 1 -- 172.21.15.46:0/878094061 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56294763cd70 con 0x562947756fd0 2024-09-19T09:21:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a2affd640 10 client.16440 handle_command_reply: tid=0 2024-09-19T09:21:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 client.16440 shutdown 2024-09-19T09:21:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 msgr2=0x5629476e5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 0x5629476e5d70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000fc0 tx=0x7f2a34009b00 comp rx=0 tx=0).stop 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 shutdown_connections 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562947756fd0 0x5629477593c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5629476db780 0x5629476e5d70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a2affd640 0 client.16440 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5629476d66f0 0x5629476e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 --2- 172.21.15.46:0/878094061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5629476d5db0 0x5629476e4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 >> 172.21.15.46:0/878094061 conn(0x5629476cd010 msgr2=0x5629476ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 shutdown_connections 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 1 -- 172.21.15.46:0/878094061 wait complete. 2024-09-19T09:21:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.064+0000 7f2a54e22740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T09:21:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:21:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:21:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:21:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2a380a32f0 msgr2=0x7f2a380a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2a380a32f0 0x7f2a380a57b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2a440bd700 tx=0x7f2a440a8040 comp rx=0 tx=0).stop 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 msgr2=0x7f2a4c19f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c19f360 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2a44003ba0 tx=0x7f2a44003bd0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 shutdown_connections 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f2a380a32f0 0x7f2a380a57b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a4c103710 0x7f2a4c19f360 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2a4c102d50 0x7f2a4c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 --2- 172.21.15.46:0/3496751388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2a4c101b60 0x7f2a4c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 >> 172.21.15.46:0/3496751388 conn(0x7f2a4c0fd2e0 msgr2=0x7f2a4c105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 shutdown_connections 2024-09-19T09:21:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:21:55.065+0000 7f2a52082640 1 -- 172.21.15.46:0/3496751388 wait complete. 2024-09-19T09:21:56.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:56 smithi099 ceph-mon[35256]: pgmap v448: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.2 MiB/s wr, 219 op/s 2024-09-19T09:21:56.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:56 smithi115 ceph-mon[35055]: pgmap v448: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.2 MiB/s wr, 219 op/s 2024-09-19T09:21:56.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:56 smithi046 ceph-mon[31203]: pgmap v448: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.2 MiB/s wr, 219 op/s 2024-09-19T09:21:58.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:21:58 smithi099 ceph-mon[35256]: pgmap v449: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 985 KiB/s wr, 147 op/s 2024-09-19T09:21:58.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:21:58 smithi115 ceph-mon[35055]: pgmap v449: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 985 KiB/s wr, 147 op/s 2024-09-19T09:21:58.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:21:58 smithi046 ceph-mon[31203]: pgmap v449: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 985 KiB/s wr, 147 op/s 2024-09-19T09:21:59.512 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:21:59.785 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 -- 172.21.15.46:0/2877126366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744102790 msgr2=0x7f97441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 --2- 172.21.15.46:0/2877126366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744102790 0x7f97441067e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9738009900 tx=0x7f973802a410 comp rx=0 tx=0).stop 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 -- 172.21.15.46:0/2877126366 shutdown_connections 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 --2- 172.21.15.46:0/2877126366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744102790 0x7f97441067e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 --2- 172.21.15.46:0/2877126366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744106f10 0x7f974410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 --2- 172.21.15.46:0/2877126366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 0x7f97441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 -- 172.21.15.46:0/2877126366 >> 172.21.15.46:0/2877126366 conn(0x7f97440fd8c0 msgr2=0x7f97440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 -- 172.21.15.46:0/2877126366 shutdown_connections 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.273+0000 7f974995f640 1 -- 172.21.15.46:0/2877126366 wait complete. 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 Processor -- start 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 -- start start 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 0x7f9744198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744102790 0x7f97441989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 0x7f974419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9744111f70 con 0x7f9744106f10 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9744111df0 con 0x7f9744101de0 2024-09-19T09:22:00.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f974995f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f97441120f0 con 0x7f9744102790 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f97437fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 0x7f974419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f97437fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 0x7f974419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45802/0 (socket says 172.21.15.46:45802) 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.274+0000 7f97437fe640 1 -- 172.21.15.46:0/2364877644 learned_addr learned my addr 172.21.15.46:0/2364877644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f9742ffd640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 0x7f9744198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97427fc640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744102790 0x7f97441989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97437fe640 1 -- 172.21.15.46:0/2364877644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744102790 msgr2=0x7f97441989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97437fe640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744102790 0x7f97441989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97437fe640 1 -- 172.21.15.46:0/2364877644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 msgr2=0x7f9744198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97437fe640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 0x7f9744198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97437fe640 1 -- 172.21.15.46:0/2364877644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974419d440 con 0x7f9744106f10 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f9742ffd640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 0x7f9744198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:00.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f97437fe640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 0x7f974419cd60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f973c00eaa0 tx=0x7f973c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c00cdb0 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974419d730 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f973c005020 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c0116b0 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.275+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97441a5010 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.276+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97441021c0 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.278+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f973c005560 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.278+0000 7f974895d640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f972c0a3240 0x7f972c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.278+0000 7f9742ffd640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f972c0a3240 0x7f972c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.278+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f973c0cfb70 con 0x7f9744106f10 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.279+0000 7f9742ffd640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f972c0a3240 0x7f972c0a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f97340058c0 tx=0x7f9734005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:00.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.283+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f973c016030 con 0x7f9744106f10 2024-09-19T09:22:00.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:00 smithi046 ceph-mon[31203]: pgmap v450: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T09:22:00.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.497+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9744109b60 con 0x7f9744106f10 2024-09-19T09:22:00.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.498+0000 7f974895d640 1 -- 172.21.15.46:0/2364877644 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11967 (secure 0 0 0) 0x7f973c09c8c0 con 0x7f9744106f10 2024-09-19T09:22:00.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:22:00.500 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-19T09:21:29:130184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:21:29.130168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:22:00.500 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-19T09:22:00.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f972c0a3240 msgr2=0x7f972c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f972c0a3240 0x7f972c0a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f97340058c0 tx=0x7f9734005850 comp rx=0 tx=0).stop 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 msgr2=0x7f974419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 0x7f974419cd60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f973c00eaa0 tx=0x7f973c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 shutdown_connections 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f972c0a3240 0x7f972c0a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9744106f10 0x7f974419cd60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9744102790 0x7f97441989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 --2- 172.21.15.46:0/2364877644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9744101de0 0x7f9744198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 >> 172.21.15.46:0/2364877644 conn(0x7f97440fd8c0 msgr2=0x7f97440fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 shutdown_connections 2024-09-19T09:22:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:00.500+0000 7f974995f640 1 -- 172.21.15.46:0/2364877644 wait complete. 2024-09-19T09:22:00.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:00 smithi099 ceph-mon[35256]: pgmap v450: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T09:22:00.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:00 smithi115 ceph-mon[35055]: pgmap v450: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T09:22:01.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:01 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2364877644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:01.588 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:01 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2364877644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:01.625 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 6eab7a3d --release --await' 2024-09-19T09:22:01.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 6eab7a3d --release --await 2024-09-19T09:22:01.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:01 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2364877644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:01.891 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:02.293 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:02 smithi046 ceph-mon[31203]: pgmap v451: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 62 KiB/s wr, 36 op/s 2024-09-19T09:22:02.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3482992476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578101420 msgr2=0x7fb57810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3482992476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578101420 0x7fb57810d950 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb570009cd0 tx=0x7fb57002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3482992476 shutdown_connections 2024-09-19T09:22:02.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3482992476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578101420 0x7fb57810d950 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3482992476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb578100a80 0x7fb578100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3482992476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb578106a80 0x7fb578106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3482992476 >> 172.21.15.46:0/3482992476 conn(0x7fb5780fc7a0 msgr2=0x7fb5780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3482992476 shutdown_connections 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.381+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3482992476 wait complete. 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 Processor -- start 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 -- start start 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb578100a80 0x7fb578198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb578101420 0x7fb578198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 0x7fb57819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb578110e80 con 0x7fb578106a80 2024-09-19T09:22:02.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb578110d00 con 0x7fb578100a80 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57f1eb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb578111000 con 0x7fb578101420 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57d788640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 0x7fb57819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57d788640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 0x7fb57819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45830/0 (socket says 172.21.15.46:45830) 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.382+0000 7fb57d788640 1 -- 172.21.15.46:0/3740098929 learned_addr learned my addr 172.21.15.46:0/3740098929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57cf87640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb578100a80 0x7fb578198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb577fff640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb578101420 0x7fb578198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57d788640 1 -- 172.21.15.46:0/3740098929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb578101420 msgr2=0x7fb578198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57d788640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb578101420 0x7fb578198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57d788640 1 -- 172.21.15.46:0/3740098929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb578100a80 msgr2=0x7fb578198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57d788640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb578100a80 0x7fb578198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57d788640 1 -- 172.21.15.46:0/3740098929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57819d400 con 0x7fb578106a80 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57d788640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 0x7fb57819cd20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb570005cc0 tx=0x7fb5700093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb575ffb640 1 -- 172.21.15.46:0/3740098929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570003e00 con 0x7fb578106a80 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb575ffb640 1 -- 172.21.15.46:0/3740098929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb570004520 con 0x7fb578106a80 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57819d690 con 0x7fb578106a80 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb575ffb640 1 -- 172.21.15.46:0/3740098929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570030db0 con 0x7fb578106a80 2024-09-19T09:22:02.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.383+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781a4fd0 con 0x7fb578106a80 2024-09-19T09:22:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb575ffb640 1 -- 172.21.15.46:0/3740098929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb5700046d0 con 0x7fb578106a80 2024-09-19T09:22:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 Processor -- start 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 -- start start 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba577300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba586110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 0x55d3ba588a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d3ba4dc620 con 0x55d3ba576f20 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d3ba483e50 con 0x55d3ba577840 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb5815c4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d3ba4d85e0 con 0x55d3ba586650 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba577300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb575ffb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb5680a3240 0x7fb5680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba577300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45832/0 (socket says 172.21.15.46:45832) 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.386+0000 7fb577fff640 1 -- 172.21.15.46:0/104194409 learned_addr learned my addr 172.21.15.46:0/104194409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:02.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb57cf87640 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba586110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb57d788640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb5680a3240 0x7fb5680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb575ffb640 1 -- 172.21.15.46:0/3740098929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb57002e030 con 0x7fb578106a80 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb577fff640 1 -- 172.21.15.46:0/104194409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 msgr2=0x55d3ba588a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb577fff640 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 0x55d3ba588a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb577fff640 1 -- 172.21.15.46:0/104194409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 msgr2=0x55d3ba586110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb577fff640 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba586110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb577fff640 1 -- 172.21.15.46:0/104194409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ba474d40 con 0x55d3ba576f20 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb577fff640 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba577300 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb564009d40 tx=0x7fb564013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2007c4c83bf1ddf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb57d788640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb5680a3240 0x7fb5680a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb570009ca0 tx=0x7fb57003d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb562ffd640 1 -- 172.21.15.46:0/104194409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56401c470 con 0x55d3ba576f20 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb562ffd640 1 -- 172.21.15.46:0/104194409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564017070 con 0x55d3ba576f20 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.387+0000 7fb562ffd640 1 -- 172.21.15.46:0/104194409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56400f6b0 con 0x55d3ba576f20 2024-09-19T09:22:02.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 -- 172.21.15.46:0/104194409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 msgr2=0x55d3ba577300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba577300 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb564009d40 tx=0x7fb564013830 comp rx=0 tx=0).stop 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 -- 172.21.15.46:0/104194409 shutdown_connections 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 0x55d3ba588a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba586110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 --2- 172.21.15.46:0/104194409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba577300 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 -- 172.21.15.46:0/104194409 >> 172.21.15.46:0/104194409 conn(0x55d3ba5735f0 msgr2=0x55d3ba5739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 -- 172.21.15.46:0/104194409 shutdown_connections 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 -- 172.21.15.46:0/104194409 wait complete. 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.388+0000 7fb5815c4740 1 -- start start 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 Processor -- start 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba576f20 0x55d3ba583600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba583b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 0x55d3ba584080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55d3ba589220 con 0x55d3ba586650 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55d3ba464f10 con 0x55d3ba577840 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55d3ba5893a0 con 0x55d3ba576f20 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb5815c4740 10 client.0 _ll_register_callbacks cb 0x55d3ba488db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 0x55d3ba584080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 0x55d3ba584080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45846/0 (socket says 172.21.15.46:45846) 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 -- 172.21.15.46:0/965796713 learned_addr learned my addr 172.21.15.46:0/965796713 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb57cf87640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba583b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba576f20 0x55d3ba583600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 -- 172.21.15.46:0/965796713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba576f20 msgr2=0x55d3ba583600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba576f20 0x55d3ba583600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.389+0000 7fb577fff640 1 -- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 msgr2=0x55d3ba583b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb577fff640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba583b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb577fff640 1 -- 172.21.15.46:0/965796713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ba1eb580 con 0x55d3ba586650 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb57cf87640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba583b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb577fff640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 0x55d3ba584080 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb564013fd0 tx=0x7fb564010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9002d02d9159d4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb557fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb557fff640 1 -- 172.21.15.46:0/965796713 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5640109e0 con 0x55d3ba586650 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb557fff640 1 -- 172.21.15.46:0/965796713 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb564010b80 con 0x55d3ba586650 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb564017070 con 0x55d3ba586650 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb557fff640 1 -- 172.21.15.46:0/965796713 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb564032050 con 0x55d3ba586650 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb5815c4740 10 client.16458 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:02.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d3ba2b5960 con 0x55d3ba586650 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb557fff640 1 -- 172.21.15.46:0/965796713 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564017070 con 0x55d3ba586650 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.390+0000 7fb557fff640 1 -- 172.21.15.46:0/965796713 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fb56401c470 con 0x55d3ba586650 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb5815c4740 10 client.16458 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb5815c4740 10 client.16458 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb5815c4740 20 client.16458 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb5815c4740 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba598540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb5815c4740 4 client.16458 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3ba4e9b90 con 0x55d3ba596150 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb57cf87640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba598540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb57cf87640 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba598540 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32806530cce60a44 server_cookie=20079d3e27aad213 in_seq=0 out_seq=0 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.391+0000 7fb557fff640 10 client.16458 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb557fff640 1 -- 172.21.15.46:0/965796713 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3ba4e9b90 con 0x55d3ba596150 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb557fff640 10 client.16458 handle_command_reply: tid=0 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 client.16458 shutdown 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 msgr2=0x55d3ba584080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 0x55d3ba584080 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb564013fd0 tx=0x7fb564010e80 comp rx=0 tx=0).stop 2024-09-19T09:22:02.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 shutdown_connections 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba598540 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba586650 0x55d3ba584080 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb557fff640 0 client.16458 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba583b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 --2- 172.21.15.46:0/965796713 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba576f20 0x55d3ba583600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 >> 172.21.15.46:0/965796713 conn(0x55d3ba5735f0 msgr2=0x55d3ba579350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 shutdown_connections 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 1 -- 172.21.15.46:0/965796713 wait complete. 2024-09-19T09:22:02.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.392+0000 7fb5815c4740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T09:22:02.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 Processor -- start 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 -- start start 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba585570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba577840 0x55d3ba59dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba586650 0x55d3ba59e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb5781ab330 con 0x55d3ba576f20 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb5781acf30 con 0x55d3ba586650 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb5815c4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5781aba00 con 0x55d3ba577840 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba585570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba585570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45848/0 (socket says 172.21.15.46:45848) 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 -- 172.21.15.46:0/1505001931 learned_addr learned my addr 172.21.15.46:0/1505001931 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb57cf87640 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba577840 0x55d3ba59dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba586650 0x55d3ba59e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 -- 172.21.15.46:0/1505001931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba577840 msgr2=0x55d3ba59dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba577840 0x55d3ba59dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 -- 172.21.15.46:0/1505001931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba586650 msgr2=0x55d3ba59e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba586650 0x55d3ba59e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.410+0000 7fb577fff640 1 -- 172.21.15.46:0/1505001931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3ba577670 con 0x55d3ba576f20 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb577fff640 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba585570 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb5640107c0 tx=0x7fb564005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442ab4180e81a375 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:02.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5627fc640 1 -- 172.21.15.46:0/1505001931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564013d30 con 0x55d3ba576f20 2024-09-19T09:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5627fc640 1 -- 172.21.15.46:0/1505001931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564017070 con 0x55d3ba576f20 2024-09-19T09:22:02.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5627fc640 1 -- 172.21.15.46:0/1505001931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564010930 con 0x55d3ba576f20 2024-09-19T09:22:02.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 -- 172.21.15.46:0/1505001931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 msgr2=0x55d3ba585570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba585570 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb5640107c0 tx=0x7fb564005f90 comp rx=0 tx=0).stop 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 -- 172.21.15.46:0/1505001931 shutdown_connections 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba586650 0x55d3ba59e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba577840 0x55d3ba59dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1505001931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba585570 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 -- 172.21.15.46:0/1505001931 >> 172.21.15.46:0/1505001931 conn(0x55d3ba5735f0 msgr2=0x55d3ba584e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 -- 172.21.15.46:0/1505001931 shutdown_connections 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.411+0000 7fb5815c4740 1 -- 172.21.15.46:0/1505001931 wait complete. 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 -- start start 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 Processor -- start 2024-09-19T09:22:02.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba58a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba58aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 0x55d3ba5ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb5781ac860 con 0x55d3ba576f20 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb5781ac0d0 con 0x55d3ba577840 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb5781a9330 con 0x55d3ba586650 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb5815c4740 10 client.0 _ll_register_callbacks cb 0x7fb564010880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba58a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb577fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba58a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45854/0 (socket says 172.21.15.46:45854) 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb577fff640 1 -- 172.21.15.46:0/1001138674 learned_addr learned my addr 172.21.15.46:0/1001138674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.412+0000 7fb57cf87640 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba58aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb577fff640 1 -- 172.21.15.46:0/1001138674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 msgr2=0x55d3ba5ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb577fff640 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 0x55d3ba5ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb577fff640 1 -- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 msgr2=0x55d3ba58aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb577fff640 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba58aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb577fff640 1 -- 172.21.15.46:0/1001138674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3ba600170 con 0x55d3ba576f20 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb577fff640 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba58a760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb56400a010 tx=0x7fb564005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe43d631b63b5767 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb557fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb557fff640 1 -- 172.21.15.46:0/1001138674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56403b060 con 0x55d3ba576f20 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb557fff640 1 -- 172.21.15.46:0/1001138674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb564010930 con 0x55d3ba576f20 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb564017070 con 0x55d3ba576f20 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb557fff640 1 -- 172.21.15.46:0/1001138674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb564010b30 con 0x55d3ba576f20 2024-09-19T09:22:02.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb5815c4740 10 client.16464 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d3ba601330 con 0x55d3ba576f20 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.413+0000 7fb557fff640 1 -- 172.21.15.46:0/1001138674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb564017070 con 0x55d3ba576f20 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb557fff640 1 -- 172.21.15.46:0/1001138674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fb5640039c0 con 0x55d3ba576f20 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb5815c4740 10 client.16464 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb5815c4740 10 client.16464 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb5815c4740 20 client.16464 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba603a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb5815c4740 4 client.16464 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6eab7a3d", "release": true, "await": true}] 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6eab7a3d", "release": true, "await": true}) -- 0x55d3ba584410 con 0x55d3ba596150 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb57cf87640 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba603a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb557fff640 10 client.16464 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:02.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.414+0000 7fb57cf87640 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba603a70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f2e0774b1316c5 server_cookie=24574a78ac57d8e8 in_seq=0 out_seq=0 2024-09-19T09:22:02.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:02 smithi099 ceph-mon[35256]: pgmap v451: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 62 KiB/s wr, 36 op/s 2024-09-19T09:22:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb557fff640 1 -- 172.21.15.46:0/1001138674 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d3ba584410 con 0x55d3ba596150 2024-09-19T09:22:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb557fff640 10 client.16464 handle_command_reply: tid=0 2024-09-19T09:22:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 client.16464 shutdown 2024-09-19T09:22:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 msgr2=0x55d3ba58a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba58a760 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb56400a010 tx=0x7fb564005da0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 shutdown_connections 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55d3ba596150 0x55d3ba603a70 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55d3ba586650 0x55d3ba5ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d3ba577840 0x55d3ba58aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 --2- 172.21.15.46:0/1001138674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55d3ba576f20 0x55d3ba58a760 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 >> 172.21.15.46:0/1001138674 conn(0x55d3ba5735f0 msgr2=0x55d3ba585680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb557fff640 0 client.16464 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 shutdown_connections 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 1 -- 172.21.15.46:0/1001138674 wait complete. 2024-09-19T09:22:02.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.518+0000 7fb5815c4740 20 client.16464 trim_cache size 0 max 16384 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 16, 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout: "6eab7a3d": { 2024-09-19T09:22:02.522 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 16, 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 136.6, 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:22:02.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:02.524 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb5680a3240 msgr2=0x7fb5680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb5680a3240 0x7fb5680a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb570009ca0 tx=0x7fb57003d040 comp rx=0 tx=0).stop 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 msgr2=0x7fb57819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 0x7fb57819cd20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb570005cc0 tx=0x7fb5700093d0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 shutdown_connections 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb5680a3240 0x7fb5680a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb578106a80 0x7fb57819cd20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb578101420 0x7fb578198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 --2- 172.21.15.46:0/3740098929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb578100a80 0x7fb578198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:02.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 >> 172.21.15.46:0/3740098929 conn(0x7fb5780fc7a0 msgr2=0x7fb57806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 shutdown_connections 2024-09-19T09:22:02.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:02.519+0000 7fb57f1eb640 1 -- 172.21.15.46:0/3740098929 wait complete. 2024-09-19T09:22:02.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:02 smithi115 ceph-mon[35055]: pgmap v451: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 62 KiB/s wr, 36 op/s 2024-09-19T09:22:03.331 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6eab7a3d', total seconds elapsed: 20.5 2024-09-19T09:22:04.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:04 smithi099 ceph-mon[35256]: pgmap v452: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 17 op/s 2024-09-19T09:22:04.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:04 smithi115 ceph-mon[35055]: pgmap v452: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 17 op/s 2024-09-19T09:22:04.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:04 smithi046 ceph-mon[31203]: pgmap v452: 97 pgs: 97 active+clean; 49 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 10 KiB/s wr, 17 op/s 2024-09-19T09:22:04.956 INFO:tasks.workunit.client.0.smithi046.stdout:50000 copy from 0x898b8 to 0x92015, (0x875d bytes) at 0xb142c 2024-09-19T09:22:04.957 INFO:tasks.workunit.client.0.smithi046.stdout:All 50000 operations completed A-OK! 2024-09-19T09:22:04.957 INFO:tasks.workunit.client.0.smithi046.stderr:+ ./fsx -z 10MB -N 50000 -p 10000 -l 10485760 2024-09-19T09:22:04.959 INFO:tasks.workunit.client.0.smithi046.stdout:Seed set to 1 2024-09-19T09:22:05.087 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-19T09:22:05.087 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-19T09:22:05.088 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T09:22:05.088 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T09:22:05.088 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T09:22:05.091 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T09:22:05.093 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero length punch hole 2024-09-19T09:22:05.093 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero length punch hole 2024-09-19T09:22:05.094 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero length punch hole 2024-09-19T09:22:05.094 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support exchange range, disabling! 2024-09-19T09:22:05.094 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero size read 2024-09-19T09:22:05.094 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero length punch hole 2024-09-19T09:22:05.094 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero size read 2024-09-19T09:22:05.095 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero length punch hole 2024-09-19T09:22:05.095 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x4310e9 2024-09-19T09:22:05.098 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x954a45 2024-09-19T09:22:05.125 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x9bc582 2024-09-19T09:22:05.144 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x9eecbc 2024-09-19T09:22:06.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:06 smithi099 ceph-mon[35256]: pgmap v453: 97 pgs: 97 active+clean; 50 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 49 op/s 2024-09-19T09:22:06.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:06 smithi115 ceph-mon[35055]: pgmap v453: 97 pgs: 97 active+clean; 50 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 49 op/s 2024-09-19T09:22:06.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:06 smithi046 ceph-mon[31203]: pgmap v453: 97 pgs: 97 active+clean; 50 MiB data, 785 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 108 KiB/s wr, 49 op/s 2024-09-19T09:22:06.808 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x9fdd84 2024-09-19T09:22:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.163+0000 7f4274da6640 1 -- 172.21.15.46:0/3929079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270103700 msgr2=0x7f4270109f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.163+0000 7f4274da6640 1 --2- 172.21.15.46:0/3929079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270103700 0x7f4270109f90 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4268009ca0 tx=0x7f426802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 -- 172.21.15.46:0/3929079535 shutdown_connections 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 --2- 172.21.15.46:0/3929079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270103700 0x7f4270109f90 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 --2- 172.21.15.46:0/3929079535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 0x7f42701031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 --2- 172.21.15.46:0/3929079535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270101b50 0x7f4270101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 -- 172.21.15.46:0/3929079535 >> 172.21.15.46:0/3929079535 conn(0x7f42700fd2b0 msgr2=0x7f42700ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 -- 172.21.15.46:0/3929079535 shutdown_connections 2024-09-19T09:22:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 -- 172.21.15.46:0/3929079535 wait complete. 2024-09-19T09:22:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.164+0000 7f4274da6640 1 Processor -- start 2024-09-19T09:22:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 -- start start 2024-09-19T09:22:08.168 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 0x7f4270197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 0x7f4270198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103700 0x7f427019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f427010d7d0 con 0x7f4270101b50 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f427010d650 con 0x7f4270102d40 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f4274da6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f427010d950 con 0x7f4270103700 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 0x7f4270197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 0x7f4270197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45876/0 (socket says 172.21.15.46:45876) 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 0x7f4270198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426e59c640 1 -- 172.21.15.46:0/3568962761 learned_addr learned my addr 172.21.15.46:0/3568962761 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426ed9d640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103700 0x7f427019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 -- 172.21.15.46:0/3568962761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103700 msgr2=0x7f427019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.169 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103700 0x7f427019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 -- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 msgr2=0x7f4270197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 0x7f4270197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 -- 172.21.15.46:0/3568962761 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427019f9e0 con 0x7f4270102d40 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426e59c640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 0x7f4270197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426ed9d640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103700 0x7f427019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.165+0000 7f426dd9b640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 0x7f4270198300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f426400e9f0 tx=0x7f426400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.166+0000 7f425f7fe640 1 -- 172.21.15.46:0/3568962761 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426400cd80 con 0x7f4270102d40 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.166+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f427019fcd0 con 0x7f4270102d40 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.166+0000 7f425f7fe640 1 -- 172.21.15.46:0/3568962761 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42640035f0 con 0x7f4270102d40 2024-09-19T09:22:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.166+0000 7f425f7fe640 1 -- 172.21.15.46:0/3568962761 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264010670 con 0x7f4270102d40 2024-09-19T09:22:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.166+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701a01c0 con 0x7f4270102d40 2024-09-19T09:22:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.168+0000 7f425f7fe640 1 -- 172.21.15.46:0/3568962761 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f42640037a0 con 0x7f4270102d40 2024-09-19T09:22:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 Processor -- start 2024-09-19T09:22:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f425f7fe640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f42580a32f0 0x7f42580a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f426ed9d640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f42580a32f0 0x7f42580a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.178 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f425f7fe640 1 -- 172.21.15.46:0/3568962761 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f42640cfbb0 con 0x7f4270102d40 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 -- start start 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 0x55a63d1cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a63d12c2f0 con 0x55a63d1d2780 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a63d0d4270 con 0x55a63d1cd6f0 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f4277c1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a63d1282b0 con 0x55a63d1ccdb0 2024-09-19T09:22:08.179 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f426e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 0x55a63d1cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f426e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 0x55a63d1cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:38540/0 (socket says 172.21.15.46:38540) 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f426e59c640 1 -- 172.21.15.46:0/1250637141 learned_addr learned my addr 172.21.15.46:0/1250637141 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.169+0000 7f426ed9d640 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426ed9d640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f42580a32f0 0x7f42580a57b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4268005cc0 tx=0x7f4268005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426e59c640 1 -- 172.21.15.46:0/1250637141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 msgr2=0x55a63d1d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.180 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426e59c640 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426e59c640 1 -- 172.21.15.46:0/1250637141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 msgr2=0x55a63d1d4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426e59c640 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1d4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426e59c640 1 -- 172.21.15.46:0/1250637141 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63d0d3340 con 0x55a63d1ccdb0 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426ed9d640 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f426e59c640 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 0x55a63d1cd1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42600115f0 tx=0x7f4260011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=282d6a495a84c09c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f425cff9640 1 -- 172.21.15.46:0/1250637141 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260004020 con 0x55a63d1ccdb0 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f425cff9640 1 -- 172.21.15.46:0/1250637141 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600041c0 con 0x55a63d1ccdb0 2024-09-19T09:22:08.181 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.170+0000 7f425cff9640 1 -- 172.21.15.46:0/1250637141 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600039d0 con 0x55a63d1ccdb0 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 -- 172.21.15.46:0/1250637141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 msgr2=0x55a63d1cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 0x55a63d1cd1b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42600115f0 tx=0x7f4260011ab0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 -- 172.21.15.46:0/1250637141 shutdown_connections 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 --2- 172.21.15.46:0/1250637141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1ccdb0 0x55a63d1cd1b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.182 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 -- 172.21.15.46:0/1250637141 >> 172.21.15.46:0/1250637141 conn(0x55a63d1c8420 msgr2=0x55a63d1c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 -- 172.21.15.46:0/1250637141 shutdown_connections 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.171+0000 7f4277c1e740 1 -- 172.21.15.46:0/1250637141 wait complete. 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 -- start start 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 Processor -- start 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1de530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a63d1d5750 con 0x55a63d1cd6f0 2024-09-19T09:22:08.183 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a63d0b5290 con 0x55a63d1ccdb0 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a63d1d58d0 con 0x55a63d1d2780 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f4277c1e740 10 client.0 _ll_register_callbacks cb 0x55a63d0e6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45892/0 (socket says 172.21.15.46:45892) 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f426dd9b640 1 -- 172.21.15.46:0/2402550764 learned_addr learned my addr 172.21.15.46:0/2402550764 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f426ed9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1de530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.184 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.172+0000 7f426e59c640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426e59c640 1 -- 172.21.15.46:0/2402550764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 msgr2=0x55a63d1de530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426e59c640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1de530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426e59c640 1 -- 172.21.15.46:0/2402550764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 msgr2=0x55a63d1d74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426e59c640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426e59c640 1 -- 172.21.15.46:0/2402550764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63ce3f210 con 0x55a63d1ccdb0 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426ed9d640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426dd9b640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:08.185 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f426e59c640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d6fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42600058c0 tx=0x7f42600045a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1447732e6cca2d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4255ffb640 1 -- 172.21.15.46:0/2402550764 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260027020 con 0x55a63d1ccdb0 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4255ffb640 1 -- 172.21.15.46:0/2402550764 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f4260016040 con 0x55a63d1ccdb0 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42600041c0 con 0x55a63d1ccdb0 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4255ffb640 1 -- 172.21.15.46:0/2402550764 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4260009d60 con 0x55a63d1ccdb0 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4277c1e740 10 client.25973 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:08.186 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a63cf0b620 con 0x55a63d1ccdb0 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.173+0000 7f4255ffb640 1 -- 172.21.15.46:0/2402550764 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42600041c0 con 0x55a63d1ccdb0 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4255ffb640 1 -- 172.21.15.46:0/2402550764 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f42600036d0 con 0x55a63d1ccdb0 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4277c1e740 10 client.25973 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4277c1e740 10 client.25973 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4277c1e740 20 client.25973 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d1e2a60 0x55a63d1e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.187 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4277c1e740 4 client.25973 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a63d139a20 con 0x55a63d1e2a60 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f426dd9b640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d1e2a60 0x55a63d1e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f4255ffb640 10 client.25973 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.174+0000 7f426dd9b640 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d1e2a60 0x55a63d1e4ea0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29191e43bbc1c31 server_cookie=9c57e0b329653a4d in_seq=0 out_seq=0 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4255ffb640 1 -- 172.21.15.46:0/2402550764 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a63d139a20 con 0x55a63d1e2a60 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4255ffb640 10 client.25973 handle_command_reply: tid=0 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 client.25973 shutdown 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 msgr2=0x55a63d1d6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d6fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42600058c0 tx=0x7f42600045a0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.188 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 shutdown_connections 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d1e2a60 0x55a63d1e4ea0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1cd6f0 0x55a63d1d74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4255ffb640 0 client.25973 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1de530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2402550764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d6fb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 >> 172.21.15.46:0/2402550764 conn(0x55a63d1c8420 msgr2=0x55a63d1c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 shutdown_connections 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.175+0000 7f4277c1e740 1 -- 172.21.15.46:0/2402550764 wait complete. 2024-09-19T09:22:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.176+0000 7f4277c1e740 20 client.25973 trim_cache size 0 max 16384 2024-09-19T09:22:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 Processor -- start 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 -- start start 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a6d80 con 0x55a63d1ccdb0 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a8980 con 0x55a63d1cd6f0 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.192+0000 7f4277c1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a7450 con 0x55a63d1d2780 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426ed9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45898/0 (socket says 172.21.15.46:45898) 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426e59c640 1 -- 172.21.15.46:0/3363152712 learned_addr learned my addr 172.21.15.46:0/3363152712 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 -- 172.21.15.46:0/3363152712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 msgr2=0x55a63d1c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 -- 172.21.15.46:0/3363152712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 msgr2=0x55a63d1d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 -- 172.21.15.46:0/3363152712 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63d1ce350 con 0x55a63d1cd6f0 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426e59c640 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f426dd9b640 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1de4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42640cd6e0 tx=0x7f426409f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b4afd98a39e3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f4257fff640 1 -- 172.21.15.46:0/3363152712 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264009410 con 0x55a63d1cd6f0 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f4257fff640 1 -- 172.21.15.46:0/3363152712 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f426409a2a0 con 0x55a63d1cd6f0 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.193+0000 7f4257fff640 1 -- 172.21.15.46:0/3363152712 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640a0120 con 0x55a63d1cd6f0 2024-09-19T09:22:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 -- 172.21.15.46:0/3363152712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 msgr2=0x55a63d1de4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1de4f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42640cd6e0 tx=0x7f426409f040 comp rx=0 tx=0).stop 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 -- 172.21.15.46:0/3363152712 shutdown_connections 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1d2780 0x55a63d1c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1cd6f0 0x55a63d1de4f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 --2- 172.21.15.46:0/3363152712 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1ccdb0 0x55a63d1d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 -- 172.21.15.46:0/3363152712 >> 172.21.15.46:0/3363152712 conn(0x55a63d1c8420 msgr2=0x55a63d1c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 -- 172.21.15.46:0/3363152712 shutdown_connections 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 -- 172.21.15.46:0/3363152712 wait complete. 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 -- start start 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.194+0000 7f4277c1e740 1 Processor -- start 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1db610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1cd6f0 0x55a63d1dbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1dcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a82b0 con 0x55a63d1d2780 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a7b20 con 0x55a63d1ccdb0 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f42701a4d60 con 0x55a63d1cd6f0 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4277c1e740 10 client.0 _ll_register_callbacks cb 0x7f4264097e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1dcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1cd6f0 0x55a63d1dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1db610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1dcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45910/0 (socket says 172.21.15.46:45910) 2024-09-19T09:22:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1cd6f0 0x55a63d1dbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:38564/0 (socket says 172.21.15.46:38564) 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 -- 172.21.15.46:0/2593687721 learned_addr learned my addr 172.21.15.46:0/2593687721 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 -- 172.21.15.46:0/2593687721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1cd6f0 msgr2=0x55a63d1dbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1cd6f0 0x55a63d1dbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 -- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 msgr2=0x55a63d1db610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1db610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 -- 172.21.15.46:0/2593687721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a63d1dd120 con 0x55a63d1d2780 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426e59c640 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1db610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f426ed9d640 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1dcb10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4268031940 tx=0x7f426802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cb5563fb792fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.195+0000 7f4255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4255ffb640 1 -- 172.21.15.46:0/2593687721 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268030cc0 con 0x55a63d1d2780 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4255ffb640 1 -- 172.21.15.46:0/2593687721 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f4268030e60 con 0x55a63d1d2780 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f426409a2a0 con 0x55a63d1d2780 2024-09-19T09:22:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4255ffb640 1 -- 172.21.15.46:0/2593687721 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f426803c410 con 0x55a63d1d2780 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 10 client.16482 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a63d1de4a0 con 0x55a63d1d2780 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4255ffb640 1 -- 172.21.15.46:0/2593687721 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f426409a2a0 con 0x55a63d1d2780 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4255ffb640 1 -- 172.21.15.46:0/2593687721 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f42680485b0 con 0x55a63d1d2780 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 10 client.16482 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 10 client.16482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 20 client.16482 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d24dca0 0x55a63d2500c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 4 client.16482 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a63d133d70 con 0x55a63d24dca0 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.196+0000 7f426e59c640 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d24dca0 0x55a63d2500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.197+0000 7f4255ffb640 10 client.16482 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.197+0000 7f426e59c640 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d24dca0 0x55a63d2500c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fd310c09496b19f server_cookie=a895571326bc9e9b in_seq=0 out_seq=0 2024-09-19T09:22:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.207+0000 7f4255ffb640 1 -- 172.21.15.46:0/2593687721 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a63d133d70 con 0x55a63d24dca0 2024-09-19T09:22:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.207+0000 7f4255ffb640 10 client.16482 handle_command_reply: tid=0 2024-09-19T09:22:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.207+0000 7f4277c1e740 1 client.16482 shutdown 2024-09-19T09:22:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 msgr2=0x55a63d1dcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1dcb10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4268031940 tx=0x7f426802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 shutdown_connections 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a63d24dca0 0x55a63d2500c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a63d1d2780 0x55a63d1dcb10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a63d1cd6f0 0x55a63d1dbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4255ffb640 0 client.16482 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 --2- 172.21.15.46:0/2593687721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a63d1ccdb0 0x55a63d1db610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 >> 172.21.15.46:0/2593687721 conn(0x55a63d1c8420 msgr2=0x55a63d1c31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 shutdown_connections 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 1 -- 172.21.15.46:0/2593687721 wait complete. 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4277c1e740 20 client.16482 trim_cache size 0 max 16384 2024-09-19T09:22:08.211 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:22:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:22:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:22:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f42580a32f0 msgr2=0x7f42580a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4274da6640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f42580a32f0 0x7f42580a57b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4268005cc0 tx=0x7f4268005c30 comp rx=0 tx=0).stop 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 msgr2=0x7f4270198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.208+0000 7f4274da6640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 0x7f4270198300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f426400e9f0 tx=0x7f426400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 shutdown_connections 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f42580a32f0 0x7f42580a57b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4270103700 0x7f427019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4270102d40 0x7f4270198300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 --2- 172.21.15.46:0/3568962761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4270101b50 0x7f4270197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 >> 172.21.15.46:0/3568962761 conn(0x7f42700fd2b0 msgr2=0x7f4270105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 shutdown_connections 2024-09-19T09:22:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:08.209+0000 7f4274da6640 1 -- 172.21.15.46:0/3568962761 wait complete. 2024-09-19T09:22:08.513 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:08 smithi099 ceph-mon[35256]: pgmap v454: 97 pgs: 97 active+clean; 54 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.0 MiB/s wr, 180 op/s 2024-09-19T09:22:08.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:08 smithi115 ceph-mon[35055]: pgmap v454: 97 pgs: 97 active+clean; 54 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.0 MiB/s wr, 180 op/s 2024-09-19T09:22:08.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:08 smithi046 ceph-mon[31203]: pgmap v454: 97 pgs: 97 active+clean; 54 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.0 MiB/s wr, 180 op/s 2024-09-19T09:22:10.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:10 smithi099 ceph-mon[35256]: pgmap v455: 97 pgs: 97 active+clean; 54 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.0 MiB/s wr, 176 op/s 2024-09-19T09:22:10.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:10 smithi115 ceph-mon[35055]: pgmap v455: 97 pgs: 97 active+clean; 54 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.0 MiB/s wr, 176 op/s 2024-09-19T09:22:10.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:10 smithi046 ceph-mon[31203]: pgmap v455: 97 pgs: 97 active+clean; 54 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.0 MiB/s wr, 176 op/s 2024-09-19T09:22:12.511 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:12 smithi115 ceph-mon[35055]: pgmap v456: 97 pgs: 97 active+clean; 54 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 385 op/s 2024-09-19T09:22:12.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:12 smithi099 ceph-mon[35256]: pgmap v456: 97 pgs: 97 active+clean; 54 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 385 op/s 2024-09-19T09:22:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:12 smithi046 ceph-mon[31203]: pgmap v456: 97 pgs: 97 active+clean; 54 MiB data, 795 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.8 MiB/s wr, 385 op/s 2024-09-19T09:22:14.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:14 smithi099 ceph-mon[35256]: pgmap v457: 97 pgs: 97 active+clean; 55 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.3 MiB/s wr, 613 op/s 2024-09-19T09:22:14.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:14 smithi115 ceph-mon[35055]: pgmap v457: 97 pgs: 97 active+clean; 55 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.3 MiB/s wr, 613 op/s 2024-09-19T09:22:14.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:14 smithi046 ceph-mon[31203]: pgmap v457: 97 pgs: 97 active+clean; 55 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 3.3 MiB/s wr, 613 op/s 2024-09-19T09:22:15.877 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x9ff773 2024-09-19T09:22:16.202 INFO:tasks.workunit.client.0.smithi046.stdout:20000 punch from 0x34ddcb to 0x35324f, (0x5484 bytes) 2024-09-19T09:22:16.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:16 smithi099 ceph-mon[35256]: pgmap v458: 97 pgs: 97 active+clean; 56 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.7 MiB/s wr, 707 op/s 2024-09-19T09:22:16.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:16 smithi115 ceph-mon[35055]: pgmap v458: 97 pgs: 97 active+clean; 56 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.7 MiB/s wr, 707 op/s 2024-09-19T09:22:16.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:16 smithi046 ceph-mon[31203]: pgmap v458: 97 pgs: 97 active+clean; 56 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 MiB/s rd, 3.7 MiB/s wr, 707 op/s 2024-09-19T09:22:18.512 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:18 smithi099 ceph-mon[35256]: pgmap v459: 97 pgs: 97 active+clean; 53 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.2 MiB/s wr, 932 op/s 2024-09-19T09:22:18.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:18 smithi115 ceph-mon[35055]: pgmap v459: 97 pgs: 97 active+clean; 53 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.2 MiB/s wr, 932 op/s 2024-09-19T09:22:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:18 smithi046 ceph-mon[31203]: pgmap v459: 97 pgs: 97 active+clean; 53 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 5.2 MiB/s wr, 932 op/s 2024-09-19T09:22:20.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:20 smithi115 ceph-mon[35055]: pgmap v460: 97 pgs: 97 active+clean; 53 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 798 op/s 2024-09-19T09:22:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:20 smithi046 ceph-mon[31203]: pgmap v460: 97 pgs: 97 active+clean; 53 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 798 op/s 2024-09-19T09:22:20.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:20 smithi099 ceph-mon[35256]: pgmap v460: 97 pgs: 97 active+clean; 53 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 798 op/s 2024-09-19T09:22:21.311 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.307+0000 7fb13628d640 1 -- 172.21.15.46:0/740123600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 msgr2=0x7fb13010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.307+0000 7fb13628d640 1 --2- 172.21.15.46:0/740123600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb13010c190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb128009ca0 tx=0x7fb12802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 -- 172.21.15.46:0/740123600 shutdown_connections 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 --2- 172.21.15.46:0/740123600 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb13010c190 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 --2- 172.21.15.46:0/740123600 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130104f40 0x7fb1301053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 --2- 172.21.15.46:0/740123600 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130103d50 0x7fb130104150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 -- 172.21.15.46:0/740123600 >> 172.21.15.46:0/740123600 conn(0x7fb1300ff4b0 msgr2=0x7fb1301018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 -- 172.21.15.46:0/740123600 shutdown_connections 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 -- 172.21.15.46:0/740123600 wait complete. 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 Processor -- start 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.308+0000 7fb13628d640 1 -- start start 2024-09-19T09:22:21.312 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13628d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130103d50 0x7fb130199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13628d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 0x7fb13019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13628d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb1301a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13628d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb13010f9d0 con 0x7fb130105900 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13628d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb13010f850 con 0x7fb130104f40 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13628d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb13010fb50 con 0x7fb130103d50 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13482a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb1301a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 0x7fb13019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130103d50 0x7fb130199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13482a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb1301a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58082/0 (socket says 172.21.15.46:58082) 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13482a640 1 -- 172.21.15.46:0/2668973604 learned_addr learned my addr 172.21.15.46:0/2668973604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:21.313 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 0x7fb13019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:51160/0 (socket says 172.21.15.46:51160) 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 -- 172.21.15.46:0/2668973604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130103d50 msgr2=0x7fb130199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130103d50 0x7fb130199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 -- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 msgr2=0x7fb1301a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb1301a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 -- 172.21.15.46:0/2668973604 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1301a1bb0 con 0x7fb130104f40 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12ffff640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130103d50 0x7fb130199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb13482a640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb1301a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 0x7fb13019a4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb12400e9f0 tx=0x7fb12400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12d7fa640 1 -- 172.21.15.46:0/2668973604 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12400cd80 con 0x7fb130104f40 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.309+0000 7fb12d7fa640 1 -- 172.21.15.46:0/2668973604 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1240035f0 con 0x7fb130104f40 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.310+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1301a1ea0 con 0x7fb130104f40 2024-09-19T09:22:21.314 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.310+0000 7fb12d7fa640 1 -- 172.21.15.46:0/2668973604 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb124010690 con 0x7fb130104f40 2024-09-19T09:22:21.315 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.310+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1301a2360 con 0x7fb130104f40 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.312+0000 7fb12d7fa640 1 -- 172.21.15.46:0/2668973604 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb124003b30 con 0x7fb130104f40 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.312+0000 7fb13902b740 1 Processor -- start 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.312+0000 7fb13902b740 1 -- start start 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13902b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f07789bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13902b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789c2e0 0x55f0778a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13902b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a1370 0x55f0778a3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13902b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f0777ff2f0 con 0x55f07789b9a0 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13902b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f0777a7270 con 0x55f07789c2e0 2024-09-19T09:22:21.320 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13902b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f0777fb2b0 con 0x55f0778a1370 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13482a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f07789bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13482a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f07789bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58096/0 (socket says 172.21.15.46:58096) 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13482a640 1 -- 172.21.15.46:0/1067368158 learned_addr learned my addr 172.21.15.46:0/1067368158 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789c2e0 0x55f0778a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12d7fa640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1180a32f0 0x7fb1180a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a1370 0x55f0778a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb13482a640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1180a32f0 0x7fb1180a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 -- 172.21.15.46:0/1067368158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a1370 msgr2=0x55f0778a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a1370 0x55f0778a3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 -- 172.21.15.46:0/1067368158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 msgr2=0x55f07789bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f07789bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.321 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 -- 172.21.15.46:0/1067368158 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0777a6340 con 0x55f07789c2e0 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a1370 0x55f0778a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12d7fa640 1 -- 172.21.15.46:0/2668973604 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb1240cfc10 con 0x7fb130104f40 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.313+0000 7fb12ffff640 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789c2e0 0x55f0778a0da0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb120009fa0 tx=0x7fb1200118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b674a2a8ecf64832 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13482a640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1180a32f0 0x7fb1180a57b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1280098e0 tx=0x7fb12802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb1167fc640 1 -- 172.21.15.46:0/1067368158 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120004030 con 0x55f07789c2e0 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb1167fc640 1 -- 172.21.15.46:0/1067368158 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1200041d0 con 0x55f07789c2e0 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb1167fc640 1 -- 172.21.15.46:0/1067368158 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12000f8d0 con 0x55f07789c2e0 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 -- 172.21.15.46:0/1067368158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789c2e0 msgr2=0x55f0778a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789c2e0 0x55f0778a0da0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb120009fa0 tx=0x7fb1200118d0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 -- 172.21.15.46:0/1067368158 shutdown_connections 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a1370 0x55f0778a3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.322 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789c2e0 0x55f0778a0da0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 --2- 172.21.15.46:0/1067368158 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f07789bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.314+0000 7fb13902b740 1 -- 172.21.15.46:0/1067368158 >> 172.21.15.46:0/1067368158 conn(0x55f077897010 msgr2=0x55f077897410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.315+0000 7fb13902b740 1 -- 172.21.15.46:0/1067368158 shutdown_connections 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.315+0000 7fb13902b740 1 -- 172.21.15.46:0/1067368158 wait complete. 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.315+0000 7fb13902b740 1 -- start start 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 Processor -- start 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 0x55f0778a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789c2e0 0x55f0778a6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f0778a1370 0x55f0778ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f0778a4340 con 0x55f0778a1370 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f077788290 con 0x55f07789b9a0 2024-09-19T09:22:21.323 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f0778a44c0 con 0x55f07789c2e0 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13902b740 10 client.0 _ll_register_callbacks cb 0x55f0777b9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 0x55f0778a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb13482a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f0778a1370 0x55f0778ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 0x55f0778a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:51176/0 (socket says 172.21.15.46:51176) 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 -- 172.21.15.46:0/2894452823 learned_addr learned my addr 172.21.15.46:0/2894452823 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789c2e0 0x55f0778a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 -- 172.21.15.46:0/2894452823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789c2e0 msgr2=0x55f0778a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789c2e0 0x55f0778a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 -- 172.21.15.46:0/2894452823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f0778a1370 msgr2=0x55f0778ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f0778a1370 0x55f0778ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.316+0000 7fb12ffff640 1 -- 172.21.15.46:0/2894452823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f077512210 con 0x55f07789b9a0 2024-09-19T09:22:21.324 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb12ffff640 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 0x55f0778a5c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb120003c60 tx=0x7fb120003c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c00f54d65cdb5d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb10f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb10f7fe640 1 -- 172.21.15.46:0/2894452823 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb120028020 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb10f7fe640 1 -- 172.21.15.46:0/2894452823 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb120016040 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1200041d0 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb10f7fe640 1 -- 172.21.15.46:0/2894452823 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb120004000 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb13902b740 10 client.25991 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f0775de620 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.317+0000 7fb10f7fe640 1 -- 172.21.15.46:0/2894452823 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1200041d0 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb10f7fe640 1 -- 172.21.15.46:0/2894452823 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fb120004ce0 con 0x55f07789b9a0 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb13902b740 10 client.25991 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb13902b740 10 client.25991 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:21.325 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb13902b740 20 client.25991 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb13902b740 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f0778b1700 0x55f0778b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb13902b740 4 client.25991 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f07780ca20 con 0x55f0778b1700 2024-09-19T09:22:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f0778b1700 0x55f0778b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb10f7fe640 10 client.25991 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:21.326 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.318+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f0778b1700 0x55f0778b3b60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fda747e4ec28cd84 server_cookie=9ded30f586a03500 in_seq=0 out_seq=0 2024-09-19T09:22:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb10f7fe640 1 -- 172.21.15.46:0/2894452823 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f07780ca20 con 0x55f0778b1700 2024-09-19T09:22:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb10f7fe640 10 client.25991 handle_command_reply: tid=0 2024-09-19T09:22:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 client.25991 shutdown 2024-09-19T09:22:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 msgr2=0x55f0778a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 0x55f0778a5c20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb120003c60 tx=0x7fb120003c90 comp rx=0 tx=0).stop 2024-09-19T09:22:21.327 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 shutdown_connections 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f0778b1700 0x55f0778b3b60 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f0778a1370 0x55f0778ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789c2e0 0x55f0778a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb10f7fe640 0 client.25991 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.319+0000 7fb13902b740 1 --2- 172.21.15.46:0/2894452823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f07789b9a0 0x55f0778a5c20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.320+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 >> 172.21.15.46:0/2894452823 conn(0x55f077897010 msgr2=0x55f077898820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.320+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 shutdown_connections 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.320+0000 7fb13902b740 1 -- 172.21.15.46:0/2894452823 wait complete. 2024-09-19T09:22:21.328 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.320+0000 7fb13902b740 20 client.25991 trim_cache size 0 max 16384 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.335+0000 7fb13902b740 1 Processor -- start 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.335+0000 7fb13902b740 1 -- start start 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13902b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0778a0e90 0x55f0778a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13902b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f077897010 0x55f0778ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13902b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 0x55f0778986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13902b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb1301ab130 con 0x55f077897010 2024-09-19T09:22:21.338 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13902b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb1301acd30 con 0x55f0778a0e90 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13902b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb1301ab800 con 0x55f07789b9a0 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb12f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f077897010 0x55f0778ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 0x55f0778986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0778a0e90 0x55f0778a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 0x55f0778986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:49350/0 (socket says 172.21.15.46:49350) 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 -- 172.21.15.46:0/2840613998 learned_addr learned my addr 172.21.15.46:0/2840613998 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 -- 172.21.15.46:0/2840613998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0778a0e90 msgr2=0x55f0778a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0778a0e90 0x55f0778a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 -- 172.21.15.46:0/2840613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f077897010 msgr2=0x55f0778ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f077897010 0x55f0778ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 -- 172.21.15.46:0/2840613998 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0778a07a0 con 0x55f07789b9a0 2024-09-19T09:22:21.339 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.336+0000 7fb13482a640 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 0x55f0778986b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb128004a70 tx=0x7fb128005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aae3271da2b47f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.337+0000 7fb115ffb640 1 -- 172.21.15.46:0/2840613998 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1280307c0 con 0x55f07789b9a0 2024-09-19T09:22:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.337+0000 7fb115ffb640 1 -- 172.21.15.46:0/2840613998 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb128036040 con 0x55f07789b9a0 2024-09-19T09:22:21.340 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.337+0000 7fb115ffb640 1 -- 172.21.15.46:0/2840613998 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12804ccd0 con 0x55f07789b9a0 2024-09-19T09:22:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.337+0000 7fb13902b740 1 -- 172.21.15.46:0/2840613998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 msgr2=0x55f0778986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 0x55f0778986b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb128004a70 tx=0x7fb128005df0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- 172.21.15.46:0/2840613998 shutdown_connections 2024-09-19T09:22:21.343 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f077897010 0x55f0778ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f07789b9a0 0x55f0778986b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- 172.21.15.46:0/2840613998 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0778a0e90 0x55f0778a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- 172.21.15.46:0/2840613998 >> 172.21.15.46:0/2840613998 conn(0x55f07789cda0 msgr2=0x55f077897fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- 172.21.15.46:0/2840613998 shutdown_connections 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- 172.21.15.46:0/2840613998 wait complete. 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- start start 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 Processor -- start 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f077897010 0x55f0778aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f0778aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a0e90 0x55f0778abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.344 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb1301ac660 con 0x55f07789b9a0 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb1301abed0 con 0x55f077897010 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.338+0000 7fb13902b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb1301a9110 con 0x55f0778a0e90 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb13902b740 10 client.0 _ll_register_callbacks cb 0x7fb124005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f0778aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f077897010 0x55f0778aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f0778aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58134/0 (socket says 172.21.15.46:58134) 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb13482a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a0e90 0x55f0778abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 -- 172.21.15.46:0/4131104641 learned_addr learned my addr 172.21.15.46:0/4131104641 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 -- 172.21.15.46:0/4131104641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a0e90 msgr2=0x55f0778abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a0e90 0x55f0778abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 -- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f077897010 msgr2=0x55f0778aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f077897010 0x55f0778aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.345 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 -- 172.21.15.46:0/4131104641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0778ac5e0 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12ffff640 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f077897010 0x55f0778aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb12f7fe640 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f0778aafc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb12401f000 tx=0x7fb1240c6fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff3bfe1f7a99389 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb10f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb10f7fe640 1 -- 172.21.15.46:0/4131104641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1240037a0 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb10f7fe640 1 -- 172.21.15.46:0/4131104641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fb124098870 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.339+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb128036040 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb10f7fe640 1 -- 172.21.15.46:0/4131104641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb1240a0160 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 10 client.16500 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f07791c760 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb10f7fe640 1 -- 172.21.15.46:0/4131104641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb128036040 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb10f7fe640 1 -- 172.21.15.46:0/4131104641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fb1240cdba0 con 0x55f07789b9a0 2024-09-19T09:22:21.346 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 10 client.16500 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 10 client.16500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 20 client.16500 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f07789c2e0 0x55f07791f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 4 client.16500 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f077806d70 con 0x55f07789c2e0 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.340+0000 7fb12ffff640 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f07789c2e0 0x55f07791f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.341+0000 7fb10f7fe640 10 client.16500 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:21.347 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.341+0000 7fb12ffff640 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f07789c2e0 0x55f07791f190 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2f6301815c8e349 server_cookie=984136a861d46ded in_seq=0 out_seq=0 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb10f7fe640 1 -- 172.21.15.46:0/4131104641 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f077806d70 con 0x55f07789c2e0 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb10f7fe640 10 client.16500 handle_command_reply: tid=0 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 client.16500 shutdown 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 msgr2=0x55f0778aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f0778aafc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb12401f000 tx=0x7fb1240c6fd0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 shutdown_connections 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f07789c2e0 0x55f07791f190 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.359 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f07789b9a0 0x55f0778aafc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb10f7fe640 0 client.16500 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f0778a0e90 0x55f0778abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 --2- 172.21.15.46:0/4131104641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f077897010 0x55f0778aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 >> 172.21.15.46:0/4131104641 conn(0x55f07789cda0 msgr2=0x55f0778987c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 shutdown_connections 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 1 -- 172.21.15.46:0/4131104641 wait complete. 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.357+0000 7fb13902b740 20 client.16500 trim_cache size 0 max 16384 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:22:21.360 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:22:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:22:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:22:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1180a32f0 msgr2=0x7fb1180a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.361 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1180a32f0 0x7fb1180a57b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1280098e0 tx=0x7fb12802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 msgr2=0x7fb13019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 0x7fb13019a4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb12400e9f0 tx=0x7fb12400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 shutdown_connections 2024-09-19T09:22:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fb1180a32f0 0x7fb1180a57b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.362 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb130105900 0x7fb1301a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb130104f40 0x7fb13019a4d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 --2- 172.21.15.46:0/2668973604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb130103d50 0x7fb130199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 >> 172.21.15.46:0/2668973604 conn(0x7fb1300ff4b0 msgr2=0x7fb130108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 shutdown_connections 2024-09-19T09:22:21.363 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:21.358+0000 7fb13628d640 1 -- 172.21.15.46:0/2668973604 wait complete. 2024-09-19T09:22:22.533 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:22 smithi046 ceph-mon[31203]: pgmap v461: 97 pgs: 97 active+clean; 56 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.9 MiB/s wr, 967 op/s 2024-09-19T09:22:22.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:22 smithi115 ceph-mon[35055]: pgmap v461: 97 pgs: 97 active+clean; 56 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.9 MiB/s wr, 967 op/s 2024-09-19T09:22:22.714 INFO:tasks.workunit.client.0.smithi046.stdout:30000 trunc from 0x7a5444 to 0x143a5 2024-09-19T09:22:22.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:22 smithi099 ceph-mon[35256]: pgmap v461: 97 pgs: 97 active+clean; 56 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.9 MiB/s wr, 967 op/s 2024-09-19T09:22:24.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:24 smithi115 ceph-mon[35055]: pgmap v462: 97 pgs: 97 active+clean; 58 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.4 MiB/s wr, 948 op/s 2024-09-19T09:22:24.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:24 smithi046 ceph-mon[31203]: pgmap v462: 97 pgs: 97 active+clean; 58 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.4 MiB/s wr, 948 op/s 2024-09-19T09:22:24.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:24 smithi099 ceph-mon[35256]: pgmap v462: 97 pgs: 97 active+clean; 58 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.4 MiB/s wr, 948 op/s 2024-09-19T09:22:26.581 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x9ffb01 2024-09-19T09:22:26.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:26 smithi115 ceph-mon[35055]: pgmap v463: 97 pgs: 97 active+clean; 55 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 779 op/s 2024-09-19T09:22:26.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:26 smithi046 ceph-mon[31203]: pgmap v463: 97 pgs: 97 active+clean; 55 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 779 op/s 2024-09-19T09:22:26.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:26 smithi099 ceph-mon[35256]: pgmap v463: 97 pgs: 97 active+clean; 55 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 779 op/s 2024-09-19T09:22:28.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:28 smithi115 ceph-mon[35055]: pgmap v464: 97 pgs: 97 active+clean; 52 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 944 op/s 2024-09-19T09:22:28.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:28 smithi046 ceph-mon[31203]: pgmap v464: 97 pgs: 97 active+clean; 52 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 944 op/s 2024-09-19T09:22:28.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:28 smithi099 ceph-mon[35256]: pgmap v464: 97 pgs: 97 active+clean; 52 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 944 op/s 2024-09-19T09:22:30.211 INFO:tasks.workunit.client.0.smithi046.stdout:40000 mapwrite 0x1becad thru 0x1c6a92 (0x7de6 bytes) 2024-09-19T09:22:30.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:30 smithi115 ceph-mon[35055]: pgmap v465: 97 pgs: 97 active+clean; 52 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.7 MiB/s wr, 683 op/s 2024-09-19T09:22:30.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:30 smithi046 ceph-mon[31203]: pgmap v465: 97 pgs: 97 active+clean; 52 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.7 MiB/s wr, 683 op/s 2024-09-19T09:22:30.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:30 smithi099 ceph-mon[35256]: pgmap v465: 97 pgs: 97 active+clean; 52 MiB data, 948 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.7 MiB/s wr, 683 op/s 2024-09-19T09:22:32.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:32 smithi115 ceph-mon[35055]: pgmap v466: 97 pgs: 97 active+clean; 54 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 807 op/s 2024-09-19T09:22:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:32 smithi046 ceph-mon[31203]: pgmap v466: 97 pgs: 97 active+clean; 54 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 807 op/s 2024-09-19T09:22:32.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:32 smithi099 ceph-mon[35256]: pgmap v466: 97 pgs: 97 active+clean; 54 MiB data, 1006 MiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 4.3 MiB/s wr, 807 op/s 2024-09-19T09:22:34.160 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:22:34.160 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:22:34.161 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:22:34.462 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 -- 172.21.15.46:0/3863773778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c102d50 msgr2=0x7f0a8c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3863773778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c102d50 0x7f0a8c1031d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009860 tx=0x7f0a8002a340 comp rx=0 tx=0).stop 2024-09-19T09:22:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 -- 172.21.15.46:0/3863773778 shutdown_connections 2024-09-19T09:22:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3863773778 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c102d50 0x7f0a8c1031d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3863773778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c103710 0x7f0a8c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3863773778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c101b60 0x7f0a8c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 -- 172.21.15.46:0/3863773778 >> 172.21.15.46:0/3863773778 conn(0x7f0a8c0fd2c0 msgr2=0x7f0a8c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 -- 172.21.15.46:0/3863773778 shutdown_connections 2024-09-19T09:22:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.468+0000 7f0a9240e640 1 -- 172.21.15.46:0/3863773778 wait complete. 2024-09-19T09:22:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 Processor -- start 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 -- start start 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c101b60 0x7f0a8c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c102d50 0x7f0a8c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 0x7f0a8c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c10d7c0 con 0x7f0a8c101b60 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c10d640 con 0x7f0a8c103710 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.469+0000 7f0a9240e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c10d940 con 0x7f0a8c102d50 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c101b60 0x7f0a8c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 0x7f0a8c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 0x7f0a8c074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35858/0 (socket says 172.21.15.46:35858) 2024-09-19T09:22:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c101b60 0x7f0a8c075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56894/0 (socket says 172.21.15.46:56894) 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 -- 172.21.15.46:0/3349153364 learned_addr learned my addr 172.21.15.46:0/3349153364 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c102d50 0x7f0a8c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 -- 172.21.15.46:0/3349153364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c102d50 msgr2=0x7f0a8c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c102d50 0x7f0a8c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 -- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c101b60 msgr2=0x7f0a8c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c101b60 0x7f0a8c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 -- 172.21.15.46:0/3349153364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c0753b0 con 0x7f0a8c103710 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c102d50 0x7f0a8c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a909ab640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 0x7f0a8c074b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400eb10 tx=0x7f0a8400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a897fa640 1 -- 172.21.15.46:0/3349153364 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84004b20 con 0x7f0a8c103710 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a897fa640 1 -- 172.21.15.46:0/3349153364 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a84004cc0 con 0x7f0a8c103710 2024-09-19T09:22:34.474 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a897fa640 1 -- 172.21.15.46:0/3349153364 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84010760 con 0x7f0a8c103710 2024-09-19T09:22:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.470+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c1a1f60 con 0x7f0a8c103710 2024-09-19T09:22:34.475 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.471+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c1a2310 con 0x7f0a8c103710 2024-09-19T09:22:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.473+0000 7f0a897fa640 1 -- 172.21.15.46:0/3349153364 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0a84005020 con 0x7f0a8c103710 2024-09-19T09:22:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.473+0000 7f0a95287740 1 Processor -- start 2024-09-19T09:22:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.473+0000 7f0a95287740 1 -- start start 2024-09-19T09:22:34.476 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.473+0000 7f0a95287740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad2774da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.473+0000 7f0a95287740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad2779da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a95287740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad277c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a95287740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cad26d82f0 con 0x55cad27752e0 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a95287740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cad2680270 con 0x55cad277a370 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a95287740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cad26d42b0 con 0x55cad27749a0 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad2774da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad2779da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad2774da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57168/0 (socket says 172.21.15.46:57168) 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3331307317 learned_addr learned my addr 172.21.15.46:0/3331307317 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad277c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.477 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a897fa640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0a740abb00 0x7f0a740adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3331307317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 msgr2=0x55cad277c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a897fa640 1 -- 172.21.15.46:0/3349153364 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f0a840cfe70 con 0x7f0a8c103710 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad277c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3331307317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 msgr2=0x55cad2779da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad2779da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3331307317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad267f340 con 0x55cad27749a0 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.474+0000 7f0a909ab640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0a740abb00 0x7f0a740adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.475+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad2774da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a800057c0 tx=0x7f0a80030550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d303a0c45a546f3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.475+0000 7f0a727fc640 1 -- 172.21.15.46:0/3331307317 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80037040 con 0x55cad27749a0 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.475+0000 7f0a727fc640 1 -- 172.21.15.46:0/3331307317 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a80004240 con 0x55cad27749a0 2024-09-19T09:22:34.478 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.475+0000 7f0a727fc640 1 -- 172.21.15.46:0/3331307317 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80032440 con 0x55cad27749a0 2024-09-19T09:22:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 -- 172.21.15.46:0/3331307317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 msgr2=0x55cad2774da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.481 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a909ab640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0a740abb00 0x7f0a740adfc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0a8409c450 tx=0x7f0a840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad2774da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0a800057c0 tx=0x7f0a80030550 comp rx=0 tx=0).stop 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 -- 172.21.15.46:0/3331307317 shutdown_connections 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad2779da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad277c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 --2- 172.21.15.46:0/3331307317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad2774da0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 -- 172.21.15.46:0/3331307317 >> 172.21.15.46:0/3331307317 conn(0x55cad2770010 msgr2=0x55cad2770410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 -- 172.21.15.46:0/3331307317 shutdown_connections 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 -- 172.21.15.46:0/3331307317 wait complete. 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.476+0000 7f0a95287740 1 -- start start 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 Processor -- start 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad277ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.482 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad277f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad277ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad277ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57184/0 (socket says 172.21.15.46:57184) 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad277f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad277f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56922/0 (socket says 172.21.15.46:56922) 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/4126095835 learned_addr learned my addr 172.21.15.46:0/4126095835 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad2786100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cad277d280 con 0x55cad27752e0 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cad2661290 con 0x55cad277a370 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cad277d400 con 0x55cad27749a0 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.477+0000 7f0a95287740 10 client.0 _ll_register_callbacks cb 0x55cad2692140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8bfff640 1 -- 172.21.15.46:0/4126095835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 msgr2=0x55cad277ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad277ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.483 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8bfff640 1 -- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 msgr2=0x55cad2786100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad2786100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad2786100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8bfff640 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad23eb210 con 0x55cad27752e0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a80004240 con 0x55cad27752e0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad2786100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad277f130 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55cad2775d10 tx=0x7f0a7c012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b2f45dd8cc77c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.478+0000 7f0a6b7fe640 10 client.16512 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/4126095835 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0120d0 con 0x55cad27752e0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/4126095835 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f0a7c00f9b0 con 0x55cad27752e0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/4126095835 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0a7c00fc10 con 0x55cad27752e0 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a95287740 10 client.16512 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:34.484 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55cad24b7620 con 0x55cad27752e0 2024-09-19T09:22:34.485 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:34 smithi046 ceph-mon[31203]: pgmap v467: 97 pgs: 97 active+clean; 57 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 802 op/s 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/4126095835 <== mon.0 v2:172.21.15.46:3300/0 4 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f0a7c01c470 con 0x55cad27752e0 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a95287740 10 client.16512 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a95287740 10 client.16512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a95287740 20 client.16512 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.479+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad278a720 0x55cad278cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.480+0000 7f0a95287740 4 client.16512 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.480+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad26e5a20 con 0x55cad278a720 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.480+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad278a720 0x55cad278cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.480+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad278a720 0x55cad278cb30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376c45d3ed08676e server_cookie=a8024b9ebd5eb0d7 in_seq=0 out_seq=0 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.480+0000 7f0a6b7fe640 10 client.16512 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/4126095835 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cad26e5a20 con 0x55cad278a720 2024-09-19T09:22:34.487 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a6b7fe640 10 client.16512 handle_command_reply: tid=0 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 client.16512 shutdown 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 msgr2=0x55cad277f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad277f130 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55cad2775d10 tx=0x7f0a7c012ed0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 shutdown_connections 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad278a720 0x55cad278cb30 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27752e0 0x55cad277f130 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a6b7fe640 0 client.16512 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad277a370 0x55cad2786100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 --2- 172.21.15.46:0/4126095835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27749a0 0x55cad277ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 >> 172.21.15.46:0/4126095835 conn(0x55cad2770010 msgr2=0x55cad2771820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 shutdown_connections 2024-09-19T09:22:34.489 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.481+0000 7f0a95287740 1 -- 172.21.15.46:0/4126095835 wait complete. 2024-09-19T09:22:34.489 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.482+0000 7f0a95287740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T09:22:34.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 Processor -- start 2024-09-19T09:22:34.502 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 -- start start 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27749a0 0x55cad2791430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27752e0 0x55cad27860c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 0x55cad2791970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1a6d40 con 0x55cad277a370 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1a8940 con 0x55cad27749a0 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a95287740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1a7410 con 0x55cad27752e0 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 0x55cad2791970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 0x55cad2791970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56930/0 (socket says 172.21.15.46:56930) 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3796573028 learned_addr learned my addr 172.21.15.46:0/3796573028 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27749a0 0x55cad2791430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27752e0 0x55cad27860c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.503 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3796573028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27752e0 msgr2=0x55cad27860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27752e0 0x55cad27860c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3796573028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27749a0 msgr2=0x55cad2791430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.500+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27749a0 0x55cad2791430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.501+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/3796573028 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad276fe30 con 0x55cad277a370 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.501+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 0x55cad2791970 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0a80030ab0 tx=0x7f0a80030550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4f29df9150cdfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.501+0000 7f0a71ffb640 1 -- 172.21.15.46:0/3796573028 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80037040 con 0x55cad277a370 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.501+0000 7f0a71ffb640 1 -- 172.21.15.46:0/3796573028 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a80003cd0 con 0x55cad277a370 2024-09-19T09:22:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.501+0000 7f0a71ffb640 1 -- 172.21.15.46:0/3796573028 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80032b20 con 0x55cad277a370 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 -- 172.21.15.46:0/3796573028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 msgr2=0x55cad2791970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 0x55cad2791970 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f0a80030ab0 tx=0x7f0a80030550 comp rx=0 tx=0).stop 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 -- 172.21.15.46:0/3796573028 shutdown_connections 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad277a370 0x55cad2791970 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad27752e0 0x55cad27860c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 --2- 172.21.15.46:0/3796573028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27749a0 0x55cad2791430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 -- 172.21.15.46:0/3796573028 >> 172.21.15.46:0/3796573028 conn(0x55cad2770010 msgr2=0x55cad276f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.509 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 -- 172.21.15.46:0/3796573028 shutdown_connections 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 -- 172.21.15.46:0/3796573028 wait complete. 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.502+0000 7f0a95287740 1 -- start start 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 Processor -- start 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 0x55cad2784080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27752e0 0x55cad27845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad277a370 0x55cad27855d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1a8270 con 0x55cad27749a0 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1a7ae0 con 0x55cad27752e0 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1a4d20 con 0x55cad277a370 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a95287740 10 client.0 _ll_register_callbacks cb 0x7f0a7c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 0x55cad2784080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.510 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 0x55cad2784080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56934/0 (socket says 172.21.15.46:56934) 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27752e0 0x55cad27845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8b7fe640 1 -- 172.21.15.46:0/2129550103 learned_addr learned my addr 172.21.15.46:0/2129550103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad277a370 0x55cad27855d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8bfff640 1 -- 172.21.15.46:0/2129550103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad277a370 msgr2=0x55cad27855d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad277a370 0x55cad27855d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8bfff640 1 -- 172.21.15.46:0/2129550103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 msgr2=0x55cad2784080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 0x55cad2784080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8bfff640 1 -- 172.21.15.46:0/2129550103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad2785be0 con 0x55cad27752e0 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.503+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 0x55cad2784080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a8bfff640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27752e0 0x55cad27845c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009530 tx=0x7f0a7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445b7cc6134caff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/2129550103 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c012070 con 0x55cad27752e0 2024-09-19T09:22:34.511 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a80003cd0 con 0x55cad27752e0 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/2129550103 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f0a7c012210 con 0x55cad27752e0 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/2129550103 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0a7c010430 con 0x55cad27752e0 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a95287740 10 client.26012 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55cad27f5c70 con 0x55cad27752e0 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.504+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/2129550103 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a80003cd0 con 0x55cad27752e0 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/2129550103 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f0a7c030420 con 0x55cad27752e0 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a95287740 10 client.26012 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a95287740 10 client.26012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a95287740 20 client.26012 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a95287740 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad27f6710 0x55cad27f8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.512 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a95287740 4 client.26012 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cad26dfd70 con 0x55cad27f6710 2024-09-19T09:22:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad27f6710 0x55cad27f8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a8b7fe640 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad27f6710 0x55cad27f8b30 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd812671de05491f server_cookie=f4df9999b44001d5 in_seq=0 out_seq=0 2024-09-19T09:22:34.513 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.505+0000 7f0a6b7fe640 10 client.26012 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a6b7fe640 1 -- 172.21.15.46:0/2129550103 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cad26dfd70 con 0x55cad27f6710 2024-09-19T09:22:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a6b7fe640 10 client.26012 handle_command_reply: tid=0 2024-09-19T09:22:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 client.26012 shutdown 2024-09-19T09:22:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27752e0 msgr2=0x55cad27845c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27752e0 0x55cad27845c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009530 tx=0x7f0a7c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 shutdown_connections 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cad27f6710 0x55cad27f8b30 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cad277a370 0x55cad27855d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cad27752e0 0x55cad27845c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a6b7fe640 0 client.26012 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 --2- 172.21.15.46:0/2129550103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cad27749a0 0x55cad2784080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 >> 172.21.15.46:0/2129550103 conn(0x55cad2770010 msgr2=0x55cad2770ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.525+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 shutdown_connections 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a95287740 1 -- 172.21.15.46:0/2129550103 wait complete. 2024-09-19T09:22:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a95287740 20 client.26012 trim_cache size 0 max 16384 2024-09-19T09:22:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:22:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:22:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:22:34.529 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0a740abb00 msgr2=0x7f0a740adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0a740abb00 0x7f0a740adfc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0a8409c450 tx=0x7f0a840058d0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 msgr2=0x7f0a8c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 0x7f0a8c074b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400eb10 tx=0x7f0a8400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 shutdown_connections 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f0a740abb00 0x7f0a740adfc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a8c103710 0x7f0a8c074b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a8c102d50 0x7f0a8c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.530 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 --2- 172.21.15.46:0/3349153364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a8c101b60 0x7f0a8c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 >> 172.21.15.46:0/3349153364 conn(0x7f0a8c0fd2c0 msgr2=0x7f0a8c1060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.526+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 shutdown_connections 2024-09-19T09:22:34.531 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:34.527+0000 7f0a9240e640 1 -- 172.21.15.46:0/3349153364 wait complete. 2024-09-19T09:22:34.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:34 smithi115 ceph-mon[35055]: pgmap v467: 97 pgs: 97 active+clean; 57 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 802 op/s 2024-09-19T09:22:34.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:34 smithi099 ceph-mon[35256]: pgmap v467: 97 pgs: 97 active+clean; 57 MiB data, 1018 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 4.6 MiB/s wr, 802 op/s 2024-09-19T09:22:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1924159166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 msgr2=0x7fee08101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1924159166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee08101200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedf8009890 tx=0x7fedf802a410 comp rx=0 tx=0).stop 2024-09-19T09:22:34.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1924159166 shutdown_connections 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1924159166 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee08102570 0x7fee081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1924159166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee08102ef0 0x7fee0810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1924159166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee08101200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1924159166 >> 172.21.15.46:0/1924159166 conn(0x7fee080fc7d0 msgr2=0x7fee080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1924159166 shutdown_connections 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.987+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1924159166 wait complete. 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.988+0000 7fee0d5a0640 1 Processor -- start 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.988+0000 7fee0d5a0640 1 -- start start 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.988+0000 7fee0d5a0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee080fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee0d5a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee08102570 0x7fee080fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee0d5a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee08102ef0 0x7fee080fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee0d5a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fee08110fd0 con 0x7fee08102ef0 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee0d5a0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fee08110e50 con 0x7fee08100e20 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee0d5a0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fee08111150 con 0x7fee08102570 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee080fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee080fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35914/0 (socket says 172.21.15.46:35914) 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 -- 172.21.15.46:0/1615728489 learned_addr learned my addr 172.21.15.46:0/1615728489 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee067fc640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee08102570 0x7fee080fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee077fe640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee08102ef0 0x7fee080fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 -- 172.21.15.46:0/1615728489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee08102570 msgr2=0x7fee080fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee08102570 0x7fee080fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 -- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee08102ef0 msgr2=0x7fee080fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:34.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee08102ef0 0x7fee080fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 -- 172.21.15.46:0/1615728489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee081a6a10 con 0x7fee08100e20 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.989+0000 7fee06ffd640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee080fcc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000c00 tx=0x7fedf8030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.990+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8040070 con 0x7fee08100e20 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.990+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedf80054d0 con 0x7fee08100e20 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.990+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee081a6ca0 con 0x7fee08100e20 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.990+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8004d60 con 0x7fee08100e20 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.990+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee081a7180 con 0x7fee08100e20 2024-09-19T09:22:34.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.991+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee08101200 con 0x7fee08100e20 2024-09-19T09:22:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.992+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fedf8039040 con 0x7fee08100e20 2024-09-19T09:22:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.993+0000 7fedeffff640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fedf00a3300 0x7fedf00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.993+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fedf80f0760 con 0x7fee08100e20 2024-09-19T09:22:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.993+0000 7fee067fc640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fedf00a3300 0x7fedf00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:34.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.993+0000 7fee067fc640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fedf00a3300 0x7fedf00a57c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee080fe440 tx=0x7fedfc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:34.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:34.997+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedf80bd4b0 con 0x7fee08100e20 2024-09-19T09:22:35.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.303+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee0810a0d0 con 0x7fee08100e20 2024-09-19T09:22:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.304+0000 7fedeffff640 1 -- 172.21.15.46:0/1615728489 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11967 (secure 0 0 0) 0x7fedf80bcdb0 con 0x7fee08100e20 2024-09-19T09:22:35.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:22:35.306 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-19T09:21:29:130184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:21:29.130168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:22:35.306 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-19T09:22:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fedf00a3300 msgr2=0x7fedf00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fedf00a3300 0x7fedf00a57c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee080fe440 tx=0x7fedfc009260 comp rx=0 tx=0).stop 2024-09-19T09:22:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 msgr2=0x7fee080fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:35.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee080fcc80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000c00 tx=0x7fedf8030940 comp rx=0 tx=0).stop 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 shutdown_connections 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fedf00a3300 0x7fedf00a57c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fee08102ef0 0x7fee080fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee08102570 0x7fee080fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 --2- 172.21.15.46:0/1615728489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee08100e20 0x7fee080fcc80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 >> 172.21.15.46:0/1615728489 conn(0x7fee080fc7d0 msgr2=0x7fee0806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 shutdown_connections 2024-09-19T09:22:35.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:35.307+0000 7fee0d5a0640 1 -- 172.21.15.46:0/1615728489 wait complete. 2024-09-19T09:22:35.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:22:35.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:22:35.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:22:35.504 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:22:35.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:22:35.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:22:35.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:22:35.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:22:35.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:22:35.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:22:35.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:22:35.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:22:36.060 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:22:36.061 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:22:36.353 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:22:36.601 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:36 smithi046 ceph-mon[31203]: pgmap v468: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 737 op/s 2024-09-19T09:22:36.601 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:36 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1615728489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:36.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:36 smithi115 ceph-mon[35055]: pgmap v468: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 737 op/s 2024-09-19T09:22:36.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:36 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1615728489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:36.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:36 smithi099 ceph-mon[35256]: pgmap v468: 97 pgs: 97 active+clean; 59 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 3.9 MiB/s wr, 737 op/s 2024-09-19T09:22:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:36 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1615728489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 -- 172.21.15.46:0/1652493140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec10e4d0 msgr2=0x7f87ec1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 --2- 172.21.15.46:0/1652493140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec10e4d0 0x7f87ec1108e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009ca0 tx=0x7f87e402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 -- 172.21.15.46:0/1652493140 shutdown_connections 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 --2- 172.21.15.46:0/1652493140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec10e4d0 0x7f87ec1108e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 --2- 172.21.15.46:0/1652493140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec101360 0x7f87ec10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 --2- 172.21.15.46:0/1652493140 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec1009b0 0x7f87ec100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.848+0000 7f87f38a2640 1 -- 172.21.15.46:0/1652493140 >> 172.21.15.46:0/1652493140 conn(0x7f87ec0fc7d0 msgr2=0x7f87ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.849+0000 7f87f38a2640 1 -- 172.21.15.46:0/1652493140 shutdown_connections 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.849+0000 7f87f38a2640 1 -- 172.21.15.46:0/1652493140 wait complete. 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.849+0000 7f87f38a2640 1 Processor -- start 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.849+0000 7f87f38a2640 1 -- start start 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f38a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec1009b0 0x7f87ec19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f38a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 0x7f87ec19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f38a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 0x7f87ec19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f38a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec114220 con 0x7f87ec1009b0 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f38a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1140a0 con 0x7f87ec10e4d0 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f38a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1143a0 con 0x7f87ec101360 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f163e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec1009b0 0x7f87ec19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 0x7f87ec19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 0x7f87ec19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f163e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec1009b0 0x7f87ec19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56976/0 (socket says 172.21.15.46:56976) 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 0x7f87ec19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57232/0 (socket says 172.21.15.46:57232) 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 0x7f87ec19efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35932/0 (socket says 172.21.15.46:35932) 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f163e640 1 -- 172.21.15.46:0/2021104706 learned_addr learned my addr 172.21.15.46:0/2021104706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 -- 172.21.15.46:0/2021104706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 msgr2=0x7f87ec19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 0x7f87ec19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 -- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec1009b0 msgr2=0x7f87ec19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec1009b0 0x7f87ec19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 -- 172.21.15.46:0/2021104706 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec19f6b0 con 0x7f87ec10e4d0 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 0x7f87ec19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:36.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.850+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 0x7f87ec19efd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87e402ade0 tx=0x7f87e40319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.851+0000 7f87e27fc640 1 -- 172.21.15.46:0/2021104706 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4003b70 con 0x7f87ec10e4d0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.851+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ec19f940 con 0x7f87ec10e4d0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.851+0000 7f87e27fc640 1 -- 172.21.15.46:0/2021104706 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e4003d10 con 0x7f87ec10e4d0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.851+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ec1a7280 con 0x7f87ec10e4d0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.851+0000 7f87e27fc640 1 -- 172.21.15.46:0/2021104706 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e402fc40 con 0x7f87ec10e4d0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.854+0000 7f87f5c7b740 1 Processor -- start 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.854+0000 7f87e27fc640 1 -- 172.21.15.46:0/2021104706 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f87e4004050 con 0x7f87ec10e4d0 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.854+0000 7f87f5c7b740 1 -- start start 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c58423a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c58436c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58437150 0x558c58439540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558c583892a0 con 0x558c58437150 2024-09-19T09:22:36.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558c58330b10 con 0x558c58423660 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558c58385260 con 0x558c58423f80 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58437150 0x558c58439540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c58436c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c58423a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c58436c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57248/0 (socket says 172.21.15.46:57248) 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 -- 172.21.15.46:0/1187105784 learned_addr learned my addr 172.21.15.46:0/1187105784 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 -- 172.21.15.46:0/1187105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 msgr2=0x558c58423a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c58423a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 -- 172.21.15.46:0/1187105784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58437150 msgr2=0x558c58439540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58437150 0x558c58439540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f163e640 1 -- 172.21.15.46:0/1187105784 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c580fab90 con 0x558c58423f80 2024-09-19T09:22:36.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c58423a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87e27fc640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87d80a32c0 0x7f87d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.855+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87d80a32c0 0x7f87d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.856+0000 7f87e27fc640 1 -- 172.21.15.46:0/2021104706 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f87e40f0780 con 0x7f87ec10e4d0 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.856+0000 7f87f163e640 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c58436c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009e10 tx=0x7f87e8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53c1a35c4c92eac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.856+0000 7f87d77fe640 1 -- 172.21.15.46:0/1187105784 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e801e070 con 0x558c58423f80 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.856+0000 7f87d77fe640 1 -- 172.21.15.46:0/1187105784 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e8019b10 con 0x558c58423f80 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.856+0000 7f87d77fe640 1 -- 172.21.15.46:0/1187105784 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800fb20 con 0x558c58423f80 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.857+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1187105784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 msgr2=0x558c58436c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.857+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87d80a32c0 0x7f87d80a5780 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x558c58425200 tx=0x7f87dc004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.857+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c58436c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009e10 tx=0x7f87e8011810 comp rx=0 tx=0).stop 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1187105784 shutdown_connections 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58437150 0x558c58439540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c58436c10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1187105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c58423a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1187105784 >> 172.21.15.46:0/1187105784 conn(0x558c5841fcf0 msgr2=0x558c584200d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1187105784 shutdown_connections 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.858+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1187105784 wait complete. 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 -- start start 2024-09-19T09:22:36.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 Processor -- start 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c58434170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423f80 0x558c584346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c58434bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558c58439d80 con 0x558c58423660 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558c583116e0 con 0x558c58423f80 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558c58439f00 con 0x558c58437150 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f5c7b740 10 client.0 _ll_register_callbacks cb 0x558c58335a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f1e3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c58434bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.859+0000 7f87f1e3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c58434bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57256/0 (socket says 172.21.15.46:57256) 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 -- 172.21.15.46:0/1858165188 learned_addr learned my addr 172.21.15.46:0/1858165188 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423f80 0x558c584346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f163e640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c58434170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 -- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423f80 msgr2=0x558c584346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423f80 0x558c584346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 -- 172.21.15.46:0/1858165188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 msgr2=0x558c58434170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c58434170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 -- 172.21.15.46:0/1858165188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c58443400 con 0x558c58437150 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423f80 0x558c584346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f163e640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c58434170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c58434bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87e40b9350 tx=0x7f87e40b8b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835357ed9c184567 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.860+0000 7f87d4ff9640 1 -- 172.21.15.46:0/1858165188 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e40bd5f0 con 0x558c58437150 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e8019b10 con 0x558c58437150 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87d4ff9640 1 -- 172.21.15.46:0/1858165188 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f87e4004730 con 0x558c58437150 2024-09-19T09:22:36.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87d4ff9640 1 -- 172.21.15.46:0/1858165188 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f87e40bcef0 con 0x558c58437150 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 10 client.25969 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558c58439d80 con 0x558c58437150 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87d4ff9640 1 -- 172.21.15.46:0/1858165188 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e8019b10 con 0x558c58437150 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87d4ff9640 1 -- 172.21.15.46:0/1858165188 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f87e40bd1e0 con 0x558c58437150 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 10 client.25969 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 10 client.25969 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 20 client.25969 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584472f0 0x558c58449770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f163e640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584472f0 0x558c58449770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.861+0000 7f87f5c7b740 4 client.25969 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.862+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c583969d0 con 0x558c584472f0 2024-09-19T09:22:36.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.862+0000 7f87d4ff9640 10 client.25969 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.862+0000 7f87f163e640 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584472f0 0x558c58449770 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd36a76229a3bb6 server_cookie=e6cbf7be96bfd771 in_seq=0 out_seq=0 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87d4ff9640 1 -- 172.21.15.46:0/1858165188 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c583969d0 con 0x558c584472f0 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87d4ff9640 10 client.25969 handle_command_reply: tid=0 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 client.25969 shutdown 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 msgr2=0x558c58434bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c58434bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87e40b9350 tx=0x7f87e40b8b90 comp rx=0 tx=0).stop 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 shutdown_connections 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584472f0 0x558c58449770 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c58434bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423f80 0x558c584346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/1858165188 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c58434170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.872 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 >> 172.21.15.46:0/1858165188 conn(0x558c5841fcf0 msgr2=0x558c58425a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87d4ff9640 0 client.25969 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 shutdown_connections 2024-09-19T09:22:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 1 -- 172.21.15.46:0/1858165188 wait complete. 2024-09-19T09:22:36.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.863+0000 7f87f5c7b740 20 client.25969 trim_cache size 0 max 16384 2024-09-19T09:22:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.882+0000 7f87f5c7b740 1 Processor -- start 2024-09-19T09:22:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.882+0000 7f87f5c7b740 1 -- start start 2024-09-19T09:22:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c5844eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c5844f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58437150 0x558c584313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1ab1d0 con 0x558c58423660 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1acdd0 con 0x558c58437150 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1ab8a0 con 0x558c58423f80 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c5844f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f163e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c5844eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f1e3f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58437150 0x558c584313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c5844f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:57264/0 (socket says 172.21.15.46:57264) 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f163e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c5844eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57002/0 (socket says 172.21.15.46:57002) 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f0e3d640 1 -- 172.21.15.46:0/916780565 learned_addr learned my addr 172.21.15.46:0/916780565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f1e3f640 1 -- 172.21.15.46:0/916780565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 msgr2=0x558c5844f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c5844f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f1e3f640 1 -- 172.21.15.46:0/916780565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 msgr2=0x558c5844eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c5844eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.883+0000 7f87f1e3f640 1 -- 172.21.15.46:0/916780565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c58423db0 con 0x558c58437150 2024-09-19T09:22:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.884+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58437150 0x558c584313d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f87e40ee300 tx=0x7f87e402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a6731df705c3307 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.884+0000 7f87d6ffd640 1 -- 172.21.15.46:0/916780565 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e409f070 con 0x558c58437150 2024-09-19T09:22:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.884+0000 7f87d6ffd640 1 -- 172.21.15.46:0/916780565 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e4036040 con 0x558c58437150 2024-09-19T09:22:36.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.884+0000 7f87d6ffd640 1 -- 172.21.15.46:0/916780565 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e40c5b60 con 0x558c58437150 2024-09-19T09:22:36.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.884+0000 7f87f5c7b740 1 -- 172.21.15.46:0/916780565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58437150 msgr2=0x558c584313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:36.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.884+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58437150 0x558c584313d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f87e40ee300 tx=0x7f87e402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 -- 172.21.15.46:0/916780565 shutdown_connections 2024-09-19T09:22:36.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58437150 0x558c584313d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58423f80 0x558c5844f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/916780565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423660 0x558c5844eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 -- 172.21.15.46:0/916780565 >> 172.21.15.46:0/916780565 conn(0x558c5841fcf0 msgr2=0x558c58425a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 -- 172.21.15.46:0/916780565 shutdown_connections 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 -- 172.21.15.46:0/916780565 wait complete. 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 -- start start 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.885+0000 7f87f5c7b740 1 Processor -- start 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c5843b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423f80 0x558c5843b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c5843ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1ac700 con 0x558c58423f80 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1abf70 con 0x558c58423660 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1a91f0 con 0x558c58437150 2024-09-19T09:22:36.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f5c7b740 10 client.0 _ll_register_callbacks cb 0x7f87e40b8a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f0e3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423f80 0x558c5843b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f163e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c5843b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f1e3f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c5843ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f163e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c5843b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:35964/0 (socket says 172.21.15.46:35964) 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f163e640 1 -- 172.21.15.46:0/3624434773 learned_addr learned my addr 172.21.15.46:0/3624434773 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f1e3f640 1 -- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 msgr2=0x558c5843b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c5843b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.886+0000 7f87f1e3f640 1 -- 172.21.15.46:0/3624434773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423f80 msgr2=0x558c5843b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423f80 0x558c5843b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f1e3f640 1 -- 172.21.15.46:0/3624434773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c584b1120 con 0x558c58437150 2024-09-19T09:22:36.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f163e640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c5843b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f0e3d640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423f80 0x558c5843b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f1e3f640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c5843ba80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87e40bce80 tx=0x7f87e4003fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e05186948f87209 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87d4ff9640 1 -- 172.21.15.46:0/3624434773 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e409f040 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87d4ff9640 1 -- 172.21.15.46:0/3624434773 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f87e4004730 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e4036040 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87d4ff9640 1 -- 172.21.15.46:0/3624434773 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f87e40bca30 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f5c7b740 10 client.25975 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558c584b1120 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.887+0000 7f87d4ff9640 1 -- 172.21.15.46:0/3624434773 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87e40c5b60 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87d4ff9640 1 -- 172.21.15.46:0/3624434773 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f87e40ce050 con 0x558c58437150 2024-09-19T09:22:36.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f5c7b740 10 client.25975 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f5c7b740 10 client.25975 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f5c7b740 20 client.25975 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584b2810 0x558c584b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f5c7b740 4 client.25975 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x7f87e4036040 con 0x558c584b2810 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f163e640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584b2810 0x558c584b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87f163e640 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584b2810 0x558c584b4c30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f57c07fd6e18394 server_cookie=f92aee187e432e4d in_seq=0 out_seq=0 2024-09-19T09:22:36.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:36.888+0000 7f87d4ff9640 10 client.25975 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87d4ff9640 1 -- 172.21.15.46:0/3624434773 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f87e4036040 con 0x558c584b2810 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87d4ff9640 10 client.25975 handle_command_reply: tid=0 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 client.25975 shutdown 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 msgr2=0x558c5843ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c5843ba80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87e40bce80 tx=0x7f87e4003fc0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 shutdown_connections 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558c584b2810 0x558c584b4c30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558c58423f80 0x558c5843b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558c58437150 0x558c5843ba80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87d4ff9640 0 client.25975 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 --2- 172.21.15.46:0/3624434773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c58423660 0x558c5843b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.480+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 >> 172.21.15.46:0/3624434773 conn(0x558c5841fcf0 msgr2=0x558c5841e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 shutdown_connections 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f5c7b740 1 -- 172.21.15.46:0/3624434773 wait complete. 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f5c7b740 20 client.25975 trim_cache size 0 max 16384 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 18, 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout: "ba070a16": { 2024-09-19T09:22:37.484 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 18, 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 149.8, 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:22:37.485 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:22:37.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87d80a32c0 msgr2=0x7f87d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87d80a32c0 0x7f87d80a5780 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x558c58425200 tx=0x7f87dc004730 comp rx=0 tx=0).stop 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 msgr2=0x7f87ec19efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 0x7f87ec19efd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87e402ade0 tx=0x7f87e40319f0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 shutdown_connections 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f87d80a32c0 0x7f87d80a5780 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ec10e4d0 0x7f87ec19efd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87ec101360 0x7f87ec19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.481+0000 7f87f38a2640 1 --2- 172.21.15.46:0/2021104706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87ec1009b0 0x7f87ec19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.482+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 >> 172.21.15.46:0/2021104706 conn(0x7f87ec0fc7d0 msgr2=0x7f87ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.482+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 shutdown_connections 2024-09-19T09:22:37.487 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:22:37.482+0000 7f87f38a2640 1 -- 172.21.15.46:0/2021104706 wait complete. 2024-09-19T09:22:38.475 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ba070a16', quiesce took 4.3 seconds. Will release after: 25.5 2024-09-19T09:22:38.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:38 smithi115 ceph-mon[35055]: pgmap v469: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 827 op/s 2024-09-19T09:22:38.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:38 smithi046 ceph-mon[31203]: pgmap v469: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 827 op/s 2024-09-19T09:22:38.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:38 smithi099 ceph-mon[35256]: pgmap v469: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 4.7 MiB/s wr, 827 op/s 2024-09-19T09:22:40.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:40 smithi115 ceph-mon[35055]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.2 MiB/s wr, 566 op/s 2024-09-19T09:22:40.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:40 smithi046 ceph-mon[31203]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.2 MiB/s wr, 566 op/s 2024-09-19T09:22:40.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:40 smithi099 ceph-mon[35256]: pgmap v470: 97 pgs: 97 active+clean; 56 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 3.2 MiB/s wr, 566 op/s 2024-09-19T09:22:42.565 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:42 smithi099 ceph-mon[35256]: pgmap v471: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 3.4 MiB/s wr, 621 op/s 2024-09-19T09:22:42.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:42 smithi115 ceph-mon[35055]: pgmap v471: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 3.4 MiB/s wr, 621 op/s 2024-09-19T09:22:42.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:42 smithi046 ceph-mon[31203]: pgmap v471: 97 pgs: 97 active+clean; 57 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 3.4 MiB/s wr, 621 op/s 2024-09-19T09:22:44.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:44 smithi115 ceph-mon[35055]: pgmap v472: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.1 MiB/s wr, 524 op/s 2024-09-19T09:22:44.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:44 smithi046 ceph-mon[31203]: pgmap v472: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.1 MiB/s wr, 524 op/s 2024-09-19T09:22:44.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:44 smithi099 ceph-mon[35256]: pgmap v472: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 3.1 MiB/s wr, 524 op/s 2024-09-19T09:22:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:46 smithi115 ceph-mon[35055]: pgmap v473: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.0 MiB/s wr, 362 op/s 2024-09-19T09:22:46.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:46 smithi046 ceph-mon[31203]: pgmap v473: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.0 MiB/s wr, 362 op/s 2024-09-19T09:22:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:46 smithi099 ceph-mon[35256]: pgmap v473: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 2.0 MiB/s wr, 362 op/s 2024-09-19T09:22:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 -- 172.21.15.46:0/949383931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 msgr2=0x7fd068101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 --2- 172.21.15.46:0/949383931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068101f60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd058009900 tx=0x7fd05802a410 comp rx=0 tx=0).stop 2024-09-19T09:22:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 -- 172.21.15.46:0/949383931 shutdown_connections 2024-09-19T09:22:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 --2- 172.21.15.46:0/949383931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd068103710 0x7fd068109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.636 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 --2- 172.21.15.46:0/949383931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068102d50 0x7fd0681031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 --2- 172.21.15.46:0/949383931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068101f60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 -- 172.21.15.46:0/949383931 >> 172.21.15.46:0/949383931 conn(0x7fd0680fd2e0 msgr2=0x7fd0680ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 -- 172.21.15.46:0/949383931 shutdown_connections 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.631+0000 7fd06f159640 1 -- 172.21.15.46:0/949383931 wait complete. 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 Processor -- start 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 -- start start 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd068102d50 0x7fd068198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068103710 0x7fd06819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd06810d810 con 0x7fd068101b60 2024-09-19T09:22:47.637 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd06810d690 con 0x7fd068102d50 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06f159640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd06810d990 con 0x7fd068103710 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06cef5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06cef5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40172/0 (socket says 172.21.15.46:40172) 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06cef5640 1 -- 172.21.15.46:0/3251266561 learned_addr learned my addr 172.21.15.46:0/3251266561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd067fff640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd068102d50 0x7fd068198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.632+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068103710 0x7fd06819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06cef5640 1 -- 172.21.15.46:0/3251266561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068103710 msgr2=0x7fd06819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06cef5640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068103710 0x7fd06819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06cef5640 1 -- 172.21.15.46:0/3251266561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd068102d50 msgr2=0x7fd068198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06cef5640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd068102d50 0x7fd068198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.638 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06cef5640 1 -- 172.21.15.46:0/3251266561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06819f970 con 0x7fd068101b60 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068103710 0x7fd06819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06cef5640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068197d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd058031440 tx=0x7fd058032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd065ffb640 1 -- 172.21.15.46:0/3251266561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05803f030 con 0x7fd068101b60 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06819fc00 con 0x7fd068101b60 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd065ffb640 1 -- 172.21.15.46:0/3251266561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd058003ce0 con 0x7fd068101b60 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd065ffb640 1 -- 172.21.15.46:0/3251266561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058035070 con 0x7fd068101b60 2024-09-19T09:22:47.639 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.633+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0681a00f0 con 0x7fd068101b60 2024-09-19T09:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd065ffb640 1 -- 172.21.15.46:0/3251266561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd058042030 con 0x7fd068101b60 2024-09-19T09:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 Processor -- start 2024-09-19T09:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 -- start start 2024-09-19T09:22:47.645 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 0x562337b42da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b432e0 0x562337b47da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b4a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x562337aa62f0 con 0x562337b429a0 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562337a4e270 con 0x562337b432e0 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd071fd3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562337aa22b0 con 0x562337b48370 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd06d6f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 0x562337b42da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd06d6f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 0x562337b42da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40176/0 (socket says 172.21.15.46:40176) 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd06d6f6640 1 -- 172.21.15.46:0/2366016441 learned_addr learned my addr 172.21.15.46:0/2366016441 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd06cef5640 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b432e0 0x562337b47da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd067fff640 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b4a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.636+0000 7fd065ffb640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0540a32f0 0x7fd0540a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.646 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 -- 172.21.15.46:0/2366016441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 msgr2=0x562337b4a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b4a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 -- 172.21.15.46:0/2366016441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b432e0 msgr2=0x562337b47da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b432e0 0x562337b47da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 -- 172.21.15.46:0/2366016441 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562337a4d340 con 0x562337b429a0 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd065ffb640 1 -- 172.21.15.46:0/3251266561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd0580eff70 con 0x7fd068101b60 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0540a32f0 0x7fd0540a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 0x562337b42da0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e3a0 tx=0x7fd06000e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80e51ec481321f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd05effd640 1 -- 172.21.15.46:0/2366016441 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060012dc0 con 0x562337b429a0 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd05effd640 1 -- 172.21.15.46:0/2366016441 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0600124b0 con 0x562337b429a0 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.637+0000 7fd05effd640 1 -- 172.21.15.46:0/2366016441 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060005290 con 0x562337b429a0 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 -- 172.21.15.46:0/2366016441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 msgr2=0x562337b42da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.647 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0540a32f0 0x7fd0540a57b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd06001f000 tx=0x7fd060020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 0x562337b42da0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd06000e3a0 tx=0x7fd06000e860 comp rx=0 tx=0).stop 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 -- 172.21.15.46:0/2366016441 shutdown_connections 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b4a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b432e0 0x562337b47da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2366016441 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b429a0 0x562337b42da0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 -- 172.21.15.46:0/2366016441 >> 172.21.15.46:0/2366016441 conn(0x562337b3e010 msgr2=0x562337b3e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 -- 172.21.15.46:0/2366016441 shutdown_connections 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 -- 172.21.15.46:0/2366016441 wait complete. 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 -- start start 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.638+0000 7fd071fd3740 1 Processor -- start 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b4cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.648 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b4d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b54120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x562337b4b340 con 0x562337b432e0 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562337a2f290 con 0x562337b429a0 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562337b4b4c0 con 0x562337b48370 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd071fd3740 10 client.0 _ll_register_callbacks cb 0x562337a60140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b4d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b4d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40186/0 (socket says 172.21.15.46:40186) 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd06cef5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b4cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 -- 172.21.15.46:0/3526332034 learned_addr learned my addr 172.21.15.46:0/3526332034 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b54120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 -- 172.21.15.46:0/3526332034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 msgr2=0x562337b54120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.649 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b54120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 -- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 msgr2=0x562337b4cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b4cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd067fff640 1 -- 172.21.15.46:0/3526332034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623377b9210 con 0x562337b432e0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.639+0000 7fd06cef5640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b4cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd067fff640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b4d0e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd050004650 tx=0x7fd0500039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bc2cbebb4d1573 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd047fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd047fff640 1 -- 172.21.15.46:0/3526332034 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050011910 con 0x562337b432e0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd047fff640 1 -- 172.21.15.46:0/3526332034 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd050011ab0 con 0x562337b432e0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0600124b0 con 0x562337b432e0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd047fff640 1 -- 172.21.15.46:0/3526332034 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd050011cb0 con 0x562337b432e0 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd071fd3740 10 client.16554 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:47.650 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562337885620 con 0x562337b432e0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd047fff640 1 -- 172.21.15.46:0/3526332034 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0600124b0 con 0x562337b432e0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.640+0000 7fd047fff640 1 -- 172.21.15.46:0/3526332034 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fd050018070 con 0x562337b432e0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd071fd3740 10 client.16554 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd071fd3740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd071fd3740 20 client.16554 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd071fd3740 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337b589a0 0x562337b5ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd071fd3740 4 client.16554 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562337ab3a20 con 0x562337b589a0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd06cef5640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337b589a0 0x562337b5ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd06cef5640 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337b589a0 0x562337b5ae00 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df018d02419e7f76 server_cookie=4117bddc7705bef5 in_seq=0 out_seq=0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.641+0000 7fd047fff640 10 client.16554 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd047fff640 1 -- 172.21.15.46:0/3526332034 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562337ab3a20 con 0x562337b589a0 2024-09-19T09:22:47.651 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd047fff640 10 client.16554 handle_command_reply: tid=0 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 client.16554 shutdown 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 msgr2=0x562337b4d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b4d0e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd050004650 tx=0x7fd0500039c0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 shutdown_connections 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337b589a0 0x562337b5ae00 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b4d0e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b54120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 --2- 172.21.15.46:0/3526332034 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b4cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd047fff640 0 client.16554 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.642+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 >> 172.21.15.46:0/3526332034 conn(0x562337b3e010 msgr2=0x562337b3f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.643+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 shutdown_connections 2024-09-19T09:22:47.652 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.643+0000 7fd071fd3740 1 -- 172.21.15.46:0/3526332034 wait complete. 2024-09-19T09:22:47.653 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.643+0000 7fd071fd3740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T09:22:47.659 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 Processor -- start 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 -- start start 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b42d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b3d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b3f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd0681a8e30 con 0x562337b432e0 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0681aaa30 con 0x562337b429a0 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd071fd3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd0681a9500 con 0x562337b48370 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd067fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b3d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd067fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b3d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40188/0 (socket says 172.21.15.46:40188) 2024-09-19T09:22:47.660 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.657+0000 7fd067fff640 1 -- 172.21.15.46:0/1492105093 learned_addr learned my addr 172.21.15.46:0/1492105093 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd06cef5640 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b42d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b3f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd067fff640 1 -- 172.21.15.46:0/1492105093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 msgr2=0x562337b3f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd067fff640 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b3f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd067fff640 1 -- 172.21.15.46:0/1492105093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 msgr2=0x562337b42d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd067fff640 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b42d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd067fff640 1 -- 172.21.15.46:0/1492105093 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562337b43ee0 con 0x562337b432e0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd067fff640 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b3d0b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c590 tx=0x7fd05000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d58fe50e5df52f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd05e7fc640 1 -- 172.21.15.46:0/1492105093 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050011710 con 0x562337b432e0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd05e7fc640 1 -- 172.21.15.46:0/1492105093 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd050011e50 con 0x562337b432e0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.658+0000 7fd05e7fc640 1 -- 172.21.15.46:0/1492105093 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050005420 con 0x562337b432e0 2024-09-19T09:22:47.661 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- 172.21.15.46:0/1492105093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 msgr2=0x562337b3d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b3d0b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c590 tx=0x7fd05000caa0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- 172.21.15.46:0/1492105093 shutdown_connections 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337b3d0b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b48370 0x562337b3f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- 172.21.15.46:0/1492105093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b429a0 0x562337b42d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- 172.21.15.46:0/1492105093 >> 172.21.15.46:0/1492105093 conn(0x562337b3e010 msgr2=0x562337b3c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- 172.21.15.46:0/1492105093 shutdown_connections 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- 172.21.15.46:0/1492105093 wait complete. 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- start start 2024-09-19T09:22:47.662 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 Processor -- start 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b429a0 0x562337bbe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337bbef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b48370 0x562337bc5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd0681aa360 con 0x562337b432e0 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0681a9bd0 con 0x562337b48370 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd0681a6e10 con 0x562337b429a0 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.659+0000 7fd071fd3740 10 client.0 _ll_register_callbacks cb 0x7fd050004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337bbef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337bbef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40202/0 (socket says 172.21.15.46:40202) 2024-09-19T09:22:47.665 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 -- 172.21.15.46:0/2172143385 learned_addr learned my addr 172.21.15.46:0/2172143385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd06d6f6640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b48370 0x562337bc5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd06cef5640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b429a0 0x562337bbe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 -- 172.21.15.46:0/2172143385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b429a0 msgr2=0x562337bbe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b429a0 0x562337bbe9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 -- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b48370 msgr2=0x562337bc5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b48370 0x562337bc5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 -- 172.21.15.46:0/2172143385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562337bc6560 con 0x562337b432e0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd067fff640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337bbef10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd05000cb50 tx=0x7fd0500053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4908b0688ec9c938 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd047fff640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd047fff640 1 -- 172.21.15.46:0/2172143385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050025420 con 0x562337b432e0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd047fff640 1 -- 172.21.15.46:0/2172143385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd050025860 con 0x562337b432e0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd050011e50 con 0x562337b432e0 2024-09-19T09:22:47.666 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd047fff640 1 -- 172.21.15.46:0/2172143385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd050025a60 con 0x562337b432e0 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd071fd3740 10 client.16560 fetch_fsmap learned FSMap version 37 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.660+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562337bc7870 con 0x562337b432e0 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd047fff640 1 -- 172.21.15.46:0/2172143385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd050011e50 con 0x562337b432e0 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd047fff640 1 -- 172.21.15.46:0/2172143385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fd050018070 con 0x562337b432e0 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd071fd3740 10 client.16560 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd071fd3740 10 client.16560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd071fd3740 20 client.16560 populate_metadata read hostname 'smithi046' 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337bc8210 0x562337bca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd071fd3740 4 client.16560 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562337aadd70 con 0x562337bc8210 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.661+0000 7fd06cef5640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337bc8210 0x562337bca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.667 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.662+0000 7fd06cef5640 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337bc8210 0x562337bca630 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c4fd8f10b196df3 server_cookie=b924f6c36ef86bd in_seq=0 out_seq=0 2024-09-19T09:22:47.668 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.662+0000 7fd047fff640 10 client.16560 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd047fff640 1 -- 172.21.15.46:0/2172143385 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562337aadd70 con 0x562337bc8210 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd047fff640 10 client.16560 handle_command_reply: tid=0 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 client.16560 shutdown 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 msgr2=0x562337bbef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337bbef10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd05000cb50 tx=0x7fd0500053d0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 shutdown_connections 2024-09-19T09:22:47.680 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562337bc8210 0x562337bca630 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562337b432e0 0x562337bbef10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562337b48370 0x562337bc5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 --2- 172.21.15.46:0/2172143385 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562337b429a0 0x562337bbe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd047fff640 0 client.16560 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 >> 172.21.15.46:0/2172143385 conn(0x562337b3e010 msgr2=0x562337b3d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 shutdown_connections 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 1 -- 172.21.15.46:0/2172143385 wait complete. 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.679+0000 7fd071fd3740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T09:22:47.681 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:22:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:22:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:22:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:22:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0540a32f0 msgr2=0x7fd0540a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.682 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0540a32f0 0x7fd0540a57b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd06001f000 tx=0x7fd060020000 comp rx=0 tx=0).stop 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 msgr2=0x7fd068197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068197d50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd058031440 tx=0x7fd058032e20 comp rx=0 tx=0).stop 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 shutdown_connections 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0540a32f0 0x7fd0540a57b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd068103710 0x7fd06819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd068102d50 0x7fd068198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 --2- 172.21.15.46:0/3251266561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd068101b60 0x7fd068197d50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 >> 172.21.15.46:0/3251266561 conn(0x7fd0680fd2e0 msgr2=0x7fd068106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 shutdown_connections 2024-09-19T09:22:47.683 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:22:47.680+0000 7fd06f159640 1 -- 172.21.15.46:0/3251266561 wait complete. 2024-09-19T09:22:48.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:48 smithi115 ceph-mon[35055]: pgmap v474: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.4 MiB/s wr, 238 op/s 2024-09-19T09:22:48.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:48 smithi046 ceph-mon[31203]: pgmap v474: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.4 MiB/s wr, 238 op/s 2024-09-19T09:22:48.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:48 smithi099 ceph-mon[35256]: pgmap v474: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 1.4 MiB/s wr, 238 op/s 2024-09-19T09:22:50.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:50 smithi115 ceph-mon[35055]: pgmap v475: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 383 KiB/s wr, 87 op/s 2024-09-19T09:22:50.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:50 smithi046 ceph-mon[31203]: pgmap v475: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 383 KiB/s wr, 87 op/s 2024-09-19T09:22:50.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:50 smithi099 ceph-mon[35256]: pgmap v475: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 383 KiB/s wr, 87 op/s 2024-09-19T09:22:52.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:52 smithi115 ceph-mon[35055]: pgmap v476: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 384 KiB/s wr, 89 op/s 2024-09-19T09:22:52.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:52 smithi046 ceph-mon[31203]: pgmap v476: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 384 KiB/s wr, 89 op/s 2024-09-19T09:22:52.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:52 smithi099 ceph-mon[35256]: pgmap v476: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 384 KiB/s wr, 89 op/s 2024-09-19T09:22:54.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:54 smithi115 ceph-mon[35055]: pgmap v477: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 182 KiB/s wr, 38 op/s 2024-09-19T09:22:54.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:54 smithi046 ceph-mon[31203]: pgmap v477: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 182 KiB/s wr, 38 op/s 2024-09-19T09:22:54.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:54 smithi099 ceph-mon[35256]: pgmap v477: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 182 KiB/s wr, 38 op/s 2024-09-19T09:22:56.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:56 smithi115 ceph-mon[35055]: pgmap v478: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-19T09:22:56.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:56 smithi046 ceph-mon[31203]: pgmap v478: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-19T09:22:56.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:56 smithi099 ceph-mon[35256]: pgmap v478: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.8 KiB/s wr, 12 op/s 2024-09-19T09:22:58.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:22:58 smithi115 ceph-mon[35055]: pgmap v479: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2024-09-19T09:22:58.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:22:58 smithi046 ceph-mon[31203]: pgmap v479: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2024-09-19T09:22:58.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:22:58 smithi099 ceph-mon[35256]: pgmap v479: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.9 KiB/s wr, 14 op/s 2024-09-19T09:23:00.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:00 smithi115 ceph-mon[35055]: pgmap v480: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T09:23:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:00 smithi046 ceph-mon[31203]: pgmap v480: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T09:23:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:00 smithi099 ceph-mon[35256]: pgmap v480: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/1594961990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0101b60 msgr2=0x7f3dc0101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/1594961990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0101b60 0x7f3dc0101f60 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009900 tx=0x7f3dbc02a410 comp rx=0 tx=0).stop 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/1594961990 shutdown_connections 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/1594961990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0103710 0x7f3dc0109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/1594961990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc0102d50 0x7f3dc01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/1594961990 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0101b60 0x7f3dc0101f60 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.784 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/1594961990 >> 172.21.15.46:0/1594961990 conn(0x7f3dc00fd2e0 msgr2=0x7f3dc00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/1594961990 shutdown_connections 2024-09-19T09:23:00.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.783+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/1594961990 wait complete. 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 Processor -- start 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 -- start start 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc0101b60 0x7f3dc0197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0102d50 0x7f3dc01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 0x7f3dc019f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc010d7c0 con 0x7f3dc0103710 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc010d640 con 0x7f3dc0102d50 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc7ad0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc010d940 con 0x7f3dc0101b60 2024-09-19T09:23:00.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc606d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 0x7f3dc019f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc606d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 0x7f3dc019f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36628/0 (socket says 172.21.15.46:36628) 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc606d640 1 -- 172.21.15.46:0/2214319397 learned_addr learned my addr 172.21.15.46:0/2214319397 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc506b640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0102d50 0x7f3dc01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc586c640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc0101b60 0x7f3dc0197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.784+0000 7f3dc606d640 1 -- 172.21.15.46:0/2214319397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc0101b60 msgr2=0x7f3dc0197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc606d640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc0101b60 0x7f3dc0197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc606d640 1 -- 172.21.15.46:0/2214319397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0102d50 msgr2=0x7f3dc01982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc606d640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0102d50 0x7f3dc01982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc606d640 1 -- 172.21.15.46:0/2214319397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc019f9b0 con 0x7f3dc0103710 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc606d640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 0x7f3dc019f310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3db800eaa0 tx=0x7f3db800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3db6ffd640 1 -- 172.21.15.46:0/2214319397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8004d20 con 0x7f3dc0103710 2024-09-19T09:23:00.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3db6ffd640 1 -- 172.21.15.46:0/2214319397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db8005020 con 0x7f3dc0103710 2024-09-19T09:23:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc019fca0 con 0x7f3dc0103710 2024-09-19T09:23:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3db6ffd640 1 -- 172.21.15.46:0/2214319397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db80116d0 con 0x7f3dc0103710 2024-09-19T09:23:00.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.785+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc01a0170 con 0x7f3dc0103710 2024-09-19T09:23:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.788+0000 7f3db6ffd640 1 -- 172.21.15.46:0/2214319397 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3db80051d0 con 0x7f3dc0103710 2024-09-19T09:23:00.794 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.788+0000 7f3dca86c740 1 Processor -- start 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.788+0000 7f3dca86c740 1 -- start start 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.788+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e221da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.788+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e226da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.788+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e229830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dca86c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a58e1852f0 con 0x55a58e2219a0 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dca86c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a58e12d270 con 0x55a58e227370 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dca86c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a58e1812b0 con 0x55a58e2222e0 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e221da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e221da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36630/0 (socket says 172.21.15.46:36630) 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 -- 172.21.15.46:0/1832942090 learned_addr learned my addr 172.21.15.46:0/1832942090 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc586c640 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e226da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.795 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3db6ffd640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3dac0a32f0 0x7f3dac0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e229830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 -- 172.21.15.46:0/1832942090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 msgr2=0x55a58e226da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e226da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 -- 172.21.15.46:0/1832942090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 msgr2=0x55a58e229830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e229830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 -- 172.21.15.46:0/1832942090 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58e12c340 con 0x55a58e2219a0 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc606d640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3dac0a32f0 0x7f3dac0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3db6ffd640 1 -- 172.21.15.46:0/2214319397 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f3db80cfb50 con 0x7f3dc0103710 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.789+0000 7f3dc506b640 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e221da0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3db000af40 tx=0x7f3db000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d567821ca7839d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dabfff640 1 -- 172.21.15.46:0/1832942090 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db000f650 con 0x55a58e2219a0 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dabfff640 1 -- 172.21.15.46:0/1832942090 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db0017030 con 0x55a58e2219a0 2024-09-19T09:23:00.796 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dabfff640 1 -- 172.21.15.46:0/1832942090 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db001b630 con 0x55a58e2219a0 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 -- 172.21.15.46:0/1832942090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 msgr2=0x55a58e221da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dc606d640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3dac0a32f0 0x7f3dac0a57b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009270 tx=0x7f3db80915f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e221da0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3db000af40 tx=0x7f3db000a860 comp rx=0 tx=0).stop 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 -- 172.21.15.46:0/1832942090 shutdown_connections 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e229830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e226da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 --2- 172.21.15.46:0/1832942090 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e221da0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 -- 172.21.15.46:0/1832942090 >> 172.21.15.46:0/1832942090 conn(0x55a58e21d010 msgr2=0x55a58e21d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.790+0000 7f3dca86c740 1 -- 172.21.15.46:0/1832942090 shutdown_connections 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 -- 172.21.15.46:0/1832942090 wait complete. 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 -- start start 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 Processor -- start 2024-09-19T09:23:00.797 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e22ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e237500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55a58e22a340 con 0x55a58e2219a0 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55a58e10e290 con 0x55a58e227370 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55a58e22a4c0 con 0x55a58e2222e0 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dca86c740 10 client.0 _ll_register_callbacks cb 0x55a58e13f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.791+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e22ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e22ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36640/0 (socket says 172.21.15.46:36640) 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 -- 172.21.15.46:0/4081965010 learned_addr learned my addr 172.21.15.46:0/4081965010 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc586c640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e237500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 -- 172.21.15.46:0/4081965010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 msgr2=0x55a58e2304c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.798 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2304c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 -- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 msgr2=0x55a58e237500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e237500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 -- 172.21.15.46:0/4081965010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58de98210 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dc506b640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e22ff80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3db000a940 tx=0x7f3db000a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8331433b21a6f22b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3da97fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3da97fa640 1 -- 172.21.15.46:0/4081965010 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0005230 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3da97fa640 1 -- 172.21.15.46:0/4081965010 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f3db00053d0 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3db0017030 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3da97fa640 1 -- 172.21.15.46:0/4081965010 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3db000a2d0 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.792+0000 7f3dca86c740 10 client.16572 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a58df64620 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3da97fa640 1 -- 172.21.15.46:0/4081965010 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db0017030 con 0x55a58e2219a0 2024-09-19T09:23:00.799 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3da97fa640 1 -- 172.21.15.46:0/4081965010 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f3db000f820 con 0x55a58e2219a0 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 10 client.16572 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 10 client.16572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 20 client.16572 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e23bab0 0x55a58e23def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 4 client.16572 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a58e192a20 con 0x55a58e23bab0 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.793+0000 7f3dc586c640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e23bab0 0x55a58e23def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.794+0000 7f3da97fa640 10 client.16572 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:00.800 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.794+0000 7f3dc586c640 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e23bab0 0x55a58e23def0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49a595050551b47 server_cookie=3019d63b201adff in_seq=0 out_seq=0 2024-09-19T09:23:00.801 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.794+0000 7f3da97fa640 1 -- 172.21.15.46:0/4081965010 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a58e192a20 con 0x55a58e23bab0 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.794+0000 7f3da97fa640 10 client.16572 handle_command_reply: tid=0 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.794+0000 7f3dca86c740 1 client.16572 shutdown 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 msgr2=0x55a58e22ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e22ff80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3db000a940 tx=0x7f3db000a8d0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 shutdown_connections 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e23bab0 0x55a58e23def0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e237500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 --2- 172.21.15.46:0/4081965010 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e22ff80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3da97fa640 0 client.16572 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:00.802 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 >> 172.21.15.46:0/4081965010 conn(0x55a58e21d010 msgr2=0x55a58e21e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 shutdown_connections 2024-09-19T09:23:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 1 -- 172.21.15.46:0/4081965010 wait complete. 2024-09-19T09:23:00.803 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.795+0000 7f3dca86c740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T09:23:00.811 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 Processor -- start 2024-09-19T09:23:00.811 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 -- start start 2024-09-19T09:23:00.811 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e21b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.811 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.811 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e21bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a6c80 con 0x55a58e2219a0 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a8880 con 0x55a58e227370 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dca86c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a7350 con 0x55a58e2222e0 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e21b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e21b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36650/0 (socket says 172.21.15.46:36650) 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 -- 172.21.15.46:0/3134829542 learned_addr learned my addr 172.21.15.46:0/3134829542 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 -- 172.21.15.46:0/3134829542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 msgr2=0x55a58e2374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc586c640 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 -- 172.21.15.46:0/3134829542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 msgr2=0x55a58e21bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e21bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.812 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 -- 172.21.15.46:0/3134829542 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58e22aed0 con 0x55a58e2219a0 2024-09-19T09:23:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc586c640 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.810+0000 7f3dc506b640 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e21b9a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3db000ad70 tx=0x7f3db000ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f08f1244c1961f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dab7fe640 1 -- 172.21.15.46:0/3134829542 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db000fe60 con 0x55a58e2219a0 2024-09-19T09:23:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dab7fe640 1 -- 172.21.15.46:0/3134829542 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db0017040 con 0x55a58e2219a0 2024-09-19T09:23:00.813 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dab7fe640 1 -- 172.21.15.46:0/3134829542 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0005450 con 0x55a58e2219a0 2024-09-19T09:23:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 -- 172.21.15.46:0/3134829542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 msgr2=0x55a58e21b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e21b9a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3db000ad70 tx=0x7f3db000ae70 comp rx=0 tx=0).stop 2024-09-19T09:23:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 -- 172.21.15.46:0/3134829542 shutdown_connections 2024-09-19T09:23:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e227370 0x55a58e21bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.816 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e2222e0 0x55a58e2374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 --2- 172.21.15.46:0/3134829542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e21b9a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 -- 172.21.15.46:0/3134829542 >> 172.21.15.46:0/3134829542 conn(0x55a58e21d010 msgr2=0x55a58e22fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 -- 172.21.15.46:0/3134829542 shutdown_connections 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.811+0000 7f3dca86c740 1 -- 172.21.15.46:0/3134829542 wait complete. 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 -- start start 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 Processor -- start 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e2344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e2222e0 0x55a58e234a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e227370 0x55a58e2a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a81b0 con 0x55a58e2219a0 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a7a20 con 0x55a58e2222e0 2024-09-19T09:23:00.817 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc01a4c60 con 0x55a58e227370 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dca86c740 10 client.0 _ll_register_callbacks cb 0x7f3db000ada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e2344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dc506b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e2344f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36660/0 (socket says 172.21.15.46:36660) 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dc506b640 1 -- 172.21.15.46:0/138675623 learned_addr learned my addr 172.21.15.46:0/138675623 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dc586c640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e2222e0 0x55a58e234a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.812+0000 7f3dc506b640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e227370 0x55a58e2a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc506b640 1 -- 172.21.15.46:0/138675623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e227370 msgr2=0x55a58e2a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc506b640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e227370 0x55a58e2a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc506b640 1 -- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e2222e0 msgr2=0x55a58e234a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc506b640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e2222e0 0x55a58e234a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc506b640 1 -- 172.21.15.46:0/138675623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58e2a4d80 con 0x55a58e2219a0 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc586c640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e2222e0 0x55a58e234a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:00.818 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dc506b640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e2344f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3db0000c00 tx=0x7f3db0012850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e88b5fa28a4df6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3da97fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3da97fa640 1 -- 172.21.15.46:0/138675623 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db00051d0 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3da97fa640 1 -- 172.21.15.46:0/138675623 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f3db0005370 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3db0017040 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3da97fa640 1 -- 172.21.15.46:0/138675623 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3db0005570 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dca86c740 10 client.16578 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a58e2a6000 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3da97fa640 1 -- 172.21.15.46:0/138675623 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db0017040 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.813+0000 7f3da97fa640 1 -- 172.21.15.46:0/138675623 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f3db0035070 con 0x55a58e2219a0 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dca86c740 10 client.16578 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dca86c740 10 client.16578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dca86c740 20 client.16578 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:00.819 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dca86c740 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e2a6a10 0x55a58e2a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dca86c740 4 client.16578 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a58e18cd70 con 0x55a58e2a6a10 2024-09-19T09:23:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dc586c640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e2a6a10 0x55a58e2a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3da97fa640 10 client.16578 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:00.820 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.814+0000 7f3dc586c640 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e2a6a10 0x55a58e2a8e30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b277382c98b9cb server_cookie=26df202be9f67be4 in_seq=0 out_seq=0 2024-09-19T09:23:00.829 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3da97fa640 1 -- 172.21.15.46:0/138675623 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a58e18cd70 con 0x55a58e2a6a10 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3da97fa640 10 client.16578 handle_command_reply: tid=0 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 client.16578 shutdown 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 msgr2=0x55a58e2344f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e2344f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3db0000c00 tx=0x7f3db0012850 comp rx=0 tx=0).stop 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 shutdown_connections 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55a58e2a6a10 0x55a58e2a8e30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55a58e227370 0x55a58e2a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a58e2222e0 0x55a58e234a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3da97fa640 0 client.16578 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.828+0000 7f3dca86c740 1 --2- 172.21.15.46:0/138675623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55a58e2219a0 0x55a58e2344f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 >> 172.21.15.46:0/138675623 conn(0x55a58e21d010 msgr2=0x55a58e21df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.830 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 shutdown_connections 2024-09-19T09:23:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dca86c740 1 -- 172.21.15.46:0/138675623 wait complete. 2024-09-19T09:23:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dca86c740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T09:23:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:23:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:23:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:23:00.831 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3dac0a32f0 msgr2=0x7f3dac0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3dac0a32f0 0x7f3dac0a57b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009270 tx=0x7f3db80915f0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 msgr2=0x7f3dc019f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 0x7f3dc019f310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3db800eaa0 tx=0x7f3db800eea0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 shutdown_connections 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f3dac0a32f0 0x7f3dac0a57b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3dc0103710 0x7f3dc019f310 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.832 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0102d50 0x7f3dc01982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 --2- 172.21.15.46:0/2214319397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc0101b60 0x7f3dc0197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 >> 172.21.15.46:0/2214319397 conn(0x7f3dc00fd2e0 msgr2=0x7f3dc0106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 shutdown_connections 2024-09-19T09:23:00.833 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:00.829+0000 7f3dc7ad0640 1 -- 172.21.15.46:0/2214319397 wait complete. 2024-09-19T09:23:02.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:02 smithi115 ceph-mon[35055]: pgmap v481: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-19T09:23:02.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:02 smithi046 ceph-mon[31203]: pgmap v481: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-19T09:23:02.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:02 smithi099 ceph-mon[35256]: pgmap v481: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-19T09:23:03.977 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:23:04.245 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:04.627 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:04 smithi046 ceph-mon[31203]: pgmap v482: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-19T09:23:04.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:04 smithi115 ceph-mon[35055]: pgmap v482: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-19T09:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 -- 172.21.15.46:0/3079409212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf300745c0 msgr2=0x7fdf300749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/3079409212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf300745c0 0x7fdf300749a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009900 tx=0x7fdf2002a480 comp rx=0 tx=0).stop 2024-09-19T09:23:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 -- 172.21.15.46:0/3079409212 shutdown_connections 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/3079409212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf3010e430 0x7fdf30110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/3079409212 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf30074ee0 0x7fdf3010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/3079409212 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf300745c0 0x7fdf300749a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 -- 172.21.15.46:0/3079409212 >> 172.21.15.46:0/3079409212 conn(0x7fdf300fd8f0 msgr2=0x7fdf300ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 -- 172.21.15.46:0/3079409212 shutdown_connections 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.712+0000 7fdf34f2d640 1 -- 172.21.15.46:0/3079409212 wait complete. 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 Processor -- start 2024-09-19T09:23:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 -- start start 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf300745c0 0x7fdf3019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf30074ee0 0x7fdf3019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 0x7fdf3019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114180 con 0x7fdf3010e430 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114000 con 0x7fdf30074ee0 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf34f2d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114300 con 0x7fdf300745c0 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 0x7fdf3019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2e59c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf300745c0 0x7fdf3019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 0x7fdf3019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36678/0 (socket says 172.21.15.46:36678) 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 -- 172.21.15.46:0/4033801781 learned_addr learned my addr 172.21.15.46:0/4033801781 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf30074ee0 0x7fdf3019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 -- 172.21.15.46:0/4033801781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf300745c0 msgr2=0x7fdf3019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf300745c0 0x7fdf3019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 -- 172.21.15.46:0/4033801781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf30074ee0 msgr2=0x7fdf3019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf30074ee0 0x7fdf3019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.713+0000 7fdf2ed9d640 1 -- 172.21.15.46:0/4033801781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3019f5d0 con 0x7fdf3010e430 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf2dd9b640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf30074ee0 0x7fdf3019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf2ed9d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 0x7fdf3019eef0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800eb40 tx=0x7fdf2800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800ce40 con 0x7fdf3010e430 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf28005020 con 0x7fdf3010e430 2024-09-19T09:23:04.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28010690 con 0x7fdf3010e430 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3019f8c0 con 0x7fdf3010e430 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.714+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf301a71a0 con 0x7fdf3010e430 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.715+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf300749a0 con 0x7fdf3010e430 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.716+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdf280051d0 con 0x7fdf3010e430 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.717+0000 7fdf1f7fe640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf180a3240 0x7fdf180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.717+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fdf280cff70 con 0x7fdf3010e430 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.717+0000 7fdf2e59c640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf180a3240 0x7fdf180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.718+0000 7fdf2e59c640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf180a3240 0x7fdf180a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009230 tx=0x7fdf200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.724+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf2809ccc0 con 0x7fdf3010e430 2024-09-19T09:23:04.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:04 smithi099 ceph-mon[35256]: pgmap v482: 97 pgs: 97 active+clean; 50 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.942+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf3019b980 con 0x7fdf3010e430 2024-09-19T09:23:04.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.943+0000 7fdf1f7fe640 1 -- 172.21.15.46:0/4033801781 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11967 (secure 0 0 0) 0x7fdf3019b980 con 0x7fdf3010e430 2024-09-19T09:23:04.944 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:23:04.944 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-19T09:21:29:130184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:21:29.130168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:23:04.944 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf180a3240 msgr2=0x7fdf180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf180a3240 0x7fdf180a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009230 tx=0x7fdf200058d0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 msgr2=0x7fdf3019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 0x7fdf3019eef0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800eb40 tx=0x7fdf2800ef40 comp rx=0 tx=0).stop 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 shutdown_connections 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fdf180a3240 0x7fdf180a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf3010e430 0x7fdf3019eef0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf30074ee0 0x7fdf3019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 --2- 172.21.15.46:0/4033801781 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf300745c0 0x7fdf3019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.945+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 >> 172.21.15.46:0/4033801781 conn(0x7fdf300fd8f0 msgr2=0x7fdf300fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.946+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 shutdown_connections 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:04.946+0000 7fdf34f2d640 1 -- 172.21.15.46:0/4033801781 wait complete. 2024-09-19T09:23:05.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:05 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4033801781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:05.717 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:05 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4033801781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:05.746 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id ba070a16 --release --await' 2024-09-19T09:23:05.746 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id ba070a16 --release --await 2024-09-19T09:23:05.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:05 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4033801781' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:06.007 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:06.413 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:06 smithi046 ceph-mon[31203]: pgmap v483: 97 pgs: 97 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:23:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 -- 172.21.15.46:0/3237366390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 msgr2=0x7fc34c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 --2- 172.21.15.46:0/3237366390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c100ee0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009930 tx=0x7fc33c02a420 comp rx=0 tx=0).stop 2024-09-19T09:23:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 -- 172.21.15.46:0/3237366390 shutdown_connections 2024-09-19T09:23:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 --2- 172.21.15.46:0/3237366390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c100ee0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 --2- 172.21.15.46:0/3237366390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c101420 0x7fc34c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 --2- 172.21.15.46:0/3237366390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c106a80 0x7fc34c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 -- 172.21.15.46:0/3237366390 >> 172.21.15.46:0/3237366390 conn(0x7fc34c0fc7a0 msgr2=0x7fc34c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 -- 172.21.15.46:0/3237366390 shutdown_connections 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.503+0000 7fc354557640 1 -- 172.21.15.46:0/3237366390 wait complete. 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 Processor -- start 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 -- start start 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c101420 0x7fc34c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c106a80 0x7fc34c19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c110ef0 con 0x7fc34c100a80 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c110d70 con 0x7fc34c101420 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc354557640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c111070 con 0x7fc34c106a80 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c1973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36698/0 (socket says 172.21.15.46:36698) 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.504+0000 7fc3522f3640 1 -- 172.21.15.46:0/1863292214 learned_addr learned my addr 172.21.15.46:0/1863292214 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc351af2640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c101420 0x7fc34c197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc352af4640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c106a80 0x7fc34c19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3522f3640 1 -- 172.21.15.46:0/1863292214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c106a80 msgr2=0x7fc34c19bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3522f3640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c106a80 0x7fc34c19bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3522f3640 1 -- 172.21.15.46:0/1863292214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c101420 msgr2=0x7fc34c197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3522f3640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c101420 0x7fc34c197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3522f3640 1 -- 172.21.15.46:0/1863292214 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c19c380 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc352af4640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c106a80 0x7fc34c19bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc351af2640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c101420 0x7fc34c197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3522f3640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c1973d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d950 tx=0x7fc34800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3437fe640 1 -- 172.21.15.46:0/1863292214 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348017070 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3437fe640 1 -- 172.21.15.46:0/1863292214 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc348009c30 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34c19c670 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc3437fe640 1 -- 172.21.15.46:0/1863292214 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34800f6b0 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.505+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34c1a3f50 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.507+0000 7fc3437fe640 1 -- 172.21.15.46:0/1863292214 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc3480109d0 con 0x7fc34c100a80 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 Processor -- start 2024-09-19T09:23:06.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 -- start start 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ec3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407ecff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ed0450 0x558407ed2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558407e28620 con 0x558407ec2f40 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558407dcfe50 con 0x558407ec3860 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc356930740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558407e245e0 con 0x558407ed0450 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc352af4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ec3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc352af4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ec3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36700/0 (socket says 172.21.15.46:36700) 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc3437fe640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3380a32c0 0x7fc3380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc352af4640 1 -- 172.21.15.46:0/530226376 learned_addr learned my addr 172.21.15.46:0/530226376 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc351af2640 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ed0450 0x558407ed2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.508+0000 7fc3522f3640 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407ecff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3380a32c0 0x7fc3380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 -- 172.21.15.46:0/530226376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ed0450 msgr2=0x558407ed2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ed0450 0x558407ed2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 -- 172.21.15.46:0/530226376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 msgr2=0x558407ecff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407ecff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 -- 172.21.15.46:0/530226376 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558407dc0d40 con 0x558407ec2f40 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc3437fe640 1 -- 172.21.15.46:0/1863292214 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fc3480cf580 con 0x7fc34c100a80 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc352af4640 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ec3320 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc344010a30 tx=0x7fc344010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9cd2f82f4a334c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc340ff9640 1 -- 172.21.15.46:0/530226376 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344020070 con 0x558407ec2f40 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc340ff9640 1 -- 172.21.15.46:0/530226376 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc34401bbd0 con 0x558407ec2f40 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.509+0000 7fc340ff9640 1 -- 172.21.15.46:0/530226376 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34400e590 con 0x558407ec2f40 2024-09-19T09:23:06.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 -- 172.21.15.46:0/530226376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 msgr2=0x558407ec3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ec3320 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fc344010a30 tx=0x7fc344010ef0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc352af4640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3380a32c0 0x7fc3380a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc34401d000 tx=0x7fc344019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 -- 172.21.15.46:0/530226376 shutdown_connections 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ed0450 0x558407ed2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407ecff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 --2- 172.21.15.46:0/530226376 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ec3320 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 -- 172.21.15.46:0/530226376 >> 172.21.15.46:0/530226376 conn(0x558407ebf5f0 msgr2=0x558407ebf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 -- 172.21.15.46:0/530226376 shutdown_connections 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 -- 172.21.15.46:0/530226376 wait complete. 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 -- start start 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.510+0000 7fc356930740 1 Processor -- start 2024-09-19T09:23:06.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ecd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ecd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ed0450 0x558407ecde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x558407ed3020 con 0x558407ec2f40 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x558407db0f10 con 0x558407ed0450 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558407ed31a0 con 0x558407ec3860 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 10 client.0 _ll_register_callbacks cb 0x558407dd4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ecd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ecd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36702/0 (socket says 172.21.15.46:36702) 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 -- 172.21.15.46:0/2400310367 learned_addr learned my addr 172.21.15.46:0/2400310367 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc352af4640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ed0450 0x558407ecde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc351af2640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ecd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 -- 172.21.15.46:0/2400310367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 msgr2=0x558407ecd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ecd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 -- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ed0450 msgr2=0x558407ecde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ed0450 0x558407ecde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 -- 172.21.15.46:0/2400310367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558407b37580 con 0x558407ec2f40 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc352af4640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ed0450 0x558407ecde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc3522f3640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ecd380 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc348010fd0 tx=0x7fc348009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eba31a7293c78af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc335ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc335ffb640 1 -- 172.21.15.46:0/2400310367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348020070 con 0x558407ec2f40 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc335ffb640 1 -- 172.21.15.46:0/2400310367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fc3480cf0e0 con 0x558407ec2f40 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.511+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc34401bbd0 con 0x558407ec2f40 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc335ffb640 1 -- 172.21.15.46:0/2400310367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc3480a47e0 con 0x558407ec2f40 2024-09-19T09:23:06.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 10 client.16596 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558407c01960 con 0x558407ec2f40 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc335ffb640 1 -- 172.21.15.46:0/2400310367 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc34401bbd0 con 0x558407ec2f40 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc335ffb640 1 -- 172.21.15.46:0/2400310367 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fc34809afc0 con 0x558407ec2f40 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 10 client.16596 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 10 client.16596 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 20 client.16596 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ee0050 0x558407ee24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 4 client.16596 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558407e35b90 con 0x558407ee0050 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.512+0000 7fc351af2640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ee0050 0x558407ee24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.513+0000 7fc351af2640 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ee0050 0x558407ee24b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc4df1d19149cf2c server_cookie=9a4aa1bfca5a6b4f in_seq=0 out_seq=0 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.513+0000 7fc335ffb640 10 client.16596 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:06.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc335ffb640 1 -- 172.21.15.46:0/2400310367 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558407e35b90 con 0x558407ee0050 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc335ffb640 10 client.16596 handle_command_reply: tid=0 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 client.16596 shutdown 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 msgr2=0x558407ecd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ecd380 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc348010fd0 tx=0x7fc348009ea0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 shutdown_connections 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ee0050 0x558407ee24b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ed0450 0x558407ecde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ecd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 --2- 172.21.15.46:0/2400310367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ec2f40 0x558407ecd380 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 >> 172.21.15.46:0/2400310367 conn(0x558407ebf5f0 msgr2=0x558407ec5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc335ffb640 0 client.16596 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:06.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 shutdown_connections 2024-09-19T09:23:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 1 -- 172.21.15.46:0/2400310367 wait complete. 2024-09-19T09:23:06.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.514+0000 7fc356930740 20 client.16596 trim_cache size 0 max 16384 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 Processor -- start 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 -- start start 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ebe640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec2f40 0x558407ee7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ee82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c1ab420 con 0x558407ebf5f0 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c1ad020 con 0x558407ec2f40 2024-09-19T09:23:06.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc356930740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c1abaf0 con 0x558407ec3860 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ebe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ebe640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36718/0 (socket says 172.21.15.46:36718) 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.531+0000 7fc3522f3640 1 -- 172.21.15.46:0/3308673546 learned_addr learned my addr 172.21.15.46:0/3308673546 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc352af4640 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ee82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc351af2640 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec2f40 0x558407ee7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc3522f3640 1 -- 172.21.15.46:0/3308673546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 msgr2=0x558407ee82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc3522f3640 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ee82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc3522f3640 1 -- 172.21.15.46:0/3308673546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec2f40 msgr2=0x558407ee7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc3522f3640 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec2f40 0x558407ee7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc3522f3640 1 -- 172.21.15.46:0/3308673546 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558407ec0780 con 0x558407ebf5f0 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc351af2640 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec2f40 0x558407ee7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc3522f3640 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ebe640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc348098540 tx=0x7fc34809bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d877f0e5f2f4c304 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc337fff640 1 -- 172.21.15.46:0/3308673546 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34809b6b0 con 0x558407ebf5f0 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc337fff640 1 -- 172.21.15.46:0/3308673546 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc34809afc0 con 0x558407ebf5f0 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.532+0000 7fc337fff640 1 -- 172.21.15.46:0/3308673546 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3480cf0e0 con 0x558407ebf5f0 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 -- 172.21.15.46:0/3308673546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 msgr2=0x558407ebe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ebe640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc348098540 tx=0x7fc34809bcf0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 -- 172.21.15.46:0/3308673546 shutdown_connections 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec3860 0x558407ee82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec2f40 0x558407ee7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 --2- 172.21.15.46:0/3308673546 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ebe640 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 -- 172.21.15.46:0/3308673546 >> 172.21.15.46:0/3308673546 conn(0x558407ec8d70 msgr2=0x558407ebdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 -- 172.21.15.46:0/3308673546 shutdown_connections 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 -- 172.21.15.46:0/3308673546 wait complete. 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 -- start start 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.533+0000 7fc356930740 1 Processor -- start 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ed45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec2f40 0x558407ed4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407f49d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c1ac950 con 0x558407ebf5f0 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c1ac1c0 con 0x558407ec3860 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc34c1a9400 con 0x558407ec2f40 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc356930740 10 client.0 _ll_register_callbacks cb 0x7fc34809c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:06.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ed45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ed45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36720/0 (socket says 172.21.15.46:36720) 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 -- 172.21.15.46:0/1591482537 learned_addr learned my addr 172.21.15.46:0/1591482537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc351af2640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec2f40 0x558407ed4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc352af4640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407f49d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 -- 172.21.15.46:0/1591482537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec2f40 msgr2=0x558407ed4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec2f40 0x558407ed4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 -- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 msgr2=0x558407f49d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407f49d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 -- 172.21.15.46:0/1591482537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558407f4a290 con 0x558407ebf5f0 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc352af4640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407f49d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc3522f3640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ed45a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc3480d1040 tx=0x7fc348098380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c429e33426a411 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc335ffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc335ffb640 1 -- 172.21.15.46:0/1591482537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348020070 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.534+0000 7fc335ffb640 1 -- 172.21.15.46:0/1591482537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fc3480cf2b0 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc34809afc0 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc335ffb640 1 -- 172.21.15.46:0/1591482537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc3480b3030 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 10 client.16602 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x558407f4b490 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc335ffb640 1 -- 172.21.15.46:0/1591482537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc34809afc0 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc335ffb640 1 -- 172.21.15.46:0/1591482537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fc3480a10b0 con 0x558407ebf5f0 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 10 client.16602 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 10 client.16602 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 20 client.16602 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ed0450 0x558407f4d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 4 client.16602 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ba070a16", "release": true, "await": true}] 2024-09-19T09:23:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.535+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ba070a16", "release": true, "await": true}) -- 0x558407e300a0 con 0x558407ed0450 2024-09-19T09:23:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.536+0000 7fc351af2640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ed0450 0x558407f4d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.536+0000 7fc351af2640 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ed0450 0x558407f4d9e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1cdf0ce67f9307 server_cookie=d54859112c811ed3 in_seq=0 out_seq=0 2024-09-19T09:23:06.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.536+0000 7fc335ffb640 10 client.16602 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc335ffb640 1 -- 172.21.15.46:0/1591482537 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558407e300a0 con 0x558407ed0450 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc335ffb640 10 client.16602 handle_command_reply: tid=0 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 client.16602 shutdown 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 msgr2=0x558407ed45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ed45a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fc3480d1040 tx=0x7fc348098380 comp rx=0 tx=0).stop 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 shutdown_connections 2024-09-19T09:23:06.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x558407ed0450 0x558407f4d9e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558407ec3860 0x558407f49d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc335ffb640 0 client.16602 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558407ec2f40 0x558407ed4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 --2- 172.21.15.46:0/1591482537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x558407ebf5f0 0x558407ed45a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 >> 172.21.15.46:0/1591482537 conn(0x558407ec8d70 msgr2=0x558407ebe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 shutdown_connections 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 1 -- 172.21.15.46:0/1591482537 wait complete. 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.626+0000 7fc356930740 20 client.16602 trim_cache size 0 max 16384 2024-09-19T09:23:06.628 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 20, 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ba070a16": { 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 20, 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:23:06.629 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 149.8, 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:06.630 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:23:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3380a32c0 msgr2=0x7fc3380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3380a32c0 0x7fc3380a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc34401d000 tx=0x7fc344019000 comp rx=0 tx=0).stop 2024-09-19T09:23:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 msgr2=0x7fc34c1973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c1973d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d950 tx=0x7fc34800de10 comp rx=0 tx=0).stop 2024-09-19T09:23:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 shutdown_connections 2024-09-19T09:23:06.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fc3380a32c0 0x7fc3380a5780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc34c106a80 0x7fc34c19bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc34c101420 0x7fc34c197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 --2- 172.21.15.46:0/1863292214 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc34c100a80 0x7fc34c1973d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 >> 172.21.15.46:0/1863292214 conn(0x7fc34c0fc7a0 msgr2=0x7fc34c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 shutdown_connections 2024-09-19T09:23:06.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:06.627+0000 7fc354557640 1 -- 172.21.15.46:0/1863292214 wait complete. 2024-09-19T09:23:06.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:06 smithi115 ceph-mon[35055]: pgmap v483: 97 pgs: 97 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:23:06.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:06 smithi099 ceph-mon[35256]: pgmap v483: 97 pgs: 97 active+clean; 50 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T09:23:07.427 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ba070a16', total seconds elapsed: 33.3 2024-09-19T09:23:07.427 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:23:07.427 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:23:07.703 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:07.782 INFO:tasks.workunit.client.0.smithi046.stdout:50000 write 0x5304f4 thru 0x53fa11 (0xf51e bytes) 2024-09-19T09:23:07.782 INFO:tasks.workunit.client.0.smithi046.stdout:All 50000 operations completed A-OK! 2024-09-19T09:23:07.786 INFO:tasks.workunit.client.0.smithi046.stderr:+ ./fsx -z 100MB -N 50000 -p 10000 -l 104857600 2024-09-19T09:23:07.788 INFO:tasks.workunit.client.0.smithi046.stdout:Seed set to 1 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 -- 172.21.15.46:0/3580997646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0106a80 msgr2=0x7f1ac0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/3580997646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0106a80 0x7f1ac0106e60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009930 tx=0x7f1ab002a420 comp rx=0 tx=0).stop 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 -- 172.21.15.46:0/3580997646 shutdown_connections 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/3580997646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac0101420 0x7f1ac010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/3580997646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ac0100a80 0x7f1ac0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/3580997646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0106a80 0x7f1ac0106e60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 -- 172.21.15.46:0/3580997646 >> 172.21.15.46:0/3580997646 conn(0x7f1ac00fc7a0 msgr2=0x7f1ac00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 -- 172.21.15.46:0/3580997646 shutdown_connections 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 -- 172.21.15.46:0/3580997646 wait complete. 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 Processor -- start 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.198+0000 7f1ac5a47640 1 -- start start 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ac5a47640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 0x7f1ac01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ac5a47640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ac0101420 0x7f1ac0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ac5a47640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac0106a80 0x7f1ac019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ac5a47640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0110e40 con 0x7f1ac0100a80 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ac5a47640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0110cc0 con 0x7f1ac0106a80 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ac5a47640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac0110fc0 con 0x7f1ac0101420 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 0x7f1ac01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 0x7f1ac01983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36732/0 (socket says 172.21.15.46:36732) 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 -- 172.21.15.46:0/1758079535 learned_addr learned my addr 172.21.15.46:0/1758079535 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:08.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ac0101420 0x7f1ac0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abf7fe640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac0106a80 0x7f1ac019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 -- 172.21.15.46:0/1758079535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ac0101420 msgr2=0x7f1ac0198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ac0101420 0x7f1ac0198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 -- 172.21.15.46:0/1758079535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac0106a80 msgr2=0x7f1ac019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac0106a80 0x7f1ac019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.199+0000 7f1abeffd640 1 -- 172.21.15.46:0/1758079535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac019d370 con 0x7f1ac0100a80 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.200+0000 7f1abeffd640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 0x7f1ac01983c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009230 tx=0x7f1ab0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.200+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab003f030 con 0x7f1ac0100a80 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.200+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac019d600 con 0x7f1ac0100a80 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.200+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ab0003ad0 con 0x7f1ac0100a80 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.200+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0035070 con 0x7f1ac0100a80 2024-09-19T09:23:08.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.200+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac01a4f40 con 0x7f1ac0100a80 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.201+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac01021c0 con 0x7f1ac0100a80 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.202+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ab0042030 con 0x7f1ac0100a80 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.203+0000 7f1ac4a45640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aac0a3240 0x7f1aac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.203+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aac0a3240 0x7f1aac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.203+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f1ab00f00f0 con 0x7f1ac0100a80 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.204+0000 7f1ab7fff640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aac0a3240 0x7f1aac0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00ff1e0 tx=0x7f1aa800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.206+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ab00bce40 con 0x7f1ac0100a80 2024-09-19T09:23:08.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.417+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ac010a000 con 0x7f1ac0100a80 2024-09-19T09:23:08.418 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:08 smithi046 ceph-mon[31203]: pgmap v484: 97 pgs: 97 active+clean; 52 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:23:08.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.418+0000 7f1ac4a45640 1 -- 172.21.15.46:0/1758079535 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11967 (secure 0 0 0) 0x7f1ab00bc740 con 0x7f1ac0100a80 2024-09-19T09:23:08.419 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:23:08.419 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-19T09:21:29:130184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:21:29.130168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:23:08.419 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-19T09:23:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.420+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aac0a3240 msgr2=0x7f1aac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.420+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aac0a3240 0x7f1aac0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00ff1e0 tx=0x7f1aa800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.420+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 msgr2=0x7f1ac01983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.420+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 0x7f1ac01983c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009230 tx=0x7f1ab0004270 comp rx=0 tx=0).stop 2024-09-19T09:23:08.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.420+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 shutdown_connections 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.420+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f1aac0a3240 0x7f1aac0a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.421+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ac0106a80 0x7f1ac019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.421+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ac0101420 0x7f1ac0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.421+0000 7f1ac5a47640 1 --2- 172.21.15.46:0/1758079535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1ac0100a80 0x7f1ac01983c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.421+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 >> 172.21.15.46:0/1758079535 conn(0x7f1ac00fc7a0 msgr2=0x7f1ac006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.421+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 shutdown_connections 2024-09-19T09:23:08.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:08.421+0000 7f1ac5a47640 1 -- 172.21.15.46:0/1758079535 wait complete. 2024-09-19T09:23:08.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:08 smithi115 ceph-mon[35055]: pgmap v484: 97 pgs: 97 active+clean; 52 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:23:08.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:08 smithi099 ceph-mon[35256]: pgmap v484: 97 pgs: 97 active+clean; 52 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:23:08.994 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode 0, disabling! 2024-09-19T09:23:08.994 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_KEEP_SIZE, disabling! 2024-09-19T09:23:08.997 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_COLLAPSE_RANGE, disabling! 2024-09-19T09:23:08.997 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support fallocate mode FALLOC_FL_INSERT_RANGE, disabling! 2024-09-19T09:23:08.997 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support clone range, disabling! 2024-09-19T09:23:09.002 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support dedupe range, disabling! 2024-09-19T09:23:09.005 INFO:tasks.workunit.client.0.smithi046.stderr:main: filesystem does not support exchange range, disabling! 2024-09-19T09:23:09.005 INFO:tasks.workunit.client.0.smithi046.stdout:skipping zero size read 2024-09-19T09:23:09.017 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x1c37b90 2024-09-19T09:23:09.024 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x5bd330d 2024-09-19T09:23:09.040 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x637bf99 2024-09-19T09:23:09.142 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:23:09.142 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:23:09.219 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x63d9b9c 2024-09-19T09:23:09.446 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:09.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:09 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1758079535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:09.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:09 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1758079535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:09.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:09 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1758079535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 -- 172.21.15.46:0/1906673936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094100e20 msgr2=0x7fd094101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 --2- 172.21.15.46:0/1906673936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094100e20 0x7fd094101200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd090009930 tx=0x7fd09002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 -- 172.21.15.46:0/1906673936 shutdown_connections 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 --2- 172.21.15.46:0/1906673936 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 0x7fd0941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 --2- 172.21.15.46:0/1906673936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094102ef0 0x7fd09410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 --2- 172.21.15.46:0/1906673936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094100e20 0x7fd094101200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 -- 172.21.15.46:0/1906673936 >> 172.21.15.46:0/1906673936 conn(0x7fd0940fc7d0 msgr2=0x7fd0940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 -- 172.21.15.46:0/1906673936 shutdown_connections 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.093+0000 7fd09c50a640 1 -- 172.21.15.46:0/1906673936 wait complete. 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.094+0000 7fd09c50a640 1 Processor -- start 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.094+0000 7fd09c50a640 1 -- start start 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09c50a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 0x7fd09419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09c50a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 0x7fd09419e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09c50a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094102ef0 0x7fd094196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09c50a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd094110f50 con 0x7fd094102570 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09c50a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd094110dd0 con 0x7fd094102ef0 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09c50a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941110d0 con 0x7fd094100e20 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 0x7fd09419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd099aa5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 0x7fd09419e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 0x7fd09419e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:51160/0 (socket says 172.21.15.46:51160) 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 -- 172.21.15.46:0/712757819 learned_addr learned my addr 172.21.15.46:0/712757819 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094102ef0 0x7fd094196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 -- 172.21.15.46:0/712757819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094102ef0 msgr2=0x7fd094196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094102ef0 0x7fd094196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 -- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 msgr2=0x7fd09419e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 0x7fd09419e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd09a2a6640 1 -- 172.21.15.46:0/712757819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd094196d40 con 0x7fd094100e20 2024-09-19T09:23:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.095+0000 7fd099aa5640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 0x7fd09419e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.096+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 0x7fd09419e130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd090009230 tx=0x7fd090004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.096+0000 7fd0877fe640 1 -- 172.21.15.46:0/712757819 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09003f030 con 0x7fd094100e20 2024-09-19T09:23:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.096+0000 7fd0877fe640 1 -- 172.21.15.46:0/712757819 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd090004440 con 0x7fd094100e20 2024-09-19T09:23:10.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.096+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd094196fd0 con 0x7fd094100e20 2024-09-19T09:23:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.096+0000 7fd0877fe640 1 -- 172.21.15.46:0/712757819 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090035070 con 0x7fd094100e20 2024-09-19T09:23:10.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.096+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0941b3e10 con 0x7fd094100e20 2024-09-19T09:23:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.099+0000 7fd0877fe640 1 -- 172.21.15.46:0/712757819 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd090042030 con 0x7fd094100e20 2024-09-19T09:23:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.099+0000 7fd09e8e3740 1 Processor -- start 2024-09-19T09:23:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 -- start start 2024-09-19T09:23:10.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49d2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49dfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f8d49382a0 con 0x55f8d49d2760 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f8d48dfb10 con 0x55f8d49dd940 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f8d4934260 con 0x55f8d49d3080 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49d2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49d2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40646/0 (socket says 172.21.15.46:40646) 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd0877fe640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0800a32c0 0x7fd0800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 -- 172.21.15.46:0/3912416568 learned_addr learned my addr 172.21.15.46:0/3912416568 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd099aa5640 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49dfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 -- 172.21.15.46:0/3912416568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 msgr2=0x55f8d49dd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 -- 172.21.15.46:0/3912416568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 msgr2=0x55f8d49dfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49dfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 -- 172.21.15.46:0/3912416568 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d46a9b90 con 0x55f8d49d2760 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd0877fe640 1 -- 172.21.15.46:0/712757819 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd0900efb30 con 0x7fd094100e20 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd099aa5640 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49dfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.100+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0800a32c0 0x7fd0800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.101+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49d2b40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd08c011590 tx=0x7fd08c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f3d42be81145b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.101+0000 7fd084ff9640 1 -- 172.21.15.46:0/3912416568 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c017050 con 0x55f8d49d2760 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.101+0000 7fd084ff9640 1 -- 172.21.15.46:0/3912416568 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd08c00fd20 con 0x55f8d49d2760 2024-09-19T09:23:10.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.101+0000 7fd084ff9640 1 -- 172.21.15.46:0/3912416568 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c01ba90 con 0x55f8d49d2760 2024-09-19T09:23:10.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 -- 172.21.15.46:0/3912416568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 msgr2=0x55f8d49d2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0800a32c0 0x7fd0800a5780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd08c022000 tx=0x7fd08c023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49d2b40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd08c011590 tx=0x7fd08c011a50 comp rx=0 tx=0).stop 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 -- 172.21.15.46:0/3912416568 shutdown_connections 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49dfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/3912416568 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49d2b40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 -- 172.21.15.46:0/3912416568 >> 172.21.15.46:0/3912416568 conn(0x55f8d49cecf0 msgr2=0x55f8d49cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 -- 172.21.15.46:0/3912416568 shutdown_connections 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 -- 172.21.15.46:0/3912416568 wait complete. 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 -- start start 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 Processor -- start 2024-09-19T09:23:10.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49da850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.102+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49db2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55f8d49e0510 con 0x55f8d49d2760 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55f8d48c06e0 con 0x55f8d49dd940 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f8d49e0690 con 0x55f8d49d3080 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09e8e3740 10 client.0 _ll_register_callbacks cb 0x55f8d48e4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09a2a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49da850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49db2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49db2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:56026/0 (socket says 172.21.15.46:56026) 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 -- 172.21.15.46:0/864157820 learned_addr learned my addr 172.21.15.46:0/864157820 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd099aa5640 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 -- 172.21.15.46:0/864157820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 msgr2=0x55f8d49dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 -- 172.21.15.46:0/864157820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 msgr2=0x55f8d49da850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49da850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 -- 172.21.15.46:0/864157820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d49e9a30 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49db2d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd08c011f50 tx=0x7fd08c00fbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156659878f668f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd07dffb640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.103+0000 7fd07dffb640 1 -- 172.21.15.46:0/864157820 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c01ba90 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd08c00fd20 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd07dffb640 1 -- 172.21.15.46:0/864157820 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd08c01bdc0 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd07dffb640 1 -- 172.21.15.46:0/864157820 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd08c0049e0 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 10 client.26108 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f8d49ec410 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd07dffb640 1 -- 172.21.15.46:0/864157820 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd08c00fd20 con 0x55f8d49dd940 2024-09-19T09:23:10.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd07dffb640 1 -- 172.21.15.46:0/864157820 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fd08c01a070 con 0x55f8d49dd940 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 10 client.26108 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 10 client.26108 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 20 client.26108 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d49edd60 0x55f8d49f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 4 client.26108 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8d49459d0 con 0x55f8d49edd60 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.104+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d49edd60 0x55f8d49f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.105+0000 7fd07dffb640 10 client.26108 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.105+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d49edd60 0x55f8d49f01c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bed85841dfdd14a server_cookie=e66c724f99db77f9 in_seq=0 out_seq=0 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.105+0000 7fd07dffb640 1 -- 172.21.15.46:0/864157820 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8d49459d0 con 0x55f8d49edd60 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.105+0000 7fd07dffb640 10 client.26108 handle_command_reply: tid=0 2024-09-19T09:23:10.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.105+0000 7fd09e8e3740 1 client.26108 shutdown 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 msgr2=0x55f8d49db2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49db2d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd08c011f50 tx=0x7fd08c00fbe0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 shutdown_connections 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d49edd60 0x55f8d49f01c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49dd940 0x55f8d49db2d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd07dffb640 0 client.26108 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/864157820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49da850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 >> 172.21.15.46:0/864157820 conn(0x55f8d49cecf0 msgr2=0x55f8d49cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 shutdown_connections 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 1 -- 172.21.15.46:0/864157820 wait complete. 2024-09-19T09:23:10.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.106+0000 7fd09e8e3740 20 client.26108 trim_cache size 0 max 16384 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.124+0000 7fd09e8e3740 1 Processor -- start 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.124+0000 7fd09e8e3740 1 -- start start 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d2760 0x55f8d49d51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 0x55f8d49f6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941bc270 con 0x55f8d49dd940 2024-09-19T09:23:10.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941bde70 con 0x55f8d49d2760 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941bc940 con 0x55f8d49d3080 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 0x55f8d49f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd099aa5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 0x55f8d49f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40660/0 (socket says 172.21.15.46:40660) 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 -- 172.21.15.46:0/4275170240 learned_addr learned my addr 172.21.15.46:0/4275170240 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d2760 0x55f8d49d51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 -- 172.21.15.46:0/4275170240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 msgr2=0x55f8d49f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 -- 172.21.15.46:0/4275170240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d2760 msgr2=0x55f8d49d51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d2760 0x55f8d49d51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 -- 172.21.15.46:0/4275170240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8d49ca260 con 0x55f8d49dd940 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.125+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 0x55f8d49f6010 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd08c005c10 tx=0x7fd08c0114f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e134b3291103cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:10.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.126+0000 7fd07ffff640 1 -- 172.21.15.46:0/4275170240 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c017040 con 0x55f8d49dd940 2024-09-19T09:23:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.126+0000 7fd07ffff640 1 -- 172.21.15.46:0/4275170240 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd08c005930 con 0x55f8d49dd940 2024-09-19T09:23:10.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.126+0000 7fd07ffff640 1 -- 172.21.15.46:0/4275170240 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c01b430 con 0x55f8d49dd940 2024-09-19T09:23:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.126+0000 7fd09e8e3740 1 -- 172.21.15.46:0/4275170240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 msgr2=0x55f8d49f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.126+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 0x55f8d49f6010 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd08c005c10 tx=0x7fd08c0114f0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- 172.21.15.46:0/4275170240 shutdown_connections 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49dd940 0x55f8d49f6010 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49d3080 0x55f8d49f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/4275170240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d2760 0x55f8d49d51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- 172.21.15.46:0/4275170240 >> 172.21.15.46:0/4275170240 conn(0x55f8d49cecf0 msgr2=0x55f8d49dc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- 172.21.15.46:0/4275170240 shutdown_connections 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- 172.21.15.46:0/4275170240 wait complete. 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- start start 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 Processor -- start 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 0x55f8d49e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49dd940 0x55f8d49e1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941bd7a0 con 0x55f8d49d2760 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941bd010 con 0x55f8d49d3080 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd0941ba250 con 0x55f8d49dd940 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09e8e3740 10 client.0 _ll_register_callbacks cb 0x7fd08c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd09a2a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd099aa5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 0x55f8d49e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd099aa5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 0x55f8d49e10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:56046/0 (socket says 172.21.15.46:56046) 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.127+0000 7fd099aa5640 1 -- 172.21.15.46:0/643681802 learned_addr learned my addr 172.21.15.46:0/643681802 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49dd940 0x55f8d49e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 -- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 msgr2=0x55f8d49e10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 0x55f8d49e10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 -- 172.21.15.46:0/643681802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 msgr2=0x55f8d49e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 -- 172.21.15.46:0/643681802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8d49e1b80 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd099aa5640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 0x55f8d49e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09aaa7640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49dd940 0x55f8d49e1610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0264e0 tx=0x7fd08c01b670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590fc7f7d1e517a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd07dffb640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd07dffb640 1 -- 172.21.15.46:0/643681802 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd08c03f070 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd07dffb640 1 -- 172.21.15.46:0/643681802 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd08c01bdc0 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.128+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd08c005930 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd07dffb640 1 -- 172.21.15.46:0/643681802 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd08c017040 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 10 client.26035 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f8d4a587e0 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd07dffb640 1 -- 172.21.15.46:0/643681802 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd08c005930 con 0x55f8d49dd940 2024-09-19T09:23:10.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd07dffb640 1 -- 172.21.15.46:0/643681802 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fd08c01a070 con 0x55f8d49dd940 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 10 client.26035 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 10 client.26035 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 20 client.26035 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d4a58f80 0x55f8d4a5b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 4 client.26035 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55f8d493fd20 con 0x55f8d4a58f80 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.129+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d4a58f80 0x55f8d4a5b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.130+0000 7fd07dffb640 10 client.26035 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:10.134 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.130+0000 7fd09a2a6640 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d4a58f80 0x55f8d4a5b3a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9cc7c8d98dc1af2 server_cookie=b9d4eebf2dbbcdaa in_seq=0 out_seq=0 2024-09-19T09:23:10.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:10 smithi046 ceph-mon[31203]: pgmap v485: 97 pgs: 97 active+clean; 52 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-19T09:23:10.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:10 smithi115 ceph-mon[35055]: pgmap v485: 97 pgs: 97 active+clean; 52 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-19T09:23:10.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:10 smithi099 ceph-mon[35256]: pgmap v485: 97 pgs: 97 active+clean; 52 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd07dffb640 1 -- 172.21.15.46:0/643681802 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f8d493fd20 con 0x55f8d4a58f80 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd07dffb640 10 client.26035 handle_command_reply: tid=0 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 client.26035 shutdown 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49dd940 msgr2=0x55f8d49e1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49dd940 0x55f8d49e1610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0264e0 tx=0x7fd08c01b670 comp rx=0 tx=0).stop 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 shutdown_connections 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55f8d4a58f80 0x55f8d4a5b3a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f8d49dd940 0x55f8d49e1610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f8d49d3080 0x55f8d49e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd07dffb640 0 client.26035 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 --2- 172.21.15.46:0/643681802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55f8d49d2760 0x55f8d49e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 >> 172.21.15.46:0/643681802 conn(0x55f8d49cecf0 msgr2=0x55f8d49cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 shutdown_connections 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 1 -- 172.21.15.46:0/643681802 wait complete. 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.778+0000 7fd09e8e3740 20 client.26035 trim_cache size 0 max 16384 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:23:10.780 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 22, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "438e598c": { 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 22, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 149.8, 2024-09-19T09:23:10.781 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "QUIESCED", 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:10.782 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0800a32c0 msgr2=0x7fd0800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0800a32c0 0x7fd0800a5780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd08c022000 tx=0x7fd08c023000 comp rx=0 tx=0).stop 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 msgr2=0x7fd09419e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 0x7fd09419e130 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd090009230 tx=0x7fd090004040 comp rx=0 tx=0).stop 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 shutdown_connections 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd0800a32c0 0x7fd0800a5780 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd094102570 0x7fd09419e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd094102ef0 0x7fd094196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 --2- 172.21.15.46:0/712757819 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd094100e20 0x7fd09419e130 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 >> 172.21.15.46:0/712757819 conn(0x7fd0940fc7d0 msgr2=0x7fd094069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 shutdown_connections 2024-09-19T09:23:10.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:10.779+0000 7fd09c50a640 1 -- 172.21.15.46:0/712757819 wait complete. 2024-09-19T09:23:11.548 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '438e598c', quiesce took 4.1 seconds. Will release after: 25.700000000000003 2024-09-19T09:23:12.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:12 smithi115 ceph-mon[35055]: pgmap v486: 97 pgs: 97 active+clean; 57 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 299 KiB/s wr, 92 op/s 2024-09-19T09:23:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:12 smithi046 ceph-mon[31203]: pgmap v486: 97 pgs: 97 active+clean; 57 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 299 KiB/s wr, 92 op/s 2024-09-19T09:23:12.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:12 smithi099 ceph-mon[35256]: pgmap v486: 97 pgs: 97 active+clean; 57 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 299 KiB/s wr, 92 op/s 2024-09-19T09:23:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 -- 172.21.15.46:0/222420616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84102610 msgr2=0x7fde84108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 --2- 172.21.15.46:0/222420616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84102610 0x7fde84108ea0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009ca0 tx=0x7fde7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 -- 172.21.15.46:0/222420616 shutdown_connections 2024-09-19T09:23:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 --2- 172.21.15.46:0/222420616 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84102610 0x7fde84108ea0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 --2- 172.21.15.46:0/222420616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde84101c50 0x7fde841020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 --2- 172.21.15.46:0/222420616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84100a60 0x7fde84100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 -- 172.21.15.46:0/222420616 >> 172.21.15.46:0/222420616 conn(0x7fde840fc1e0 msgr2=0x7fde840fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 -- 172.21.15.46:0/222420616 shutdown_connections 2024-09-19T09:23:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.930+0000 7fde8c650640 1 -- 172.21.15.46:0/222420616 wait complete. 2024-09-19T09:23:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 Processor -- start 2024-09-19T09:23:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 -- start start 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 0x7fde8406ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde84101c50 0x7fde8419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84102610 0x7fde8419f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde8410c6e0 con 0x7fde84100a60 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fde8410c560 con 0x7fde84101c50 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8c650640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fde8410c860 con 0x7fde84102610 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 0x7fde8406ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 0x7fde8406ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40686/0 (socket says 172.21.15.46:40686) 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 -- 172.21.15.46:0/3563630018 learned_addr learned my addr 172.21.15.46:0/3563630018 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde89beb640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde84101c50 0x7fde8419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8abed640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84102610 0x7fde8419f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 -- 172.21.15.46:0/3563630018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84102610 msgr2=0x7fde8419f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84102610 0x7fde8419f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 -- 172.21.15.46:0/3563630018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde84101c50 msgr2=0x7fde8419cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde84101c50 0x7fde8419cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8a3ec640 1 -- 172.21.15.46:0/3563630018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8419f9f0 con 0x7fde84100a60 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.931+0000 7fde8abed640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84102610 0x7fde8419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.932+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 0x7fde8406ae70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fde8000e9c0 tx=0x7fde8000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.932+0000 7fde7b7fe640 1 -- 172.21.15.46:0/3563630018 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8000cd80 con 0x7fde84100a60 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.932+0000 7fde7b7fe640 1 -- 172.21.15.46:0/3563630018 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde800035f0 con 0x7fde84100a60 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.932+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8419fc80 con 0x7fde84100a60 2024-09-19T09:23:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.932+0000 7fde7b7fe640 1 -- 172.21.15.46:0/3563630018 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde80010690 con 0x7fde84100a60 2024-09-19T09:23:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.932+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde841a01d0 con 0x7fde84100a60 2024-09-19T09:23:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.934+0000 7fde7b7fe640 1 -- 172.21.15.46:0/3563630018 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fde800037a0 con 0x7fde84100a60 2024-09-19T09:23:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 Processor -- start 2024-09-19T09:23:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 -- start start 2024-09-19T09:23:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ff0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff12e0 0x564354ff5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564354ff8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564354f542f0 con 0x564354ff09a0 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564354efc270 con 0x564354ff12e0 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.935+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564354f502b0 con 0x564354ff6370 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ff0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ff0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40688/0 (socket says 172.21.15.46:40688) 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 -- 172.21.15.46:0/804054400 learned_addr learned my addr 172.21.15.46:0/804054400 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde89beb640 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564354ff8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde7b7fe640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde700a3370 0x7fde700a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff12e0 0x564354ff5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde700a3370 0x7fde700a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde7b7fe640 1 -- 172.21.15.46:0/3563630018 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fde800cfcf0 con 0x7fde84100a60 2024-09-19T09:23:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 -- 172.21.15.46:0/804054400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 msgr2=0x564354ff8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564354ff8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 -- 172.21.15.46:0/804054400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff12e0 msgr2=0x564354ff5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff12e0 0x564354ff5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 -- 172.21.15.46:0/804054400 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564354efb340 con 0x564354ff09a0 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff12e0 0x564354ff5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.936+0000 7fde8abed640 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ff0da0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006010 tx=0x7fde7c031e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d03fa5fcc46d559 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde78bfe640 1 -- 172.21.15.46:0/804054400 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c004d40 con 0x564354ff09a0 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde78bfe640 1 -- 172.21.15.46:0/804054400 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde7c04e070 con 0x564354ff09a0 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8abed640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde700a3370 0x7fde700a5830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fde7c04d000 tx=0x7fde7c04b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde78bfe640 1 -- 172.21.15.46:0/804054400 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c02f8a0 con 0x564354ff09a0 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 -- 172.21.15.46:0/804054400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 msgr2=0x564354ff0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ff0da0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fde7c006010 tx=0x7fde7c031e90 comp rx=0 tx=0).stop 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 -- 172.21.15.46:0/804054400 shutdown_connections 2024-09-19T09:23:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564354ff8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff12e0 0x564354ff5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/804054400 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ff0da0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.937+0000 7fde8f3e2740 1 -- 172.21.15.46:0/804054400 >> 172.21.15.46:0/804054400 conn(0x564354fec010 msgr2=0x564354fec410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 -- 172.21.15.46:0/804054400 shutdown_connections 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 -- 172.21.15.46:0/804054400 wait complete. 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 -- start start 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 Processor -- start 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ffaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564354ffafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff6370 0x564355002000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x564354ff91c0 con 0x564354ff09a0 2024-09-19T09:23:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x564354edd290 con 0x564354ff6370 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564354ff9340 con 0x564354ff12e0 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8f3e2740 10 client.0 _ll_register_callbacks cb 0x564354f0e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8a3ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ffaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8a3ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ffaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40702/0 (socket says 172.21.15.46:40702) 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.938+0000 7fde8a3ec640 1 -- 172.21.15.46:0/994550101 learned_addr learned my addr 172.21.15.46:0/994550101 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8abed640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff6370 0x564355002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8a3ec640 1 -- 172.21.15.46:0/994550101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 msgr2=0x564354ffafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde89beb640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564354ffafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564354ffafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8a3ec640 1 -- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff6370 msgr2=0x564355002000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff6370 0x564355002000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.945 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8a3ec640 1 -- 172.21.15.46:0/994550101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564354c67210 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8abed640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff6370 0x564355002000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ffaa80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fde800cd7c0 tx=0x7fde8009bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742f13cbacbe9abe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde6dffb640 1 -- 172.21.15.46:0/994550101 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde800cc020 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde6dffb640 1 -- 172.21.15.46:0/994550101 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fde800a4ac0 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde7c04e070 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde6dffb640 1 -- 172.21.15.46:0/994550101 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde800a0690 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8f3e2740 10 client.16638 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564354d33620 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.939+0000 7fde6dffb640 1 -- 172.21.15.46:0/994550101 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde7c04e070 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde6dffb640 1 -- 172.21.15.46:0/994550101 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fde800cd250 con 0x564354ff09a0 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde8f3e2740 10 client.16638 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde8f3e2740 10 client.16638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde8f3e2740 20 client.16638 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550067a0 0x564355008c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde8f3e2740 4 client.16638 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564354f61a20 con 0x5643550067a0 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.940+0000 7fde89beb640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550067a0 0x564355008c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde89beb640 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550067a0 0x564355008c30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1249fe61268f7f73 server_cookie=60149a26d0d7ed6d in_seq=0 out_seq=0 2024-09-19T09:23:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde6dffb640 10 client.16638 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde6dffb640 1 -- 172.21.15.46:0/994550101 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564354f61a20 con 0x5643550067a0 2024-09-19T09:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde6dffb640 10 client.16638 handle_command_reply: tid=0 2024-09-19T09:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde8f3e2740 1 client.16638 shutdown 2024-09-19T09:23:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 msgr2=0x564354ffaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ffaa80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fde800cd7c0 tx=0x7fde8009bd00 comp rx=0 tx=0).stop 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 shutdown_connections 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.941+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550067a0 0x564355008c30 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff6370 0x564355002000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564354ffafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde6dffb640 0 client.16638 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/994550101 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff09a0 0x564354ffaa80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 >> 172.21.15.46:0/994550101 conn(0x564354fec010 msgr2=0x564354fed820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 shutdown_connections 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 1 -- 172.21.15.46:0/994550101 wait complete. 2024-09-19T09:23:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.942+0000 7fde8f3e2740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 Processor -- start 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 -- start start 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354ffb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564355001f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 0x564354feb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde841a8da0 con 0x564354ff6370 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fde841aa9a0 con 0x564354ff09a0 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.956+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fde841a9470 con 0x564354ff12e0 2024-09-19T09:23:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 0x564354feb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 0x564354feb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40718/0 (socket says 172.21.15.46:40718) 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 -- 172.21.15.46:0/1609759146 learned_addr learned my addr 172.21.15.46:0/1609759146 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde89beb640 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564355001f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354ffb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 -- 172.21.15.46:0/1609759146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 msgr2=0x564355001f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564355001f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 -- 172.21.15.46:0/1609759146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 msgr2=0x564354ffb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354ffb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 -- 172.21.15.46:0/1609759146 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643550092b0 con 0x564354ff6370 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354ffb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde8abed640 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 0x564354feb0b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fde7c004af0 tx=0x7fde7c03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757c0f24f19e1073 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:13.962 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde6ffff640 1 -- 172.21.15.46:0/1609759146 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c02f680 con 0x564354ff6370 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde6ffff640 1 -- 172.21.15.46:0/1609759146 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde7c04e040 con 0x564354ff6370 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.957+0000 7fde6ffff640 1 -- 172.21.15.46:0/1609759146 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7c004120 con 0x564354ff6370 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1609759146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 msgr2=0x564354feb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 0x564354feb0b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fde7c004af0 tx=0x7fde7c03b000 comp rx=0 tx=0).stop 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1609759146 shutdown_connections 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff6370 0x564354feb0b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff12e0 0x564355001f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1609759146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354ffb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1609759146 >> 172.21.15.46:0/1609759146 conn(0x564354fec010 msgr2=0x564354fea9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1609759146 shutdown_connections 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1609759146 wait complete. 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- start start 2024-09-19T09:23:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 Processor -- start 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354fff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 0x564354fffe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564355000d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde841aa2d0 con 0x564354ff12e0 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fde841a9b40 con 0x564354ff09a0 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.958+0000 7fde8f3e2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fde841a6d80 con 0x564354ff6370 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde8f3e2740 10 client.0 _ll_register_callbacks cb 0x7fde80096c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 0x564354fffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 0x564354fffe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40720/0 (socket says 172.21.15.46:40720) 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 -- 172.21.15.46:0/1414162847 learned_addr learned my addr 172.21.15.46:0/1414162847 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde8abed640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564355000d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354fff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.964 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 -- 172.21.15.46:0/1414162847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 msgr2=0x564355000d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564355000d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 -- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 msgr2=0x564354fff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354fff8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 -- 172.21.15.46:0/1414162847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564355001360 con 0x564354ff12e0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde89beb640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 0x564354fffe00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fde74004700 tx=0x7fde7400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf80b6163878335 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde6dffb640 1 -- 172.21.15.46:0/1414162847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7401d410 con 0x564354ff12e0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde6dffb640 1 -- 172.21.15.46:0/1414162847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fde7401d5b0 con 0x564354ff12e0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde7c04e040 con 0x564354ff12e0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde6dffb640 1 -- 172.21.15.46:0/1414162847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde7402d070 con 0x564354ff12e0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde8f3e2740 10 client.16644 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.959+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564355071640 con 0x564354ff12e0 2024-09-19T09:23:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde6dffb640 1 -- 172.21.15.46:0/1414162847 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde7c04e040 con 0x564354ff12e0 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde6dffb640 1 -- 172.21.15.46:0/1414162847 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fde74026b30 con 0x564354ff12e0 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8f3e2740 10 client.16644 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8f3e2740 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8f3e2740 20 client.16644 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550720b0 0x5643550744d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8f3e2740 4 client.16644 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564354f5bd70 con 0x5643550720b0 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550720b0 0x5643550744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde8a3ec640 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550720b0 0x5643550744d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d4238aad8244218 server_cookie=64f28b904b88b76a in_seq=0 out_seq=0 2024-09-19T09:23:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.960+0000 7fde6dffb640 10 client.16644 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde6dffb640 1 -- 172.21.15.46:0/1414162847 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564354f5bd70 con 0x5643550720b0 2024-09-19T09:23:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde6dffb640 10 client.16644 handle_command_reply: tid=0 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 client.16644 shutdown 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 msgr2=0x564354fffe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 0x564354fffe00 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fde74004700 tx=0x7fde7400be10 comp rx=0 tx=0).stop 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 shutdown_connections 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5643550720b0 0x5643550744d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x564354ff12e0 0x564354fffe00 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564354ff6370 0x564355000d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde6dffb640 0 client.16644 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 --2- 172.21.15.46:0/1414162847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564354ff09a0 0x564354fff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 >> 172.21.15.46:0/1414162847 conn(0x564354fec010 msgr2=0x564354feb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 shutdown_connections 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.971+0000 7fde8f3e2740 1 -- 172.21.15.46:0/1414162847 wait complete. 2024-09-19T09:23:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8f3e2740 20 client.16644 trim_cache size 0 max 16384 2024-09-19T09:23:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:23:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:23:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:23:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde700a3370 msgr2=0x7fde700a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde700a3370 0x7fde700a5830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fde7c04d000 tx=0x7fde7c04b000 comp rx=0 tx=0).stop 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 msgr2=0x7fde8406ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 0x7fde8406ae70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fde8000e9c0 tx=0x7fde8000ee80 comp rx=0 tx=0).stop 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 shutdown_connections 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fde700a3370 0x7fde700a5830 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde84102610 0x7fde8419f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde84101c50 0x7fde8419cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 --2- 172.21.15.46:0/3563630018 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde84100a60 0x7fde8406ae70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 >> 172.21.15.46:0/3563630018 conn(0x7fde840fc1e0 msgr2=0x7fde84104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 shutdown_connections 2024-09-19T09:23:13.976 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:13.972+0000 7fde8c650640 1 -- 172.21.15.46:0/3563630018 wait complete. 2024-09-19T09:23:14.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:14 smithi115 ceph-mon[35055]: pgmap v487: 97 pgs: 97 active+clean; 59 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T09:23:14.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:14 smithi046 ceph-mon[31203]: pgmap v487: 97 pgs: 97 active+clean; 59 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T09:23:14.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:14 smithi099 ceph-mon[35256]: pgmap v487: 97 pgs: 97 active+clean; 59 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T09:23:16.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:16 smithi115 ceph-mon[35055]: pgmap v488: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 707 KiB/s wr, 207 op/s 2024-09-19T09:23:16.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:16 smithi046 ceph-mon[31203]: pgmap v488: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 707 KiB/s wr, 207 op/s 2024-09-19T09:23:16.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:16 smithi099 ceph-mon[35256]: pgmap v488: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 707 KiB/s wr, 207 op/s 2024-09-19T09:23:18.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:18 smithi115 ceph-mon[35055]: pgmap v489: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 211 op/s 2024-09-19T09:23:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:18 smithi046 ceph-mon[31203]: pgmap v489: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 211 op/s 2024-09-19T09:23:18.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:18 smithi099 ceph-mon[35256]: pgmap v489: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 211 op/s 2024-09-19T09:23:20.711 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:20 smithi115 ceph-mon[35055]: pgmap v490: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 208 op/s 2024-09-19T09:23:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:20 smithi046 ceph-mon[31203]: pgmap v490: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 208 op/s 2024-09-19T09:23:20.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:20 smithi099 ceph-mon[35256]: pgmap v490: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 208 op/s 2024-09-19T09:23:22.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:22 smithi115 ceph-mon[35055]: pgmap v491: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 210 op/s 2024-09-19T09:23:22.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:22 smithi046 ceph-mon[31203]: pgmap v491: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 210 op/s 2024-09-19T09:23:22.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:22 smithi099 ceph-mon[35256]: pgmap v491: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 710 KiB/s wr, 210 op/s 2024-09-19T09:23:24.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:24 smithi115 ceph-mon[35055]: pgmap v492: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 414 KiB/s wr, 131 op/s 2024-09-19T09:23:24.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:24 smithi046 ceph-mon[31203]: pgmap v492: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 414 KiB/s wr, 131 op/s 2024-09-19T09:23:24.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:24 smithi099 ceph-mon[35256]: pgmap v492: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 414 KiB/s wr, 131 op/s 2024-09-19T09:23:26.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:26 smithi115 ceph-mon[35055]: pgmap v493: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 105 KiB/s wr, 59 op/s 2024-09-19T09:23:26.733 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:26 smithi046 ceph-mon[31203]: pgmap v493: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 105 KiB/s wr, 59 op/s 2024-09-19T09:23:26.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:26 smithi099 ceph-mon[35256]: pgmap v493: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 105 KiB/s wr, 59 op/s 2024-09-19T09:23:27.075 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 -- 172.21.15.46:0/2926082999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8102670 msgr2=0x7fabc8104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 --2- 172.21.15.46:0/2926082999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8102670 0x7fabc8104a60 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fabc4009900 tx=0x7fabc402a410 comp rx=0 tx=0).stop 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 -- 172.21.15.46:0/2926082999 shutdown_connections 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 --2- 172.21.15.46:0/2926082999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabc81078d0 0x7fabc8109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 --2- 172.21.15.46:0/2926082999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc8104fa0 0x7fabc8107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 --2- 172.21.15.46:0/2926082999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8102670 0x7fabc8104a60 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 -- 172.21.15.46:0/2926082999 >> 172.21.15.46:0/2926082999 conn(0x7fabc80fc1f0 msgr2=0x7fabc80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 -- 172.21.15.46:0/2926082999 shutdown_connections 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.074+0000 7fabcf842640 1 -- 172.21.15.46:0/2926082999 wait complete. 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 Processor -- start 2024-09-19T09:23:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 -- start start 2024-09-19T09:23:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabc8102670 0x7fabc819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 0x7fabc819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc81078d0 0x7fabc81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fabc8101110 con 0x7fabc8104fa0 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fabc8100f90 con 0x7fabc8102670 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabcf842640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fabc8101290 con 0x7fabc81078d0 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabccddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 0x7fabc819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabccddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 0x7fabc819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44214/0 (socket says 172.21.15.46:44214) 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.075+0000 7fabccddd640 1 -- 172.21.15.46:0/298755639 learned_addr learned my addr 172.21.15.46:0/298755639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabcd5de640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabc8102670 0x7fabc819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabcdddf640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc81078d0 0x7fabc81a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabccddd640 1 -- 172.21.15.46:0/298755639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc81078d0 msgr2=0x7fabc81a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabccddd640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc81078d0 0x7fabc81a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabccddd640 1 -- 172.21.15.46:0/298755639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabc8102670 msgr2=0x7fabc819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabccddd640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabc8102670 0x7fabc819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabccddd640 1 -- 172.21.15.46:0/298755639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc81a1c70 con 0x7fabc8104fa0 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabccddd640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 0x7fabc819a590 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fabb800d740 tx=0x7fabb800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabbe7fc640 1 -- 172.21.15.46:0/298755639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8017070 con 0x7fabc8104fa0 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabbe7fc640 1 -- 172.21.15.46:0/298755639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb800de50 con 0x7fabc8104fa0 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc81a1f60 con 0x7fabc8104fa0 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabbe7fc640 1 -- 172.21.15.46:0/298755639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8004e00 con 0x7fabc8104fa0 2024-09-19T09:23:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.076+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc81a23d0 con 0x7fabc8104fa0 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.079+0000 7fabbe7fc640 1 -- 172.21.15.46:0/298755639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fabb8004fa0 con 0x7fabc8104fa0 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 Processor -- start 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 -- start start 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 0x56297b822da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b827da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b82a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56297b7862f0 con 0x56297b828370 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56297b72e270 con 0x56297b8229a0 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabd25d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56297b7822b0 con 0x56297b8232e0 2024-09-19T09:23:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabbe7fc640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fabb40a32f0 0x7fabb40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabccddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b82a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabcdddf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 0x56297b822da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabccddd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b82a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44228/0 (socket says 172.21.15.46:44228) 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabcdddf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 0x56297b822da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:50344/0 (socket says 172.21.15.46:50344) 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabccddd640 1 -- 172.21.15.46:0/1748274327 learned_addr learned my addr 172.21.15.46:0/1748274327 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b827da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabcdddf640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fabb40a32f0 0x7fabb40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.080+0000 7fabbe7fc640 1 -- 172.21.15.46:0/298755639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fabb80cf260 con 0x7fabc8104fa0 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabccddd640 1 -- 172.21.15.46:0/1748274327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 msgr2=0x56297b827da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabccddd640 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b827da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabccddd640 1 -- 172.21.15.46:0/1748274327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 msgr2=0x56297b822da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabccddd640 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 0x56297b822da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabccddd640 1 -- 172.21.15.46:0/1748274327 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56297b72d340 con 0x56297b828370 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabcdddf640 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 0x56297b822da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabccddd640 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b82a830 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fabb80a3f90 tx=0x7fabb806e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd18095875f73d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabcdddf640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fabb40a32f0 0x7fabb40a57b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009990 tx=0x7fabc00096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabb37fe640 1 -- 172.21.15.46:0/1748274327 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8020070 con 0x56297b828370 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabb37fe640 1 -- 172.21.15.46:0/1748274327 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb80cce40 con 0x56297b828370 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.081+0000 7fabb37fe640 1 -- 172.21.15.46:0/1748274327 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb809ad50 con 0x56297b828370 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 -- 172.21.15.46:0/1748274327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 msgr2=0x56297b82a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b82a830 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fabb80a3f90 tx=0x7fabb806e780 comp rx=0 tx=0).stop 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 -- 172.21.15.46:0/1748274327 shutdown_connections 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b82a830 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.088 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b827da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1748274327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8229a0 0x56297b822da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 -- 172.21.15.46:0/1748274327 >> 172.21.15.46:0/1748274327 conn(0x56297b81e010 msgr2=0x56297b81e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 -- 172.21.15.46:0/1748274327 shutdown_connections 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 -- 172.21.15.46:0/1748274327 wait complete. 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 -- start start 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.082+0000 7fabd25d2740 1 Processor -- start 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b82cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b82d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b834120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56297b82b340 con 0x56297b828370 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56297b70f290 con 0x56297b8232e0 2024-09-19T09:23:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56297b82b4c0 con 0x56297b8229a0 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabd25d2740 10 client.0 _ll_register_callbacks cb 0x56297b740140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b834120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b834120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44240/0 (socket says 172.21.15.46:44240) 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 -- 172.21.15.46:0/1346320291 learned_addr learned my addr 172.21.15.46:0/1346320291 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabccddd640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b82d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b82cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 -- 172.21.15.46:0/1346320291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 msgr2=0x56297b82cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b82cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 -- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 msgr2=0x56297b82d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b82d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcdddf640 1 -- 172.21.15.46:0/1346320291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56297b499210 con 0x56297b828370 2024-09-19T09:23:27.090 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.083+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b82cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabcdddf640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b834120 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005c00 tx=0x7fabc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4957330a525430b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabb0ff9640 1 -- 172.21.15.46:0/1346320291 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0024030 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabb0ff9640 1 -- 172.21.15.46:0/1346320291 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fabc001b070 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb80cce40 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabb0ff9640 1 -- 172.21.15.46:0/1346320291 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fabc0030050 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 10 client.16656 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56297b565620 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabb0ff9640 1 -- 172.21.15.46:0/1346320291 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabb80cce40 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabb0ff9640 1 -- 172.21.15.46:0/1346320291 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fabc001e040 con 0x56297b828370 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 10 client.16656 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 20 client.16656 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b838900 0x56297b83ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 4 client.16656 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.084+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56297b793a20 con 0x56297b838900 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.085+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b838900 0x56297b83ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.085+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b838900 0x56297b83ad80 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d780adc527b36b server_cookie=895f00ed52f1e3f5 in_seq=0 out_seq=0 2024-09-19T09:23:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.085+0000 7fabb0ff9640 10 client.16656 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabb0ff9640 1 -- 172.21.15.46:0/1346320291 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56297b793a20 con 0x56297b838900 2024-09-19T09:23:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabb0ff9640 10 client.16656 handle_command_reply: tid=0 2024-09-19T09:23:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 client.16656 shutdown 2024-09-19T09:23:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 msgr2=0x56297b834120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b834120 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005c00 tx=0x7fabc0004a40 comp rx=0 tx=0).stop 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 shutdown_connections 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b838900 0x56297b83ad80 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b834120 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b82d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabb0ff9640 0 client.16656 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1346320291 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b82cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 >> 172.21.15.46:0/1346320291 conn(0x56297b81e010 msgr2=0x56297b81f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 shutdown_connections 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 1 -- 172.21.15.46:0/1346320291 wait complete. 2024-09-19T09:23:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.086+0000 7fabd25d2740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T09:23:27.107 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 Processor -- start 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 -- start start 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 0x56297b81e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b834040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b828370 0x56297b81e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81ab0a0 con 0x56297b8229a0 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81acca0 con 0x56297b828370 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabd25d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81ab770 con 0x56297b8232e0 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 0x56297b81e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 0x56297b81e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44242/0 (socket says 172.21.15.46:44242) 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 -- 172.21.15.46:0/1460914621 learned_addr learned my addr 172.21.15.46:0/1460914621 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcdddf640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b828370 0x56297b81e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 -- 172.21.15.46:0/1460914621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 msgr2=0x56297b834040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabccddd640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b834040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b834040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 -- 172.21.15.46:0/1460914621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b828370 msgr2=0x56297b81e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b828370 0x56297b81e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcd5de640 1 -- 172.21.15.46:0/1460914621 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56297b81de30 con 0x56297b8229a0 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabcdddf640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b828370 0x56297b81e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.105+0000 7fabccddd640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b834040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.106+0000 7fabcd5de640 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 0x56297b81e3f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fabc40314e0 tx=0x7fabc4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5622862a90cdb37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.106+0000 7fabb2ffd640 1 -- 172.21.15.46:0/1460914621 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4035040 con 0x56297b8229a0 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.106+0000 7fabb2ffd640 1 -- 172.21.15.46:0/1460914621 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc404a070 con 0x56297b8229a0 2024-09-19T09:23:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.106+0000 7fabb2ffd640 1 -- 172.21.15.46:0/1460914621 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc40049e0 con 0x56297b8229a0 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.106+0000 7fabd25d2740 1 -- 172.21.15.46:0/1460914621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 msgr2=0x56297b81e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.106+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 0x56297b81e3f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fabc40314e0 tx=0x7fabc4005fd0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- 172.21.15.46:0/1460914621 shutdown_connections 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b828370 0x56297b81e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8232e0 0x56297b834040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 --2- 172.21.15.46:0/1460914621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b8229a0 0x56297b81e3f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- 172.21.15.46:0/1460914621 >> 172.21.15.46:0/1460914621 conn(0x56297b81e010 msgr2=0x56297b82cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- 172.21.15.46:0/1460914621 shutdown_connections 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- 172.21.15.46:0/1460914621 wait complete. 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- start start 2024-09-19T09:23:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 Processor -- start 2024-09-19T09:23:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b830d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b8312b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b8a1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81ac5d0 con 0x56297b828370 2024-09-19T09:23:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81abe40 con 0x56297b8232e0 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fabc81a9080 con 0x56297b8229a0 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.107+0000 7fabd25d2740 10 client.0 _ll_register_callbacks cb 0x7fabc0012d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b8a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b8a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44254/0 (socket says 172.21.15.46:44254) 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 -- 172.21.15.46:0/2982702774 learned_addr learned my addr 172.21.15.46:0/2982702774 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabccddd640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b8312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcd5de640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b830d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 -- 172.21.15.46:0/2982702774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 msgr2=0x56297b830d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b830d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 -- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 msgr2=0x56297b8312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b8312b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 -- 172.21.15.46:0/2982702774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56297b834330 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabcdddf640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b8a1650 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009960 tx=0x7fabc0009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfef19f5156997a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabb0ff9640 1 -- 172.21.15.46:0/2982702774 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0024070 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabb0ff9640 1 -- 172.21.15.46:0/2982702774 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fabc00129e0 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabc404a070 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabb0ff9640 1 -- 172.21.15.46:0/2982702774 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fabc0010890 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.108+0000 7fabd25d2740 10 client.16662 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56297b8a2b70 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabb0ff9640 1 -- 172.21.15.46:0/2982702774 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabc404a070 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabb0ff9640 1 -- 172.21.15.46:0/2982702774 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7fabc0004d80 con 0x56297b828370 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 10 client.16662 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 20 client.16662 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b8a35b0 0x56297b8a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 4 client.16662 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56297b78dd70 con 0x56297b8a35b0 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.109+0000 7fabcd5de640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b8a35b0 0x56297b8a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.110+0000 7fabb0ff9640 10 client.16662 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.110+0000 7fabcd5de640 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b8a35b0 0x56297b8a59d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac82753a9fe47f server_cookie=8522b96cc0ee72f8 in_seq=0 out_seq=0 2024-09-19T09:23:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabb0ff9640 1 -- 172.21.15.46:0/2982702774 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56297b78dd70 con 0x56297b8a35b0 2024-09-19T09:23:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabb0ff9640 10 client.16662 handle_command_reply: tid=0 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 client.16662 shutdown 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 msgr2=0x56297b8a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b8a1650 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009960 tx=0x7fabc0009d40 comp rx=0 tx=0).stop 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 shutdown_connections 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56297b8a35b0 0x56297b8a59d0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x56297b828370 0x56297b8a1650 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56297b8232e0 0x56297b8312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 --2- 172.21.15.46:0/2982702774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56297b8229a0 0x56297b830d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabb0ff9640 0 client.16662 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.119+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 >> 172.21.15.46:0/2982702774 conn(0x56297b81e010 msgr2=0x56297b81c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 shutdown_connections 2024-09-19T09:23:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabd25d2740 1 -- 172.21.15.46:0/2982702774 wait complete. 2024-09-19T09:23:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabd25d2740 20 client.16662 trim_cache size 0 max 16384 2024-09-19T09:23:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:23:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:23:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:23:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:23:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fabb40a32f0 msgr2=0x7fabb40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fabb40a32f0 0x7fabb40a57b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009990 tx=0x7fabc00096c0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 msgr2=0x7fabc819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 0x7fabc819a590 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fabb800d740 tx=0x7fabb800dc00 comp rx=0 tx=0).stop 2024-09-19T09:23:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 shutdown_connections 2024-09-19T09:23:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fabb40a32f0 0x7fabb40a57b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fabc8104fa0 0x7fabc819a590 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabc81078d0 0x7fabc81a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 --2- 172.21.15.46:0/298755639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fabc8102670 0x7fabc819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 >> 172.21.15.46:0/298755639 conn(0x7fabc80fc1f0 msgr2=0x7fabc8107cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 shutdown_connections 2024-09-19T09:23:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:27.120+0000 7fabcf842640 1 -- 172.21.15.46:0/298755639 wait complete. 2024-09-19T09:23:28.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:28 smithi115 ceph-mon[35055]: pgmap v494: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-09-19T09:23:28.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:28 smithi046 ceph-mon[31203]: pgmap v494: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-09-19T09:23:28.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:28 smithi099 ceph-mon[35256]: pgmap v494: 97 pgs: 97 active+clean; 58 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-09-19T09:23:30.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:30 smithi115 ceph-mon[35055]: pgmap v495: 97 pgs: 97 active+clean; 65 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-19T09:23:30.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:30 smithi046 ceph-mon[31203]: pgmap v495: 97 pgs: 97 active+clean; 65 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-19T09:23:30.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:30 smithi099 ceph-mon[35256]: pgmap v495: 97 pgs: 97 active+clean; 65 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9.8 KiB/s wr, 9 op/s 2024-09-19T09:23:32.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:32 smithi115 ceph-mon[35055]: pgmap v496: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-19T09:23:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:32 smithi046 ceph-mon[31203]: pgmap v496: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-19T09:23:32.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:32 smithi099 ceph-mon[35256]: pgmap v496: 97 pgs: 97 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-19T09:23:34.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:34 smithi115 ceph-mon[35055]: pgmap v497: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 KiB/s wr, 14 op/s 2024-09-19T09:23:34.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:34 smithi046 ceph-mon[31203]: pgmap v497: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 KiB/s wr, 14 op/s 2024-09-19T09:23:34.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:34 smithi099 ceph-mon[35256]: pgmap v497: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 KiB/s wr, 14 op/s 2024-09-19T09:23:35.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:35 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:23:35.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:35 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:23:35.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:35 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:23:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:36 smithi115 ceph-mon[35055]: pgmap v498: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 KiB/s wr, 13 op/s 2024-09-19T09:23:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:23:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:23:36.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:23:36.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:36 smithi046 ceph-mon[31203]: pgmap v498: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 KiB/s wr, 13 op/s 2024-09-19T09:23:36.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:23:36.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:23:36.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:23:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:36 smithi099 ceph-mon[35256]: pgmap v498: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 85 KiB/s wr, 13 op/s 2024-09-19T09:23:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:23:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:23:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:23:37.249 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:23:37.522 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 -- 172.21.15.46:0/1657992081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 msgr2=0x7fd89010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 --2- 172.21.15.46:0/1657992081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89010da40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd888009ca0 tx=0x7fd88802a950 comp rx=0 tx=0).stop 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 -- 172.21.15.46:0/1657992081 shutdown_connections 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 --2- 172.21.15.46:0/1657992081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89010da40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 --2- 172.21.15.46:0/1657992081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd890102570 0x7fd8901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 --2- 172.21.15.46:0/1657992081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 0x7fd890101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 -- 172.21.15.46:0/1657992081 >> 172.21.15.46:0/1657992081 conn(0x7fd8900fc7d0 msgr2=0x7fd8900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:38.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 -- 172.21.15.46:0/1657992081 shutdown_connections 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.005+0000 7fd8968da640 1 -- 172.21.15.46:0/1657992081 wait complete. 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 Processor -- start 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 -- start start 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 0x7fd890197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd890102570 0x7fd890197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd890110f80 con 0x7fd890102ef0 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd890110e00 con 0x7fd890102570 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd8968da640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd890111100 con 0x7fd890100e20 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd894e77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:38.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd894e77640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41688/0 (socket says 172.21.15.46:41688) 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd894e77640 1 -- 172.21.15.46:0/2205866633 learned_addr learned my addr 172.21.15.46:0/2205866633 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd887fff640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd890102570 0x7fd890197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.006+0000 7fd88ffff640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 0x7fd890197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd894e77640 1 -- 172.21.15.46:0/2205866633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 msgr2=0x7fd890197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd894e77640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 0x7fd890197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd894e77640 1 -- 172.21.15.46:0/2205866633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd890102570 msgr2=0x7fd890197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd894e77640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd890102570 0x7fd890197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd894e77640 1 -- 172.21.15.46:0/2205866633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89019c2b0 con 0x7fd890102ef0 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd88ffff640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 0x7fd890197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd894e77640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89019bbd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd88802ae70 tx=0x7fd88802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:38.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888034040 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89019c540 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd888030920 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888045480 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.007+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8901a3e80 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.008+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8901021b0 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.009+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd888037020 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.010+0000 7fd88dffb640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd87c0a3240 0x7fd87c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.010+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd8880f0850 con 0x7fd890102ef0 2024-09-19T09:23:38.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.010+0000 7fd88ffff640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd87c0a3240 0x7fd87c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:38.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.011+0000 7fd88ffff640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd87c0a3240 0x7fd87c0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd88000abe0 tx=0x7fd88000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:38.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.014+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd8880bd5a0 con 0x7fd890102ef0 2024-09-19T09:23:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.230+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd890198690 con 0x7fd890102ef0 2024-09-19T09:23:38.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.230+0000 7fd88dffb640 1 -- 172.21.15.46:0/2205866633 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11967 (secure 0 0 0) 0x7fd890198690 con 0x7fd890102ef0 2024-09-19T09:23:38.233 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:23:38.233 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-19T09:21:29:130184+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:21:29.130168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:23:38.233 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd87c0a3240 msgr2=0x7fd87c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd87c0a3240 0x7fd87c0a5700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd88000abe0 tx=0x7fd88000a5c0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 msgr2=0x7fd89019bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89019bbd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd88802ae70 tx=0x7fd88802f5d0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 shutdown_connections 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd87c0a3240 0x7fd87c0a5700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd890102ef0 0x7fd89019bbd0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd890102570 0x7fd890197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 --2- 172.21.15.46:0/2205866633 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd890100e20 0x7fd890197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:38.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 >> 172.21.15.46:0/2205866633 conn(0x7fd8900fc7d0 msgr2=0x7fd8901067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:38.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 shutdown_connections 2024-09-19T09:23:38.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:38.233+0000 7fd8968da640 1 -- 172.21.15.46:0/2205866633 wait complete. 2024-09-19T09:23:38.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:38 smithi046 ceph-mon[31203]: pgmap v499: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 85 KiB/s wr, 16 op/s 2024-09-19T09:23:38.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:38 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2205866633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:38.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:38 smithi115 ceph-mon[35055]: pgmap v499: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 85 KiB/s wr, 16 op/s 2024-09-19T09:23:38.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:38 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2205866633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:38.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:38 smithi099 ceph-mon[35256]: pgmap v499: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 85 KiB/s wr, 16 op/s 2024-09-19T09:23:38.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:38 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2205866633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:23:39.015 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 438e598c --release --await' 2024-09-19T09:23:39.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 438e598c --release --await 2024-09-19T09:23:39.277 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:23:39.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 -- 172.21.15.46:0/598877080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828101de0 msgr2=0x7f88281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 --2- 172.21.15.46:0/598877080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828101de0 0x7f88281021c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f8818009900 tx=0x7f881802a410 comp rx=0 tx=0).stop 2024-09-19T09:23:39.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 -- 172.21.15.46:0/598877080 shutdown_connections 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 --2- 172.21.15.46:0/598877080 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 0x7f882810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 --2- 172.21.15.46:0/598877080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828102790 0x7f88281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 --2- 172.21.15.46:0/598877080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828101de0 0x7f88281021c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 -- 172.21.15.46:0/598877080 >> 172.21.15.46:0/598877080 conn(0x7f88280fd8c0 msgr2=0x7f88280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 -- 172.21.15.46:0/598877080 shutdown_connections 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.755+0000 7f882e756640 1 -- 172.21.15.46:0/598877080 wait complete. 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 Processor -- start 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 -- start start 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828101de0 0x7f88280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 0x7f8828074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 0x7f8828074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8828111f70 con 0x7f8828102790 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8828111df0 con 0x7f8828101de0 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882e756640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f88281120f0 con 0x7f8828106f10 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f881ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 0x7f8828074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f881ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 0x7f8828074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41708/0 (socket says 172.21.15.46:41708) 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f881ffff640 1 -- 172.21.15.46:0/1025230274 learned_addr learned my addr 172.21.15.46:0/1025230274 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f8827fff640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828101de0 0x7f88280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.756+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 0x7f8828074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f881ffff640 1 -- 172.21.15.46:0/1025230274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 msgr2=0x7f8828074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f881ffff640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 0x7f8828074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f881ffff640 1 -- 172.21.15.46:0/1025230274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828101de0 msgr2=0x7f88280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f881ffff640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828101de0 0x7f88280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f881ffff640 1 -- 172.21.15.46:0/1025230274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88281a6930 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f8827fff640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828101de0 0x7f88280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 0x7f8828074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f881ffff640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 0x7f8828074a30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f881000d950 tx=0x7f881000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f8825ffb640 1 -- 172.21.15.46:0/1025230274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810017070 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f8825ffb640 1 -- 172.21.15.46:0/1025230274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8810009c30 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88281a6c20 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f8825ffb640 1 -- 172.21.15.46:0/1025230274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000f6b0 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.757+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88281a7160 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.760+0000 7f8825ffb640 1 -- 172.21.15.46:0/1025230274 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f88100109d0 con 0x7f8828102790 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.760+0000 7f8830b2f740 1 Processor -- start 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.760+0000 7f8830b2f740 1 -- start start 2024-09-19T09:23:39.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.760+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc54440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 0x5559edc5ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc61630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8830b2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5559edbb9620 con 0x5559edc54980 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8830b2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5559edb60e50 con 0x5559edc54060 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8830b2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5559edbb55e0 con 0x5559edc5f240 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 0x5559edc5ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 0x5559edc5ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41724/0 (socket says 172.21.15.46:41724) 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 -- 172.21.15.46:0/2814752567 learned_addr learned my addr 172.21.15.46:0/2814752567 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f882ccf3640 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc54440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f881ffff640 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc61630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 -- 172.21.15.46:0/2814752567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 msgr2=0x5559edc61630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc61630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 -- 172.21.15.46:0/2814752567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 msgr2=0x5559edc54440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc54440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 -- 172.21.15.46:0/2814752567 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559edb51d40 con 0x5559edc54980 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8825ffb640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f88140a3240 0x7f88140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8827fff640 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 0x5559edc5ed00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8818033000 tx=0x7f8818032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841c4a26aa2175af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f88140a3240 0x7f88140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.761+0000 7f8825ffb640 1 -- 172.21.15.46:0/1025230274 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f88100cf5e0 con 0x7f8828102790 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f881e7fc640 1 -- 172.21.15.46:0/2814752567 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881803f070 con 0x5559edc54980 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f881e7fc640 1 -- 172.21.15.46:0/2814752567 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88180317b0 con 0x5559edc54980 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f881e7fc640 1 -- 172.21.15.46:0/2814752567 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818035070 con 0x5559edc54980 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 -- 172.21.15.46:0/2814752567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 msgr2=0x5559edc5ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f88140a3240 0x7f88140a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f882000af00 tx=0x7f882000a6b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:39.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 0x5559edc5ed00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8818033000 tx=0x7f8818032d60 comp rx=0 tx=0).stop 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 -- 172.21.15.46:0/2814752567 shutdown_connections 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54980 0x5559edc5ed00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc61630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 --2- 172.21.15.46:0/2814752567 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc54440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.762+0000 7f8830b2f740 1 -- 172.21.15.46:0/2814752567 >> 172.21.15.46:0/2814752567 conn(0x5559edc505f0 msgr2=0x5559edc509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 -- 172.21.15.46:0/2814752567 shutdown_connections 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 -- 172.21.15.46:0/2814752567 wait complete. 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 -- start start 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 Processor -- start 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 0x5559edc5c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54980 0x5559edc5c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc5cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5559edc61e10 con 0x5559edc54060 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5559edb41f10 con 0x5559edc54980 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5559edc61f90 con 0x5559edc5f240 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.763+0000 7f8830b2f740 10 client.0 _ll_register_callbacks cb 0x5559edb65db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 0x5559edc5c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 0x5559edc5c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41732/0 (socket says 172.21.15.46:41732) 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 -- 172.21.15.46:0/1618558249 learned_addr learned my addr 172.21.15.46:0/1618558249 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc5cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f881ffff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54980 0x5559edc5c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 -- 172.21.15.46:0/1618558249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 msgr2=0x5559edc5cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc5cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 -- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54980 msgr2=0x5559edc5c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54980 0x5559edc5c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 -- 172.21.15.46:0/1618558249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559ed8c8580 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f881ffff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54980 0x5559edc5c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8827fff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 0x5559edc5c0c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f881802a930 tx=0x7f88180052b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fee7668c18864f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f88077fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f88077fe640 1 -- 172.21.15.46:0/1618558249 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881804a020 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f88077fe640 1 -- 172.21.15.46:0/1618558249 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f88180037f0 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.764+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88180317b0 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f88077fe640 1 -- 172.21.15.46:0/1618558249 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f881803f070 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 10 client.16680 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5559ed992960 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f88077fe640 1 -- 172.21.15.46:0/1618558249 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88180317b0 con 0x5559edc54060 2024-09-19T09:23:39.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f88077fe640 1 -- 172.21.15.46:0/1618558249 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f8818004d40 con 0x5559edc54060 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 10 client.16680 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 10 client.16680 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 20 client.16680 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edc6ec00 0x5559edc70ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 4 client.16680 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.765+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559edbc6b90 con 0x5559edc6ec00 2024-09-19T09:23:39.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.766+0000 7f881ffff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edc6ec00 0x5559edc70ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.766+0000 7f881ffff640 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edc6ec00 0x5559edc70ff0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6439c57508bfa1df server_cookie=22af86715889568a in_seq=0 out_seq=0 2024-09-19T09:23:39.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.766+0000 7f88077fe640 10 client.16680 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:39.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f88077fe640 1 -- 172.21.15.46:0/1618558249 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5559edbc6b90 con 0x5559edc6ec00 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f88077fe640 10 client.16680 handle_command_reply: tid=0 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 client.16680 shutdown 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 msgr2=0x5559edc5c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 0x5559edc5c0c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f881802a930 tx=0x7f88180052b0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 shutdown_connections 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edc6ec00 0x5559edc70ff0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc5f240 0x5559edc5cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54980 0x5559edc5c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1618558249 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc54060 0x5559edc5c0c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 >> 172.21.15.46:0/1618558249 conn(0x5559edc505f0 msgr2=0x5559edc56320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:39.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f88077fe640 0 client.16680 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:39.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 shutdown_connections 2024-09-19T09:23:39.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.767+0000 7f8830b2f740 1 -- 172.21.15.46:0/1618558249 wait complete. 2024-09-19T09:23:39.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.768+0000 7f8830b2f740 20 client.16680 trim_cache size 0 max 16384 2024-09-19T09:23:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 Processor -- start 2024-09-19T09:23:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 -- start start 2024-09-19T09:23:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc56a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc4f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88281af680 con 0x5559edc5f240 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88281b1280 con 0x5559edc54060 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8830b2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f88281afd50 con 0x5559edc54980 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc766a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41734/0 (socket says 172.21.15.46:41734) 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 -- 172.21.15.46:0/1012470888 learned_addr learned my addr 172.21.15.46:0/1012470888 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f8827fff640 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc56a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f881ffff640 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc4f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 -- 172.21.15.46:0/1012470888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 msgr2=0x5559edc4f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc4f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 -- 172.21.15.46:0/1012470888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 msgr2=0x5559edc56a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc56a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.785+0000 7f882ccf3640 1 -- 172.21.15.46:0/1012470888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559edc50420 con 0x5559edc5f240 2024-09-19T09:23:39.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.786+0000 7f8827fff640 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc56a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:39.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.786+0000 7f882ccf3640 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc766a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f882001e630 tx=0x7f8820014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5edbf0b3f8a6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.786+0000 7f881dffb640 1 -- 172.21.15.46:0/1012470888 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820004d20 con 0x5559edc5f240 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.786+0000 7f881dffb640 1 -- 172.21.15.46:0/1012470888 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8820005500 con 0x5559edc5f240 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.786+0000 7f881dffb640 1 -- 172.21.15.46:0/1012470888 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882001d950 con 0x5559edc5f240 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 -- 172.21.15.46:0/1012470888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 msgr2=0x5559edc766a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc766a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f882001e630 tx=0x7f8820014000 comp rx=0 tx=0).stop 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 -- 172.21.15.46:0/1012470888 shutdown_connections 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc766a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc4f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- 172.21.15.46:0/1012470888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc56a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 -- 172.21.15.46:0/1012470888 >> 172.21.15.46:0/1012470888 conn(0x5559edc505f0 msgr2=0x5559edc4ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 -- 172.21.15.46:0/1012470888 shutdown_connections 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 -- 172.21.15.46:0/1012470888 wait complete. 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 -- start start 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 Processor -- start 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc63660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.787+0000 7f8830b2f740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc63ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f8830b2f740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f88281b0bb0 con 0x5559edc5f240 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f8830b2f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f88281b0420 con 0x5559edc54060 2024-09-19T09:23:39.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f8830b2f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f88281ad680 con 0x5559edc54980 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f8830b2f740 10 client.0 _ll_register_callbacks cb 0x7f8818004370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc63ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc63ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41738/0 (socket says 172.21.15.46:41738) 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 -- 172.21.15.46:0/14387006 learned_addr learned my addr 172.21.15.46:0/14387006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f8827fff640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f881ffff640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc63660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 -- 172.21.15.46:0/14387006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 msgr2=0x5559edc63660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc63660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 -- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 msgr2=0x5559edc63120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc63120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 -- 172.21.15.46:0/14387006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559edcd8870 con 0x5559edc5f240 2024-09-19T09:23:39.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f881ffff640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc63660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f882ccf3640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc63ba0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8820011ca0 tx=0x7f8820004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a1b43397f83b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f88077fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f88077fe640 1 -- 172.21.15.46:0/14387006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820035020 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f88077fe640 1 -- 172.21.15.46:0/14387006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8820005210 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.788+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8820005500 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f88077fe640 1 -- 172.21.15.46:0/14387006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f882002b040 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 10 client.16686 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5559edcd9b30 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f88077fe640 1 -- 172.21.15.46:0/14387006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8820005500 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f88077fe640 1 -- 172.21.15.46:0/14387006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f8820025070 con 0x5559edc5f240 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 10 client.16686 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 10 client.16686 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:23:39.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 20 client.16686 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edcda250 0x5559edcdc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 4 client.16686 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "438e598c", "release": true, "await": true}] 2024-09-19T09:23:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "set_id": "438e598c", "release": true, "await": true}) -- 0x5559edbc10a0 con 0x5559edcda250 2024-09-19T09:23:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.789+0000 7f8827fff640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edcda250 0x5559edcdc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.790+0000 7f8827fff640 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edcda250 0x5559edcdc670 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20ca8cff20f068b server_cookie=ac8a7c373d9acb12 in_seq=0 out_seq=0 2024-09-19T09:23:39.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.790+0000 7f88077fe640 10 client.16686 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:39.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f88077fe640 1 -- 172.21.15.46:0/14387006 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5559edbc10a0 con 0x5559edcda250 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f88077fe640 10 client.16686 handle_command_reply: tid=0 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f8830b2f740 1 client.16686 shutdown 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 msgr2=0x5559edc63ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f8830b2f740 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc63ba0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8820011ca0 tx=0x7f8820004d60 comp rx=0 tx=0).stop 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 shutdown_connections 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.881+0000 7f8830b2f740 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5559edcda250 0x5559edcdc670 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5559edc5f240 0x5559edc63ba0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5559edc54980 0x5559edc63660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f88077fe640 0 client.16686 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:39.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 1 --2- 172.21.15.46:0/14387006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5559edc54060 0x5559edc63120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 >> 172.21.15.46:0/14387006 conn(0x5559edc505f0 msgr2=0x5559edc5c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 shutdown_connections 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 1 -- 172.21.15.46:0/14387006 wait complete. 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f8830b2f740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 37, 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 24, 2024-09-19T09:23:39.885 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": { 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "438e598c": { 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "version": 24, 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "age_ref": 0.0, 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "timeout": 90.0, 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "expiration": 149.8, 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "members": { 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "file:/": { 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "excluded": false, 2024-09-19T09:23:39.886 INFO:teuthology.orchestra.run.smithi046.stdout: "state": { 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RELEASED", 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: "age": 0.0 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:23:39.887 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f88140a3240 msgr2=0x7f88140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f88140a3240 0x7f88140a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f882000af00 tx=0x7f882000a6b0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 msgr2=0x7f8828074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 0x7f8828074a30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f881000d950 tx=0x7f881000de10 comp rx=0 tx=0).stop 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 shutdown_connections 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f88140a3240 0x7f88140a5700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8828102790 0x7f8828074a30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8828106f10 0x7f8828074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 --2- 172.21.15.46:0/1025230274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8828101de0 0x7f88280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:39.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.882+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 >> 172.21.15.46:0/1025230274 conn(0x7f88280fd8c0 msgr2=0x7f88280fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:39.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.883+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 shutdown_connections 2024-09-19T09:23:39.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:23:39.883+0000 7f882e756640 1 -- 172.21.15.46:0/1025230274 wait complete. 2024-09-19T09:23:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 -- 172.21.15.46:0/1398147581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 msgr2=0x7f8ae81020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 --2- 172.21.15.46:0/1398147581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae81020c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009900 tx=0x7f8ad802a410 comp rx=0 tx=0).stop 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 -- 172.21.15.46:0/1398147581 shutdown_connections 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 --2- 172.21.15.46:0/1398147581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae81020c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 --2- 172.21.15.46:0/1398147581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ae8102600 0x7f8ae8108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 --2- 172.21.15.46:0/1398147581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 -- 172.21.15.46:0/1398147581 >> 172.21.15.46:0/1398147581 conn(0x7f8ae80fc1b0 msgr2=0x7f8ae80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 -- 172.21.15.46:0/1398147581 shutdown_connections 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.227+0000 7f8aefd49640 1 -- 172.21.15.46:0/1398147581 wait complete. 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 Processor -- start 2024-09-19T09:23:40.230 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 -- start start 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ae8102600 0x7f8ae819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae810c6d0 con 0x7f8ae8101c40 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae810c550 con 0x7f8ae8100a50 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aefd49640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae810c850 con 0x7f8ae8102600 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aedae5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aedae5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:41218/0 (socket says 172.21.15.46:41218) 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.228+0000 7f8aedae5640 1 -- 172.21.15.46:0/2927959707 learned_addr learned my addr 172.21.15.46:0/2927959707 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:40.232 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ae8102600 0x7f8ae819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aedae5640 1 -- 172.21.15.46:0/2927959707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ae8102600 msgr2=0x7f8ae819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aedae5640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ae8102600 0x7f8ae819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aedae5640 1 -- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 msgr2=0x7f8ae8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aedae5640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aedae5640 1 -- 172.21.15.46:0/2927959707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae819f9f0 con 0x7f8ae8100a50 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aedae5640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8197e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400e9c0 tx=0x7f8ae400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8adeffd640 1 -- 172.21.15.46:0/2927959707 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae400cd80 con 0x7f8ae8100a50 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8adeffd640 1 -- 172.21.15.46:0/2927959707 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ae40035f0 con 0x7f8ae8100a50 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae819fce0 con 0x7f8ae8100a50 2024-09-19T09:23:40.233 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8adeffd640 1 -- 172.21.15.46:0/2927959707 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4010690 con 0x7f8ae8100a50 2024-09-19T09:23:40.234 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.229+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae81a0180 con 0x7f8ae8100a50 2024-09-19T09:23:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.234+0000 7f8adeffd640 1 -- 172.21.15.46:0/2927959707 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8ae40037a0 con 0x7f8ae8100a50 2024-09-19T09:23:40.236 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.234+0000 7f8af2bbd740 1 Processor -- start 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.234+0000 7f8af2bbd740 1 -- start start 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f6cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f71da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9f74830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5651e9ed02f0 con 0x5651e9f72370 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5651e9e78270 con 0x5651e9f6c9a0 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5651e9ecc2b0 con 0x5651e9f6d2e0 2024-09-19T09:23:40.238 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f6cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f6cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:41226/0 (socket says 172.21.15.46:41226) 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 -- 172.21.15.46:0/3539668021 learned_addr learned my addr 172.21.15.46:0/3539668021 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aedae5640 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f71da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9f74830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 -- 172.21.15.46:0/3539668021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 msgr2=0x5651e9f71da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f71da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 -- 172.21.15.46:0/3539668021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 msgr2=0x5651e9f74830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9f74830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.235+0000 7f8aee2e6640 1 -- 172.21.15.46:0/3539668021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e9e77340 con 0x5651e9f6c9a0 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8adeffd640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8ad40a32f0 0x7f8ad40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.239 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f6cda0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009fd0 tx=0x7f8ae00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a38c6922208c796 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8aedae5640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8ad40a32f0 0x7f8ad40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8ad3fff640 1 -- 172.21.15.46:0/3539668021 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0004d20 con 0x5651e9f6c9a0 2024-09-19T09:23:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8ad3fff640 1 -- 172.21.15.46:0/3539668021 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ae0004050 con 0x5651e9f6c9a0 2024-09-19T09:23:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8ad3fff640 1 -- 172.21.15.46:0/3539668021 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0005260 con 0x5651e9f6c9a0 2024-09-19T09:23:40.240 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.236+0000 7f8adeffd640 1 -- 172.21.15.46:0/2927959707 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8ae40cfd70 con 0x7f8ae8100a50 2024-09-19T09:23:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3539668021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 msgr2=0x5651e9f6cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8aedae5640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8ad40a32f0 0x7f8ad40a57b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40cdc10 tx=0x7f8ae40d3850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f6cda0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009fd0 tx=0x7f8ae00118d0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.243 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3539668021 shutdown_connections 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9f74830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f71da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3539668021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f6cda0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3539668021 >> 172.21.15.46:0/3539668021 conn(0x5651e9f68010 msgr2=0x5651e9f68410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3539668021 shutdown_connections 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3539668021 wait complete. 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.237+0000 7f8af2bbd740 1 -- start start 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 Processor -- start 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 0x5651e9f76bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6d2e0 0x5651e9f77100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.244 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f72370 0x5651e9f7e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5651e9f75340 con 0x5651e9f6d2e0 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5651e9e59290 con 0x5651e9f72370 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5651e9f754c0 con 0x5651e9f6c9a0 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8af2bbd740 10 client.0 _ll_register_callbacks cb 0x5651e9e8a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.238+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 0x5651e9f76bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6d2e0 0x5651e9f77100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 0x5651e9f76bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:34204/0 (socket says 172.21.15.46:34204) 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aee2e6640 1 -- 172.21.15.46:0/3014845364 learned_addr learned my addr 172.21.15.46:0/3014845364 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f72370 0x5651e9f7e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 -- 172.21.15.46:0/3014845364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 msgr2=0x5651e9f76bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 0x5651e9f76bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 -- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f72370 msgr2=0x5651e9f7e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.245 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f72370 0x5651e9f7e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 -- 172.21.15.46:0/3014845364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e9be3210 con 0x5651e9f6d2e0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 0x5651e9f76bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6d2e0 0x5651e9f77100 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8ad802a930 tx=0x7f8ad8032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7d92e3a87a4388 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.239+0000 7f8ad17fa640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8ad17fa640 1 -- 172.21.15.46:0/3014845364 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8040070 con 0x5651e9f6d2e0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8ad17fa640 1 -- 172.21.15.46:0/3014845364 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8ad8004040 con 0x5651e9f6d2e0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ae0004050 con 0x5651e9f6d2e0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8ad17fa640 1 -- 172.21.15.46:0/3014845364 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8ad8035040 con 0x5651e9f6d2e0 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 10 client.16695 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:40.246 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5651e9caf620 con 0x5651e9f6d2e0 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8ad17fa640 1 -- 172.21.15.46:0/3014845364 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ae0004050 con 0x5651e9f6d2e0 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8ad17fa640 1 -- 172.21.15.46:0/3014845364 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f8ad803c440 con 0x5651e9f6d2e0 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 10 client.16695 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 10 client.16695 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 20 client.16695 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9f84c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 4 client.16695 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.240+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651e9edda20 con 0x5651e9f82830 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.241+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9f84c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.242+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9f84c70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a7eeb239b06102 server_cookie=fd676624a92c4bc3 in_seq=0 out_seq=0 2024-09-19T09:23:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.242+0000 7f8ad17fa640 10 client.16695 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.242+0000 7f8ad17fa640 1 -- 172.21.15.46:0/3014845364 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651e9edda20 con 0x5651e9f82830 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.242+0000 7f8ad17fa640 10 client.16695 handle_command_reply: tid=0 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.242+0000 7f8af2bbd740 1 client.16695 shutdown 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6d2e0 msgr2=0x5651e9f77100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6d2e0 0x5651e9f77100 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8ad802a930 tx=0x7f8ad8032ed0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 shutdown_connections 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9f84c70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6d2e0 0x5651e9f77100 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8ad17fa640 0 client.16695 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f72370 0x5651e9f7e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/3014845364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6c9a0 0x5651e9f76bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 >> 172.21.15.46:0/3014845364 conn(0x5651e9f68010 msgr2=0x5651e9f69820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 shutdown_connections 2024-09-19T09:23:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 1 -- 172.21.15.46:0/3014845364 wait complete. 2024-09-19T09:23:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.243+0000 7f8af2bbd740 20 client.16695 trim_cache size 0 max 16384 2024-09-19T09:23:40.262 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 Processor -- start 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 -- start start 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6c9a0 0x5651e9f683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f72370 0x5651e9f68930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81a9060 con 0x5651e9f6c9a0 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81aac60 con 0x5651e9f6d2e0 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81a9730 con 0x5651e9f72370 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6c9a0 0x5651e9f683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6c9a0 0x5651e9f683f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41770/0 (socket says 172.21.15.46:41770) 2024-09-19T09:23:40.263 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aee2e6640 1 -- 172.21.15.46:0/262447384 learned_addr learned my addr 172.21.15.46:0/262447384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f72370 0x5651e9f68930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aed2e4640 1 -- 172.21.15.46:0/262447384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f72370 msgr2=0x5651e9f68930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f72370 0x5651e9f68930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aed2e4640 1 -- 172.21.15.46:0/262447384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6c9a0 msgr2=0x5651e9f683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6c9a0 0x5651e9f683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.260+0000 7f8aed2e4640 1 -- 172.21.15.46:0/262447384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651e9f6df70 con 0x5651e9f6d2e0 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.261+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7e100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009900 tx=0x7f8ad802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a63bdeb2b3850b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.261+0000 7f8ad37fe640 1 -- 172.21.15.46:0/262447384 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8040070 con 0x5651e9f6d2e0 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.261+0000 7f8ad37fe640 1 -- 172.21.15.46:0/262447384 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ad803c640 con 0x5651e9f6d2e0 2024-09-19T09:23:40.264 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.261+0000 7f8ad37fe640 1 -- 172.21.15.46:0/262447384 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8004460 con 0x5651e9f6d2e0 2024-09-19T09:23:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 -- 172.21.15.46:0/262447384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6d2e0 msgr2=0x5651e9f7e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7e100 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8009900 tx=0x7f8ad802a410 comp rx=0 tx=0).stop 2024-09-19T09:23:40.268 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 -- 172.21.15.46:0/262447384 shutdown_connections 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f72370 0x5651e9f68930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7e100 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/262447384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f6c9a0 0x5651e9f683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 -- 172.21.15.46:0/262447384 >> 172.21.15.46:0/262447384 conn(0x5651e9f68010 msgr2=0x5651e9f6e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 -- 172.21.15.46:0/262447384 shutdown_connections 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 -- 172.21.15.46:0/262447384 wait complete. 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 -- start start 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.262+0000 7f8af2bbd740 1 Processor -- start 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f7aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.269 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9feb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81aa590 con 0x5651e9f72370 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81a9e00 con 0x5651e9f6c9a0 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae81a7040 con 0x5651e9f6d2e0 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8af2bbd740 10 client.0 _ll_register_callbacks cb 0x7f8ae00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aee2e6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9feb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:34220/0 (socket says 172.21.15.46:34220) 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 -- 172.21.15.46:0/2938910826 learned_addr learned my addr 172.21.15.46:0/2938910826 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f7aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.270 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 -- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 msgr2=0x5651e9f7aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f7aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 -- 172.21.15.46:0/2938910826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 msgr2=0x5651e9feb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9feb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 -- 172.21.15.46:0/2938910826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651e9f7bac0 con 0x5651e9f6d2e0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8aed2e4640 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8006010 tx=0x7f8ad8031bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7a7773508753d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.263+0000 7f8ad17fa640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8ad17fa640 1 -- 172.21.15.46:0/2938910826 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8040050 con 0x5651e9f6d2e0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8ad17fa640 1 -- 172.21.15.46:0/2938910826 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8ad803c440 con 0x5651e9f6d2e0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ad803c640 con 0x5651e9f6d2e0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8ad17fa640 1 -- 172.21.15.46:0/2938910826 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8ad802aa90 con 0x5651e9f6d2e0 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 10 client.26101 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:40.271 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5651e9fecbc0 con 0x5651e9f6d2e0 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8ad17fa640 1 -- 172.21.15.46:0/2938910826 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ad803c640 con 0x5651e9f6d2e0 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8ad17fa640 1 -- 172.21.15.46:0/2938910826 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f8ad8004730 con 0x5651e9f6d2e0 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 10 client.26101 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 10 client.26101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 20 client.26101 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9fef540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 4 client.26101 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.264+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5651e9ed7d70 con 0x5651e9f82830 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.265+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9fef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.265+0000 7f8aee2e6640 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9fef540 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1958e50750e56652 server_cookie=fd24d4a50579bc7e in_seq=0 out_seq=0 2024-09-19T09:23:40.272 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.265+0000 7f8ad17fa640 10 client.26101 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8ad17fa640 1 -- 172.21.15.46:0/2938910826 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5651e9ed7d70 con 0x5651e9f82830 2024-09-19T09:23:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8ad17fa640 10 client.26101 handle_command_reply: tid=0 2024-09-19T09:23:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 client.26101 shutdown 2024-09-19T09:23:40.277 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 msgr2=0x5651e9f7b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7b420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8ad8006010 tx=0x7f8ad8031bf0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 shutdown_connections 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5651e9f82830 0x5651e9fef540 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5651e9f72370 0x5651e9feb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5651e9f6d2e0 0x5651e9f7b420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8ad17fa640 0 client.26101 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 --2- 172.21.15.46:0/2938910826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5651e9f6c9a0 0x5651e9f7aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.275+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 >> 172.21.15.46:0/2938910826 conn(0x5651e9f68010 msgr2=0x5651e9f669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.276+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 shutdown_connections 2024-09-19T09:23:40.278 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.276+0000 7f8af2bbd740 1 -- 172.21.15.46:0/2938910826 wait complete. 2024-09-19T09:23:40.279 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.276+0000 7f8af2bbd740 20 client.26101 trim_cache size 0 max 16384 2024-09-19T09:23:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:23:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:23:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:23:40.280 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:23:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8ad40a32f0 msgr2=0x7f8ad40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8ad40a32f0 0x7f8ad40a57b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40cdc10 tx=0x7f8ae40d3850 comp rx=0 tx=0).stop 2024-09-19T09:23:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 msgr2=0x7f8ae8197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8197e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400e9c0 tx=0x7f8ae400ee80 comp rx=0 tx=0).stop 2024-09-19T09:23:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 shutdown_connections 2024-09-19T09:23:40.281 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8ad40a32f0 0x7f8ad40a57b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ae8101c40 0x7f8ae8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ae8102600 0x7f8ae819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 --2- 172.21.15.46:0/2927959707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ae8100a50 0x7f8ae8197e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.279+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 >> 172.21.15.46:0/2927959707 conn(0x7f8ae80fc1b0 msgr2=0x7f8ae80fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.280+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 shutdown_connections 2024-09-19T09:23:40.282 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:40.280+0000 7f8aefd49640 1 -- 172.21.15.46:0/2927959707 wait complete. 2024-09-19T09:23:40.659 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:40 smithi046 ceph-mon[31203]: pgmap v500: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 KiB/s wr, 12 op/s 2024-09-19T09:23:40.660 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '438e598c', total seconds elapsed: 33.2 2024-09-19T09:23:40.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:40 smithi115 ceph-mon[35055]: pgmap v500: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 KiB/s wr, 12 op/s 2024-09-19T09:23:40.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:40 smithi099 ceph-mon[35256]: pgmap v500: 97 pgs: 97 active+clean; 86 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 85 KiB/s wr, 12 op/s 2024-09-19T09:23:42.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:42 smithi115 ceph-mon[35055]: pgmap v501: 97 pgs: 97 active+clean; 84 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 189 KiB/s wr, 51 op/s 2024-09-19T09:23:42.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:42 smithi046 ceph-mon[31203]: pgmap v501: 97 pgs: 97 active+clean; 84 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 189 KiB/s wr, 51 op/s 2024-09-19T09:23:42.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:42 smithi099 ceph-mon[35256]: pgmap v501: 97 pgs: 97 active+clean; 84 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 189 KiB/s wr, 51 op/s 2024-09-19T09:23:44.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:44 smithi115 ceph-mon[35055]: pgmap v502: 97 pgs: 97 active+clean; 77 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 320 KiB/s wr, 113 op/s 2024-09-19T09:23:44.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:44 smithi046 ceph-mon[31203]: pgmap v502: 97 pgs: 97 active+clean; 77 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 320 KiB/s wr, 113 op/s 2024-09-19T09:23:44.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:44 smithi099 ceph-mon[35256]: pgmap v502: 97 pgs: 97 active+clean; 77 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 320 KiB/s wr, 113 op/s 2024-09-19T09:23:46.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:46 smithi115 ceph-mon[35055]: pgmap v503: 97 pgs: 97 active+clean; 70 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 555 KiB/s wr, 255 op/s 2024-09-19T09:23:46.732 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:46 smithi046 ceph-mon[31203]: pgmap v503: 97 pgs: 97 active+clean; 70 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 555 KiB/s wr, 255 op/s 2024-09-19T09:23:46.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:46 smithi099 ceph-mon[35256]: pgmap v503: 97 pgs: 97 active+clean; 70 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 555 KiB/s wr, 255 op/s 2024-09-19T09:23:47.944 INFO:tasks.workunit.client.0.smithi046.stdout:10000 mapread 0x33cc4e3 thru 0x33cec16 (0x2734 bytes) 2024-09-19T09:23:48.703 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:48 smithi046 ceph-mon[31203]: pgmap v504: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.2 MiB/s wr, 487 op/s 2024-09-19T09:23:48.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:48 smithi115 ceph-mon[35055]: pgmap v504: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.2 MiB/s wr, 487 op/s 2024-09-19T09:23:48.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:48 smithi099 ceph-mon[35256]: pgmap v504: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 1.2 MiB/s wr, 487 op/s 2024-09-19T09:23:50.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:50 smithi115 ceph-mon[35055]: pgmap v505: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 688 op/s 2024-09-19T09:23:50.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:50 smithi046 ceph-mon[31203]: pgmap v505: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 688 op/s 2024-09-19T09:23:50.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:50 smithi099 ceph-mon[35256]: pgmap v505: 97 pgs: 97 active+clean; 72 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 1.7 MiB/s wr, 688 op/s 2024-09-19T09:23:52.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:52 smithi115 ceph-mon[35055]: pgmap v506: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.4 MiB/s wr, 926 op/s 2024-09-19T09:23:52.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:52 smithi046 ceph-mon[31203]: pgmap v506: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.4 MiB/s wr, 926 op/s 2024-09-19T09:23:52.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:52 smithi099 ceph-mon[35256]: pgmap v506: 97 pgs: 97 active+clean; 72 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.4 MiB/s wr, 926 op/s 2024-09-19T09:23:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 -- 172.21.15.46:0/3193228559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304103710 msgr2=0x7f5304109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 --2- 172.21.15.46:0/3193228559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304103710 0x7f5304109fa0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009ca0 tx=0x7f52fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 -- 172.21.15.46:0/3193228559 shutdown_connections 2024-09-19T09:23:53.394 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 --2- 172.21.15.46:0/3193228559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304103710 0x7f5304109fa0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 --2- 172.21.15.46:0/3193228559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304102d50 0x7f53041031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 --2- 172.21.15.46:0/3193228559 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304101b60 0x7f5304101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.392+0000 7f530ba5e640 1 -- 172.21.15.46:0/3193228559 >> 172.21.15.46:0/3193228559 conn(0x7f53040fd2e0 msgr2=0x7f53040ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 -- 172.21.15.46:0/3193228559 shutdown_connections 2024-09-19T09:23:53.395 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 -- 172.21.15.46:0/3193228559 wait complete. 2024-09-19T09:23:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 Processor -- start 2024-09-19T09:23:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 -- start start 2024-09-19T09:23:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304101b60 0x7f5304197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304102d50 0x7f53041982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.397 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 0x7f530419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f530410d7e0 con 0x7f5304101b60 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f530410d660 con 0x7f5304103710 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.393+0000 7f530ba5e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f530410d960 con 0x7f5304102d50 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f53097fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304101b60 0x7f5304197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 0x7f530419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 0x7f530419f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:37762/0 (socket says 172.21.15.46:37762) 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 -- 172.21.15.46:0/1357090988 learned_addr learned my addr 172.21.15.46:0/1357090988 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f53097fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304101b60 0x7f5304197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40060/0 (socket says 172.21.15.46:40060) 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5308ff9640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304102d50 0x7f53041982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 -- 172.21.15.46:0/1357090988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304102d50 msgr2=0x7f53041982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.398 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304102d50 0x7f53041982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 -- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304101b60 msgr2=0x7f5304197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304101b60 0x7f5304197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 -- 172.21.15.46:0/1357090988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530419f9d0 con 0x7f5304103710 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f5309ffb640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 0x7f530419f360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52fc031ae0 tx=0x7f52fc031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f52fa7fc640 1 -- 172.21.15.46:0/1357090988 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc003b70 con 0x7f5304103710 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f52fa7fc640 1 -- 172.21.15.46:0/1357090988 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52fc003d10 con 0x7f5304103710 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f52fa7fc640 1 -- 172.21.15.46:0/1357090988 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc02fc40 con 0x7f5304103710 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.394+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530419fc60 con 0x7f5304103710 2024-09-19T09:23:53.399 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.395+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53041a0160 con 0x7f5304103710 2024-09-19T09:23:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.397+0000 7f530e7fe740 1 Processor -- start 2024-09-19T09:23:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f52fa7fc640 1 -- 172.21.15.46:0/1357090988 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f52fc004050 con 0x7f5304103710 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 -- start start 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x5625236821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5625236826f0 0x5625236871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x562523689c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5625235e12f0 con 0x562523687780 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x562523589270 con 0x562523681db0 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f530e7fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5625235dd2b0 con 0x5625236826f0 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f5308ff9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x5625236821b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f5308ff9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x5625236821b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:37776/0 (socket says 172.21.15.46:37776) 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f5308ff9640 1 -- 172.21.15.46:0/4273567032 learned_addr learned my addr 172.21.15.46:0/4273567032 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.398+0000 7f5308ff9640 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x562523689c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f53097fa640 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5625236826f0 0x5625236871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f52fa7fc640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32f0 0x7f52f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f52fa7fc640 1 -- 172.21.15.46:0/1357090988 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f52fc0f0960 con 0x7f5304103710 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f5308ff9640 1 -- 172.21.15.46:0/4273567032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5625236826f0 msgr2=0x5625236871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f5308ff9640 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5625236826f0 0x5625236871b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f5308ff9640 1 -- 172.21.15.46:0/4273567032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 msgr2=0x5625236821b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f5308ff9640 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x5625236821b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.399+0000 7f5308ff9640 1 -- 172.21.15.46:0/4273567032 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562523588340 con 0x562523687780 2024-09-19T09:23:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.400+0000 7f5308ff9640 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x562523689c40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f52f40058c0 tx=0x7f52f4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc8a84f5e22be54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.401+0000 7f52ef7fe640 1 -- 172.21.15.46:0/4273567032 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4011e30 con 0x562523687780 2024-09-19T09:23:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.401+0000 7f52ef7fe640 1 -- 172.21.15.46:0/4273567032 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52f400f7c0 con 0x562523687780 2024-09-19T09:23:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.401+0000 7f52ef7fe640 1 -- 172.21.15.46:0/4273567032 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f40038e0 con 0x562523687780 2024-09-19T09:23:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.402+0000 7f530e7fe740 1 -- 172.21.15.46:0/4273567032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 msgr2=0x562523689c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.402+0000 7f530e7fe740 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x562523689c40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f52f40058c0 tx=0x7f52f4005f90 comp rx=0 tx=0).stop 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f530e7fe740 1 -- 172.21.15.46:0/4273567032 shutdown_connections 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f530e7fe740 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x562523689c40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f530e7fe740 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5625236826f0 0x5625236871b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f530e7fe740 1 --2- 172.21.15.46:0/4273567032 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x5625236821b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f530e7fe740 1 -- 172.21.15.46:0/4273567032 >> 172.21.15.46:0/4273567032 conn(0x562523679010 msgr2=0x562523679410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f5309ffb640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32f0 0x7f52f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.405 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.403+0000 7f530e7fe740 1 -- 172.21.15.46:0/4273567032 shutdown_connections 2024-09-19T09:23:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.404+0000 7f5309ffb640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32f0 0x7f52f00a57b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b9530 tx=0x7f52fc03d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.404+0000 7f530e7fe740 1 -- 172.21.15.46:0/4273567032 wait complete. 2024-09-19T09:23:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.404+0000 7f530e7fe740 1 -- start start 2024-09-19T09:23:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 Processor -- start 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523684650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x562523684b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x562523685ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x56252368a750 con 0x5625236826f0 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x56252356a290 con 0x562523681db0 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56252368a8d0 con 0x562523687780 2024-09-19T09:23:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f530e7fe740 10 client.0 _ll_register_callbacks cb 0x56252359b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f5308ff9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523684650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.405+0000 7f5308ff9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x562523685ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x562523685ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:34294/0 (socket says 172.21.15.46:34294) 2024-09-19T09:23:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 -- 172.21.15.46:0/3870521549 learned_addr learned my addr 172.21.15.46:0/3870521549 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f53097fa640 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x562523684b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 -- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 msgr2=0x562523684650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523684650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 -- 172.21.15.46:0/3870521549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 msgr2=0x562523684b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x562523684b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 -- 172.21.15.46:0/3870521549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625232f4210 con 0x562523687780 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f5308ff9640 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x562523685ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x562523683b80 tx=0x7f52f4005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38510d7ec156a0c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.406+0000 7f52ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f52ecff9640 1 -- 172.21.15.46:0/3870521549 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f4028040 con 0x562523687780 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f52ecff9640 1 -- 172.21.15.46:0/3870521549 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f52f401f640 con 0x562523687780 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52f400f7c0 con 0x562523687780 2024-09-19T09:23:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f52ecff9640 1 -- 172.21.15.46:0/3870521549 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f52f4011e30 con 0x562523687780 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 10 client.26113 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5625233c0620 con 0x562523687780 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f52ecff9640 1 -- 172.21.15.46:0/3870521549 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52f400f7c0 con 0x562523687780 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f52ecff9640 1 -- 172.21.15.46:0/3870521549 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f52f401d020 con 0x562523687780 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 10 client.26113 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 10 client.26113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 20 client.26113 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56252369bff0 0x56252369e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 4 client.26113 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.407+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625235eea20 con 0x56252369bff0 2024-09-19T09:23:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.408+0000 7f53097fa640 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56252369bff0 0x56252369e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.409+0000 7f53097fa640 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56252369bff0 0x56252369e410 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42ee211cb3c872fd server_cookie=947c26627389e3d3 in_seq=0 out_seq=0 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.409+0000 7f52ecff9640 10 client.26113 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f52ecff9640 1 -- 172.21.15.46:0/3870521549 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625235eea20 con 0x56252369bff0 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f52ecff9640 10 client.26113 handle_command_reply: tid=0 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 client.26113 shutdown 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 msgr2=0x562523685ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x562523685ba0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x562523683b80 tx=0x7f52f4005850 comp rx=0 tx=0).stop 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 shutdown_connections 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x56252369bff0 0x56252369e410 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x562523684b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x562523685ba0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f52ecff9640 0 client.26113 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 --2- 172.21.15.46:0/3870521549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523684650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 >> 172.21.15.46:0/3870521549 conn(0x562523679010 msgr2=0x56252367a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 shutdown_connections 2024-09-19T09:23:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 1 -- 172.21.15.46:0/3870521549 wait complete. 2024-09-19T09:23:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.410+0000 7f530e7fe740 20 client.26113 trim_cache size 0 max 16384 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 Processor -- start 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 -- start start 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523679ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x56252367a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x56252367a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f53041a6ce0 con 0x5625236826f0 2024-09-19T09:23:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53041a88e0 con 0x562523681db0 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.427+0000 7f530e7fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f53041a73b0 con 0x562523687780 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x56252367a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x56252367a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40090/0 (socket says 172.21.15.46:40090) 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 -- 172.21.15.46:0/1633986502 learned_addr learned my addr 172.21.15.46:0/1633986502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f5308ff9640 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523679ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f5308ff9640 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x56252367a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 -- 172.21.15.46:0/1633986502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 msgr2=0x56252367a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x56252367a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 -- 172.21.15.46:0/1633986502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 msgr2=0x562523679ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523679ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 -- 172.21.15.46:0/1633986502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56252367ae80 con 0x5625236826f0 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f53097fa640 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x56252367a400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x562523679e90 tx=0x7f53000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9c85a0e7a0c609 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f52eeffd640 1 -- 172.21.15.46:0/1633986502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300005020 con 0x5625236826f0 2024-09-19T09:23:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f52eeffd640 1 -- 172.21.15.46:0/1633986502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53000047a0 con 0x5625236826f0 2024-09-19T09:23:53.432 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.428+0000 7f52eeffd640 1 -- 172.21.15.46:0/1633986502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530001e700 con 0x5625236826f0 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 -- 172.21.15.46:0/1633986502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 msgr2=0x56252367a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x56252367a400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x562523679e90 tx=0x7f53000046c0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 -- 172.21.15.46:0/1633986502 shutdown_connections 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5625236826f0 0x56252367a400 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523687780 0x56252367a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 --2- 172.21.15.46:0/1633986502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562523681db0 0x562523679ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 -- 172.21.15.46:0/1633986502 >> 172.21.15.46:0/1633986502 conn(0x562523679010 msgr2=0x56252367de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 -- 172.21.15.46:0/1633986502 shutdown_connections 2024-09-19T09:23:53.434 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 -- 172.21.15.46:0/1633986502 wait complete. 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 -- start start 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.429+0000 7f530e7fe740 1 Processor -- start 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523681db0 0x562523696480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 0x5625236969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x5625236979d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f53041a8210 con 0x562523687780 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f53041a7a80 con 0x5625236826f0 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f53041a4cc0 con 0x562523681db0 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f530e7fe740 10 client.0 _ll_register_callbacks cb 0x7f52f4009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f53097fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 0x5625236969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f5308ff9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x5625236979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.435 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f53097fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 0x5625236969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:37800/0 (socket says 172.21.15.46:37800) 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f53097fa640 1 -- 172.21.15.46:0/669245126 learned_addr learned my addr 172.21.15.46:0/669245126 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.430+0000 7f5308ff9640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523681db0 0x562523696480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f5308ff9640 1 -- 172.21.15.46:0/669245126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523681db0 msgr2=0x562523696480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f5308ff9640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523681db0 0x562523696480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f5308ff9640 1 -- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 msgr2=0x5625236969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f5308ff9640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 0x5625236969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f5308ff9640 1 -- 172.21.15.46:0/669245126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562523697fe0 con 0x562523687780 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f53097fa640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 0x5625236969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f5308ff9640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x5625236979d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097c0 tx=0x7f52f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83803d3d226a3d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f52ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.431+0000 7f52ecff9640 1 -- 172.21.15.46:0/669245126 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f400f790 con 0x562523687780 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.432+0000 7f52ecff9640 1 -- 172.21.15.46:0/669245126 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f52f403d440 con 0x562523687780 2024-09-19T09:23:53.436 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.432+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53000047a0 con 0x562523687780 2024-09-19T09:23:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.432+0000 7f52ecff9640 1 -- 172.21.15.46:0/669245126 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f52f403d660 con 0x562523687780 2024-09-19T09:23:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.432+0000 7f530e7fe740 10 client.16719 fetch_fsmap learned FSMap version 37 2024-09-19T09:23:53.437 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.432+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5625236992f0 con 0x562523687780 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f52ecff9640 1 -- 172.21.15.46:0/669245126 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53000047a0 con 0x562523687780 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f52ecff9640 1 -- 172.21.15.46:0/669245126 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 37) ==== 8378+0+0 (secure 0 0 0) 0x7f52f401d070 con 0x562523687780 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f530e7fe740 10 client.16719 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f530e7fe740 10 client.16719 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f530e7fe740 20 client.16719 populate_metadata read hostname 'smithi046' 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f530e7fe740 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562523707330 0x562523709750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f530e7fe740 4 client.16719 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625235e8d70 con 0x562523707330 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f53097fa640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562523707330 0x562523709750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.433+0000 7f52ecff9640 10 client.16719 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:53.438 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.434+0000 7f53097fa640 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562523707330 0x562523709750 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35de46a2509adf0 server_cookie=d1073e6421089bce in_seq=0 out_seq=0 2024-09-19T09:23:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.444+0000 7f52ecff9640 1 -- 172.21.15.46:0/669245126 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625235e8d70 con 0x562523707330 2024-09-19T09:23:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.444+0000 7f52ecff9640 10 client.16719 handle_command_reply: tid=0 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 client.16719 shutdown 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 msgr2=0x5625236979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x5625236979d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097c0 tx=0x7f52f4009bd0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 shutdown_connections 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x562523707330 0x562523709750 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x562523687780 0x5625236979d0 secure :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f52f40097c0 tx=0x7f52f4009bd0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5625236826f0 0x5625236969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 --2- 172.21.15.46:0/669245126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562523681db0 0x562523696480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f52ecff9640 0 client.16719 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:23:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.445+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 >> 172.21.15.46:0/669245126 conn(0x562523679010 msgr2=0x562523679ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:53.449 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.447+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 shutdown_connections 2024-09-19T09:23:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.448+0000 7f530e7fe740 1 -- 172.21.15.46:0/669245126 wait complete. 2024-09-19T09:23:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.448+0000 7f530e7fe740 20 client.16719 trim_cache size 0 max 16384 2024-09-19T09:23:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:23:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:23:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:23:53.450 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:23:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32f0 msgr2=0x7f52f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32f0 0x7f52f00a57b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b9530 tx=0x7f52fc03d040 comp rx=0 tx=0).stop 2024-09-19T09:23:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 msgr2=0x7f530419f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 0x7f530419f360 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52fc031ae0 tx=0x7f52fc031ee0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 shutdown_connections 2024-09-19T09:23:53.452 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f52f00a32f0 0x7f52f00a57b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5304103710 0x7f530419f360 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5304102d50 0x7f53041982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 --2- 172.21.15.46:0/1357090988 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5304101b60 0x7f5304197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 >> 172.21.15.46:0/1357090988 conn(0x7f53040fd2e0 msgr2=0x7f5304106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 shutdown_connections 2024-09-19T09:23:53.453 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:23:53.450+0000 7f530ba5e640 1 -- 172.21.15.46:0/1357090988 wait complete. 2024-09-19T09:23:53.930 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x63e5d2a 2024-09-19T09:23:54.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:54 smithi115 ceph-mon[35055]: pgmap v507: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.5 MiB/s wr, 1.01k op/s 2024-09-19T09:23:54.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:54 smithi046 ceph-mon[31203]: pgmap v507: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.5 MiB/s wr, 1.01k op/s 2024-09-19T09:23:54.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:54 smithi099 ceph-mon[35256]: pgmap v507: 97 pgs: 97 active+clean; 67 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.5 MiB/s wr, 1.01k op/s 2024-09-19T09:23:56.179 INFO:tasks.workunit.client.0.smithi046.stdout:truncating to largest ever: 0x63e9b52 2024-09-19T09:23:56.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:56 smithi115 ceph-mon[35055]: pgmap v508: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.8 MiB/s wr, 1.11k op/s 2024-09-19T09:23:56.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:56 smithi046 ceph-mon[31203]: pgmap v508: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.8 MiB/s wr, 1.11k op/s 2024-09-19T09:23:56.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:56 smithi099 ceph-mon[35256]: pgmap v508: 97 pgs: 97 active+clean; 69 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.8 MiB/s wr, 1.11k op/s 2024-09-19T09:23:57.905 INFO:tasks.workunit.client.0.smithi046.stdout:20000 read 0xa6cbf1 thru 0xa6e358 (0x1768 bytes) 2024-09-19T09:23:58.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:23:58 smithi115 ceph-mon[35055]: pgmap v509: 97 pgs: 97 active+clean; 65 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.1 MiB/s wr, 1.21k op/s 2024-09-19T09:23:58.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:23:58 smithi046 ceph-mon[31203]: pgmap v509: 97 pgs: 97 active+clean; 65 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.1 MiB/s wr, 1.21k op/s 2024-09-19T09:23:58.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:23:58 smithi099 ceph-mon[35256]: pgmap v509: 97 pgs: 97 active+clean; 65 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 MiB/s rd, 3.1 MiB/s wr, 1.21k op/s 2024-09-19T09:23:59.556 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x63ed6b9 2024-09-19T09:24:00.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:00 smithi115 ceph-mon[35055]: pgmap v510: 97 pgs: 97 active+clean; 62 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.9 MiB/s wr, 1.16k op/s 2024-09-19T09:24:00.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:00 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:00 smithi046 ceph-mon[31203]: pgmap v510: 97 pgs: 97 active+clean; 62 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.9 MiB/s wr, 1.16k op/s 2024-09-19T09:24:00.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:00 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:00.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:00 smithi099 ceph-mon[35256]: pgmap v510: 97 pgs: 97 active+clean; 62 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 MiB/s rd, 2.9 MiB/s wr, 1.16k op/s 2024-09-19T09:24:00.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:00 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:02.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:02 smithi115 ceph-mon[35055]: pgmap v511: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.0 MiB/s wr, 1.13k op/s 2024-09-19T09:24:02.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:02 smithi046 ceph-mon[31203]: pgmap v511: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.0 MiB/s wr, 1.13k op/s 2024-09-19T09:24:02.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:02 smithi099 ceph-mon[35256]: pgmap v511: 97 pgs: 97 active+clean; 75 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 3.0 MiB/s wr, 1.13k op/s 2024-09-19T09:24:04.481 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:04 smithi046 ceph-mon[31203]: pgmap v512: 97 pgs: 97 active+clean; 81 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.8 MiB/s wr, 1.08k op/s 2024-09-19T09:24:04.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:04 smithi115 ceph-mon[35055]: pgmap v512: 97 pgs: 97 active+clean; 81 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.8 MiB/s wr, 1.08k op/s 2024-09-19T09:24:04.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:04 smithi099 ceph-mon[35256]: pgmap v512: 97 pgs: 97 active+clean; 81 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 2.8 MiB/s wr, 1.08k op/s 2024-09-19T09:24:05.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:05 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:05.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:05 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:05.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:05 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 -- 172.21.15.46:0/2927311452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d8100a40 msgr2=0x7f89d8100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 --2- 172.21.15.46:0/2927311452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d8100a40 0x7f89d8100e40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009860 tx=0x7f89c802a340 comp rx=0 tx=0).stop 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 -- 172.21.15.46:0/2927311452 shutdown_connections 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 --2- 172.21.15.46:0/2927311452 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8101c30 0x7f89d81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 --2- 172.21.15.46:0/2927311452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d81025f0 0x7f89d8108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 --2- 172.21.15.46:0/2927311452 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d8100a40 0x7f89d8100e40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 -- 172.21.15.46:0/2927311452 >> 172.21.15.46:0/2927311452 conn(0x7f89d80fc1e0 msgr2=0x7f89d80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 -- 172.21.15.46:0/2927311452 shutdown_connections 2024-09-19T09:24:06.573 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.568+0000 7f89de1b7640 1 -- 172.21.15.46:0/2927311452 wait complete. 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 Processor -- start 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 -- start start 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 0x7f89d819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8101c30 0x7f89d819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 0x7f89d81a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89d810afe0 con 0x7f89d8101c30 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89d810ae60 con 0x7f89d81025f0 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.569+0000 7f89de1b7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f89d810b160 con 0x7f89d8100a40 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8101c30 0x7f89d819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.574 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 0x7f89d81a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 0x7f89d819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 0x7f89d81a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:46124/0 (socket says 172.21.15.46:46124) 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 -- 172.21.15.46:0/3263296215 learned_addr learned my addr 172.21.15.46:0/3263296215 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 0x7f89d819e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:53056/0 (socket says 172.21.15.46:53056) 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 -- 172.21.15.46:0/3263296215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 msgr2=0x7f89d819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 0x7f89d819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 -- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8101c30 msgr2=0x7f89d819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8101c30 0x7f89d819e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 -- 172.21.15.46:0/3263296215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d81a5ff0 con 0x7f89d81025f0 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d77fe640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 0x7f89d819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d7fff640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 0x7f89d81a5980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f89d000eb10 tx=0x7f89d000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d4ff9640 1 -- 172.21.15.46:0/3263296215 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d000ce20 con 0x7f89d81025f0 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d4ff9640 1 -- 172.21.15.46:0/3263296215 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89d0005020 con 0x7f89d81025f0 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d81a62e0 con 0x7f89d81025f0 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.570+0000 7f89d4ff9640 1 -- 172.21.15.46:0/3263296215 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0010690 con 0x7f89d81025f0 2024-09-19T09:24:06.576 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.571+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d81a6830 con 0x7f89d81025f0 2024-09-19T09:24:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.573+0000 7f89d4ff9640 1 -- 172.21.15.46:0/3263296215 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f89d00108f0 con 0x7f89d81025f0 2024-09-19T09:24:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.573+0000 7f89e1029740 1 Processor -- start 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.573+0000 7f89e1029740 1 -- start start 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89e1029740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a399a0 0x55b5a8a39da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89e1029740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a3eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89e1029740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8a41830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89e1029740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b5a899d2f0 con 0x55b5a8a3f370 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89e1029740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b5a8945270 con 0x55b5a8a399a0 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89e1029740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b5a89992b0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a3eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a3eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:53062/0 (socket says 172.21.15.46:53062) 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 -- 172.21.15.46:0/3666070440 learned_addr learned my addr 172.21.15.46:0/3666070440 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a399a0 0x55b5a8a39da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8a41830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 -- 172.21.15.46:0/3666070440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a399a0 msgr2=0x55b5a8a39da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a399a0 0x55b5a8a39da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 -- 172.21.15.46:0/3666070440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 msgr2=0x55b5a8a41830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8a41830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 -- 172.21.15.46:0/3666070440 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a8944340 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d4ff9640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c00a3370 0x7f89c00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d4ff9640 1 -- 172.21.15.46:0/3263296215 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f89d00cfe50 con 0x7f89d81025f0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c00a3370 0x7f89c00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.574+0000 7f89d77fe640 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a3eda0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89c802a930 tx=0x7f89c8005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=390e765c64c04a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.575+0000 7f89bdffb640 1 -- 172.21.15.46:0/3666070440 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8037040 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.575+0000 7f89bdffb640 1 -- 172.21.15.46:0/3666070440 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89c8042070 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.575+0000 7f89bdffb640 1 -- 172.21.15.46:0/3666070440 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c80046c0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.575+0000 7f89e1029740 1 -- 172.21.15.46:0/3666070440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 msgr2=0x55b5a8a3eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.575+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c00a3370 0x7f89c00a5830 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009fd0 tx=0x7f89cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.575+0000 7f89e1029740 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a3eda0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89c802a930 tx=0x7f89c8005c90 comp rx=0 tx=0).stop 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- 172.21.15.46:0/3666070440 shutdown_connections 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8a41830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a3eda0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 --2- 172.21.15.46:0/3666070440 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a399a0 0x55b5a8a39da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- 172.21.15.46:0/3666070440 >> 172.21.15.46:0/3666070440 conn(0x55b5a8a35010 msgr2=0x55b5a8a35410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- 172.21.15.46:0/3666070440 shutdown_connections 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- 172.21.15.46:0/3666070440 wait complete. 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- start start 2024-09-19T09:24:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 Processor -- start 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a43ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a44010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a4b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55b5a8a422e0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55b5a8926290 con 0x55b5a8a3f370 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b5a8a42460 con 0x55b5a8a399a0 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.576+0000 7f89e1029740 10 client.0 _ll_register_callbacks cb 0x55b5a8957140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a44010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a43ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a43ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:53074/0 (socket says 172.21.15.46:53074) 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a4b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 -- 172.21.15.46:0/917861837 learned_addr learned my addr 172.21.15.46:0/917861837 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a44010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57438/0 (socket says 172.21.15.46:57438) 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 -- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 msgr2=0x55b5a8a4b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a4b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.588 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 -- 172.21.15.46:0/917861837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 msgr2=0x55b5a8a44010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a44010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 -- 172.21.15.46:0/917861837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a86b0210 con 0x55b5a8a399a0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d7fff640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a4b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a44010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89d77fe640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a43ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89c803f040 tx=0x7f89c8030ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0c7501c979f86da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89b6ffd640 1 -- 172.21.15.46:0/917861837 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8037040 con 0x55b5a8a399a0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89c8042070 con 0x55b5a8a399a0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.577+0000 7f89b6ffd640 1 -- 172.21.15.46:0/917861837 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f89c803d680 con 0x55b5a8a399a0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89b6ffd640 1 -- 172.21.15.46:0/917861837 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f89c803d8c0 con 0x55b5a8a399a0 2024-09-19T09:24:06.589 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 10 client.26131 fetch_fsmap learned FSMap version 39 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b5a877c620 con 0x55b5a8a399a0 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89b6ffd640 1 -- 172.21.15.46:0/917861837 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89c8042070 con 0x55b5a8a399a0 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89b6ffd640 1 -- 172.21.15.46:0/917861837 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f89c8032b20 con 0x55b5a8a399a0 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 10 client.26131 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 10 client.26131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 20 client.26131 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8a4f350 0x55b5a8a51780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 4 client.26131 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5a89aaa20 con 0x55b5a8a4f350 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.578+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8a4f350 0x55b5a8a51780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.579+0000 7f89b6ffd640 10 client.26131 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.579+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8a4f350 0x55b5a8a51780 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0bc198737732eae server_cookie=2812d46f3826e17d in_seq=0 out_seq=0 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89b6ffd640 1 -- 172.21.15.46:0/917861837 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5a89aaa20 con 0x55b5a8a4f350 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89b6ffd640 10 client.26131 handle_command_reply: tid=0 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 client.26131 shutdown 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 msgr2=0x55b5a8a43ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a43ad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89c803f040 tx=0x7f89c8030ab0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 shutdown_connections 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8a4f350 0x55b5a8a51780 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a44010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89b6ffd640 0 client.26131 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a4b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 --2- 172.21.15.46:0/917861837 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a43ad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 >> 172.21.15.46:0/917861837 conn(0x55b5a8a35010 msgr2=0x55b5a8a36820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 shutdown_connections 2024-09-19T09:24:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 1 -- 172.21.15.46:0/917861837 wait complete. 2024-09-19T09:24:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.580+0000 7f89e1029740 20 client.26131 trim_cache size 0 max 16384 2024-09-19T09:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 Processor -- start 2024-09-19T09:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 -- start start 2024-09-19T09:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a42830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a4afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89d81af400 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89d81b0f70 con 0x55b5a8a3f370 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89e1029740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f89d81afad0 con 0x55b5a8a399a0 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a4afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a4afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57454/0 (socket says 172.21.15.46:57454) 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1070382227 learned_addr learned my addr 172.21.15.46:0/1070382227 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d77fe640 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a42830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d7fff640 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1070382227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 msgr2=0x55b5a8a42830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a42830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.600 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1070382227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 msgr2=0x55b5a8a340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1070382227 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a8a34e30 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.596+0000 7f89d7fff640 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.597+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a4afe0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f89d819f8e0 tx=0x7f89cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2935c94a6f8dfc9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.597+0000 7f89bd7fa640 1 -- 172.21.15.46:0/1070382227 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc005020 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.597+0000 7f89bd7fa640 1 -- 172.21.15.46:0/1070382227 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89cc0047a0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.597+0000 7f89bd7fa640 1 -- 172.21.15.46:0/1070382227 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc020670 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 -- 172.21.15.46:0/1070382227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 msgr2=0x55b5a8a4afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a4afe0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f89d819f8e0 tx=0x7f89cc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 -- 172.21.15.46:0/1070382227 shutdown_connections 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a4afe0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3f370 0x55b5a8a340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 --2- 172.21.15.46:0/1070382227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a42830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 -- 172.21.15.46:0/1070382227 >> 172.21.15.46:0/1070382227 conn(0x55b5a8a35010 msgr2=0x55b5a8a339a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 -- 172.21.15.46:0/1070382227 shutdown_connections 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 -- 172.21.15.46:0/1070382227 wait complete. 2024-09-19T09:24:06.605 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.598+0000 7f89e1029740 1 -- start start 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 Processor -- start 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a47dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a48310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8ab8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89d81b08a0 con 0x55b5a8a3f370 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f89d81b01a0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f89d81ad3e0 con 0x55b5a8a399a0 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89e1029740 10 client.0 _ll_register_callbacks cb 0x7f89cc009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8ab8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a48310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a48310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:46156/0 (socket says 172.21.15.46:46156) 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8ab8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57466/0 (socket says 172.21.15.46:57466) 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1987920640 learned_addr learned my addr 172.21.15.46:0/1987920640 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d77fe640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a47dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1987920640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 msgr2=0x55b5a8a47dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a47dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1987920640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 msgr2=0x55b5a8ab8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8ab8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d6ffd640 1 -- 172.21.15.46:0/1987920640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a8ab8550 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.599+0000 7f89d7fff640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8ab8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89d6ffd640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a48310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0099b0 tx=0x7f89cc038480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f4c117258fef49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89b6ffd640 1 -- 172.21.15.46:0/1987920640 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0385f0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89b6ffd640 1 -- 172.21.15.46:0/1987920640 <== mon.2 v2:172.21.15.99:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f89cc038790 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89cc0047a0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89b6ffd640 1 -- 172.21.15.46:0/1987920640 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f89cc038990 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89e1029740 10 client.26219 fetch_fsmap learned FSMap version 39 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b5a8ab96d0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89b6ffd640 1 -- 172.21.15.46:0/1987920640 <== mon.2 v2:172.21.15.99:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89cc0047a0 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89b6ffd640 1 -- 172.21.15.46:0/1987920640 <== mon.2 v2:172.21.15.99:3300/0 5 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f89cc03f070 con 0x55b5a8a3a2e0 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.600+0000 7f89e1029740 10 client.26219 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89e1029740 10 client.26219 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89e1029740 20 client.26219 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89e1029740 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8aba0e0 0x55b5a8abc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89e1029740 4 client.26219 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5a8a41d70 con 0x55b5a8aba0e0 2024-09-19T09:24:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89d77fe640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8aba0e0 0x55b5a8abc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89b6ffd640 10 client.26219 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.601+0000 7f89d77fe640 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8aba0e0 0x55b5a8abc500 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb59401ad3c9c50 server_cookie=5908f34a5116d4f6 in_seq=0 out_seq=0 2024-09-19T09:24:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.621+0000 7f89b6ffd640 1 -- 172.21.15.46:0/1987920640 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5a8a41d70 con 0x55b5a8aba0e0 2024-09-19T09:24:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.621+0000 7f89b6ffd640 10 client.26219 handle_command_reply: tid=0 2024-09-19T09:24:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.621+0000 7f89e1029740 1 client.26219 shutdown 2024-09-19T09:24:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 msgr2=0x55b5a8a48310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a48310 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0099b0 tx=0x7f89cc038480 comp rx=0 tx=0).stop 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 shutdown_connections 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55b5a8aba0e0 0x55b5a8abc500 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89b6ffd640 0 client.26219 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55b5a8a3f370 0x55b5a8ab8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b5a8a3a2e0 0x55b5a8a48310 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 --2- 172.21.15.46:0/1987920640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b5a8a399a0 0x55b5a8a47dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 >> 172.21.15.46:0/1987920640 conn(0x55b5a8a35010 msgr2=0x55b5a8a341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 shutdown_connections 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 1 -- 172.21.15.46:0/1987920640 wait complete. 2024-09-19T09:24:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.622+0000 7f89e1029740 20 client.26219 trim_cache size 0 max 16384 2024-09-19T09:24:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:24:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:24:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:24:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:24:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c00a3370 msgr2=0x7f89c00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c00a3370 0x7f89c00a5830 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009fd0 tx=0x7f89cc009260 comp rx=0 tx=0).stop 2024-09-19T09:24:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 msgr2=0x7f89d81a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 0x7f89d81a5980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f89d000eb10 tx=0x7f89d000ef10 comp rx=0 tx=0).stop 2024-09-19T09:24:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 shutdown_connections 2024-09-19T09:24:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f89c00a3370 0x7f89c00a5830 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8101c30 0x7f89d819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d81025f0 0x7f89d81a5980 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 --2- 172.21.15.46:0/3263296215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89d8100a40 0x7f89d819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 >> 172.21.15.46:0/3263296215 conn(0x7f89d80fc1e0 msgr2=0x7f89d810e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 shutdown_connections 2024-09-19T09:24:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:06.623+0000 7f89de1b7640 1 -- 172.21.15.46:0/3263296215 wait complete. 2024-09-19T09:24:06.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:06 smithi115 ceph-mon[35055]: pgmap v513: 97 pgs: 97 active+clean; 78 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.12k op/s 2024-09-19T09:24:06.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:06 smithi046 ceph-mon[31203]: pgmap v513: 97 pgs: 97 active+clean; 78 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.12k op/s 2024-09-19T09:24:06.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:06 smithi099 ceph-mon[35256]: pgmap v513: 97 pgs: 97 active+clean; 78 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 3.0 MiB/s wr, 1.12k op/s 2024-09-19T09:24:08.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:08 smithi115 ceph-mon[35055]: pgmap v514: 97 pgs: 97 active+clean; 63 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 1.17k op/s 2024-09-19T09:24:08.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:08 smithi046 ceph-mon[31203]: pgmap v514: 97 pgs: 97 active+clean; 63 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 1.17k op/s 2024-09-19T09:24:08.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:08 smithi099 ceph-mon[35256]: pgmap v514: 97 pgs: 97 active+clean; 63 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 MiB/s rd, 3.2 MiB/s wr, 1.17k op/s 2024-09-19T09:24:08.787 INFO:tasks.workunit.client.0.smithi046.stdout:copying to largest ever: 0x63ef9ee 2024-09-19T09:24:10.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:10 smithi115 ceph-mon[35055]: pgmap v515: 97 pgs: 97 active+clean; 64 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-19T09:24:10.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:10 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:10.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:10 smithi046 ceph-mon[31203]: pgmap v515: 97 pgs: 97 active+clean; 64 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-19T09:24:10.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:10 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:10.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:10 smithi099 ceph-mon[35256]: pgmap v515: 97 pgs: 97 active+clean; 64 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-19T09:24:10.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:10 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:12.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:12 smithi115 ceph-mon[35055]: pgmap v516: 97 pgs: 97 active+clean; 79 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 3.0 MiB/s wr, 1.09k op/s 2024-09-19T09:24:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:12 smithi046 ceph-mon[31203]: pgmap v516: 97 pgs: 97 active+clean; 79 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 3.0 MiB/s wr, 1.09k op/s 2024-09-19T09:24:12.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:12 smithi099 ceph-mon[35256]: pgmap v516: 97 pgs: 97 active+clean; 79 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 3.0 MiB/s wr, 1.09k op/s 2024-09-19T09:24:14.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:14 smithi115 ceph-mon[35055]: pgmap v517: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-19T09:24:14.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:14 smithi046 ceph-mon[31203]: pgmap v517: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-19T09:24:14.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:14 smithi099 ceph-mon[35256]: pgmap v517: 97 pgs: 97 active+clean; 92 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 2.9 MiB/s wr, 1.11k op/s 2024-09-19T09:24:16.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:16 smithi115 ceph-mon[35055]: pgmap v518: 97 pgs: 97 active+clean; 88 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-19T09:24:16.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:16 smithi046 ceph-mon[31203]: pgmap v518: 97 pgs: 97 active+clean; 88 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-19T09:24:16.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:16 smithi099 ceph-mon[35256]: pgmap v518: 97 pgs: 97 active+clean; 88 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-19T09:24:18.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:18 smithi115 ceph-mon[35055]: pgmap v519: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-09-19T09:24:18.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:18 smithi046 ceph-mon[31203]: pgmap v519: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-09-19T09:24:18.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:18 smithi099 ceph-mon[35256]: pgmap v519: 97 pgs: 97 active+clean; 82 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.9 MiB/s wr, 1.13k op/s 2024-09-19T09:24:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 -- 172.21.15.46:0/927850489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9081025d0 msgr2=0x7fd9081049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.738 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 --2- 172.21.15.46:0/927850489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9081025d0 0x7fd9081049c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009900 tx=0x7fd8f802a410 comp rx=0 tx=0).stop 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 -- 172.21.15.46:0/927850489 shutdown_connections 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 --2- 172.21.15.46:0/927850489 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd908107830 0x7fd908109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 --2- 172.21.15.46:0/927850489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd908104f00 0x7fd9081072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 --2- 172.21.15.46:0/927850489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9081025d0 0x7fd9081049c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 -- 172.21.15.46:0/927850489 >> 172.21.15.46:0/927850489 conn(0x7fd9080fc1b0 msgr2=0x7fd9080fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 -- 172.21.15.46:0/927850489 shutdown_connections 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.733+0000 7fd90d665640 1 -- 172.21.15.46:0/927850489 wait complete. 2024-09-19T09:24:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 Processor -- start 2024-09-19T09:24:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 -- start start 2024-09-19T09:24:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9081025d0 0x7fd90819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 0x7fd90819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd908107830 0x7fd9081a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd90810d830 con 0x7fd908104f00 2024-09-19T09:24:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd90810d6b0 con 0x7fd9081025d0 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd90d665640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd90810d9b0 con 0x7fd908107830 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 0x7fd90819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd906ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9081025d0 0x7fd90819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 0x7fd90819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47142/0 (socket says 172.21.15.46:47142) 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.734+0000 7fd9067fc640 1 -- 172.21.15.46:0/238777905 learned_addr learned my addr 172.21.15.46:0/238777905 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9077fe640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd908107830 0x7fd9081a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9067fc640 1 -- 172.21.15.46:0/238777905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd908107830 msgr2=0x7fd9081a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9067fc640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd908107830 0x7fd9081a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.741 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9067fc640 1 -- 172.21.15.46:0/238777905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9081025d0 msgr2=0x7fd90819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9067fc640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9081025d0 0x7fd90819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9067fc640 1 -- 172.21.15.46:0/238777905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9081a1cb0 con 0x7fd908104f00 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd906ffd640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9081025d0 0x7fd90819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd9067fc640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 0x7fd90819a5d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00e9f0 tx=0x7fd8fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd8effff640 1 -- 172.21.15.46:0/238777905 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00ccc0 con 0x7fd908104f00 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd8effff640 1 -- 172.21.15.46:0/238777905 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8fc005500 con 0x7fd908104f00 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9081a1fa0 con 0x7fd908104f00 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd8effff640 1 -- 172.21.15.46:0/238777905 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc010690 con 0x7fd908104f00 2024-09-19T09:24:19.742 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.735+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9081a2410 con 0x7fd908104f00 2024-09-19T09:24:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.738+0000 7fd910402740 1 Processor -- start 2024-09-19T09:24:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.738+0000 7fd910402740 1 -- start start 2024-09-19T09:24:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.738+0000 7fd8effff640 1 -- 172.21.15.46:0/238777905 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd8fc0046c0 con 0x7fd908104f00 2024-09-19T09:24:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.738+0000 7fd910402740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bb8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.749 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd910402740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bbdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd910402740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bbe370 0x557f16bc0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd910402740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f16b1c2f0 con 0x557f16bb89a0 2024-09-19T09:24:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd910402740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557f16ac4270 con 0x557f16bbe370 2024-09-19T09:24:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bb8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.750 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd910402740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557f16b182b0 con 0x557f16bb92e0 2024-09-19T09:24:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bb8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47150/0 (socket says 172.21.15.46:47150) 2024-09-19T09:24:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 -- 172.21.15.46:0/794426902 learned_addr learned my addr 172.21.15.46:0/794426902 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd906ffd640 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bbdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9067fc640 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bbe370 0x557f16bc0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.751 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 -- 172.21.15.46:0/794426902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 msgr2=0x557f16bbdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bbdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 -- 172.21.15.46:0/794426902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bbe370 msgr2=0x557f16bc0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bbe370 0x557f16bc0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.752 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.739+0000 7fd9077fe640 1 -- 172.21.15.46:0/794426902 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f16ac3340 con 0x557f16bb89a0 2024-09-19T09:24:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd8effff640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8f00a32f0 0x7fd8f00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd9077fe640 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bb8da0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd900009f90 tx=0x7fd9000118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21b2087dd7fc332 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd906ffd640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8f00a32f0 0x7fd8f00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd8ed7fa640 1 -- 172.21.15.46:0/794426902 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900004b20 con 0x557f16bb89a0 2024-09-19T09:24:19.753 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd8effff640 1 -- 172.21.15.46:0/238777905 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd8fc0cfc30 con 0x7fd908104f00 2024-09-19T09:24:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd8ed7fa640 1 -- 172.21.15.46:0/794426902 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd900004cc0 con 0x557f16bb89a0 2024-09-19T09:24:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.740+0000 7fd8ed7fa640 1 -- 172.21.15.46:0/794426902 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900005020 con 0x557f16bb89a0 2024-09-19T09:24:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- 172.21.15.46:0/794426902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 msgr2=0x557f16bb8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd906ffd640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8f00a32f0 0x7fd8f00a57b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80314e0 tx=0x7fd8f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bb8da0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd900009f90 tx=0x7fd9000118d0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.754 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- 172.21.15.46:0/794426902 shutdown_connections 2024-09-19T09:24:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bbe370 0x557f16bc0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bbdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- 172.21.15.46:0/794426902 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bb8da0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- 172.21.15.46:0/794426902 >> 172.21.15.46:0/794426902 conn(0x557f16bb4010 msgr2=0x557f16bb4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- 172.21.15.46:0/794426902 shutdown_connections 2024-09-19T09:24:19.755 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- 172.21.15.46:0/794426902 wait complete. 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- start start 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 Processor -- start 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bc2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bc30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bbe370 0x557f16bca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x557f16bc1340 con 0x557f16bbe370 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x557f16aa5290 con 0x557f16bb89a0 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.741+0000 7fd910402740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557f16bc14c0 con 0x557f16bb92e0 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd910402740 10 client.0 _ll_register_callbacks cb 0x557f16ad6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bbe370 0x557f16bca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.756 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bc30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bc30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:40254/0 (socket says 172.21.15.46:40254) 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd906ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bc2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 -- 172.21.15.46:0/1578188839 learned_addr learned my addr 172.21.15.46:0/1578188839 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 -- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 msgr2=0x557f16bc2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bc2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 -- 172.21.15.46:0/1578188839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bbe370 msgr2=0x557f16bca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bbe370 0x557f16bca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 -- 172.21.15.46:0/1578188839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f1682f210 con 0x557f16bb92e0 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd9067fc640 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bc30b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc098c50 tx=0x7fd8fc09c110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a032fb546571e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd8eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd8eaff5640 1 -- 172.21.15.46:0/1578188839 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc09c980 con 0x557f16bb92e0 2024-09-19T09:24:19.757 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd8eaff5640 1 -- 172.21.15.46:0/1578188839 <== mon.1 v2:172.21.15.115:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd8fc0a4a60 con 0x557f16bb92e0 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.742+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd900004cc0 con 0x557f16bb92e0 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd8eaff5640 1 -- 172.21.15.46:0/1578188839 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd8fc09c280 con 0x557f16bb92e0 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 10 client.26149 fetch_fsmap learned FSMap version 40 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557f168fb620 con 0x557f16bb92e0 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd8eaff5640 1 -- 172.21.15.46:0/1578188839 <== mon.1 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd900004cc0 con 0x557f16bb92e0 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd8eaff5640 1 -- 172.21.15.46:0/1578188839 <== mon.1 v2:172.21.15.115:3300/0 5 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fd8fc0d6070 con 0x557f16bb92e0 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 10 client.26149 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 10 client.26149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 20 client.26149 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16bd0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.758 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 4 client.26149 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f16b29a20 con 0x557f16bce870 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.743+0000 7fd906ffd640 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16bd0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.744+0000 7fd8eaff5640 10 client.26149 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.744+0000 7fd906ffd640 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16bd0c60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a53c6b632e6d6a4c server_cookie=5b039b5627898e76 in_seq=0 out_seq=0 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd8eaff5640 1 -- 172.21.15.46:0/1578188839 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f16b29a20 con 0x557f16bce870 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd8eaff5640 10 client.26149 handle_command_reply: tid=0 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 client.26149 shutdown 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 msgr2=0x557f16bc30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.759 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bc30b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc098c50 tx=0x7fd8fc09c110 comp rx=0 tx=0).stop 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 shutdown_connections 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16bd0c60 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd8eaff5640 0 client.26149 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bbe370 0x557f16bca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bb92e0 0x557f16bc30b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 --2- 172.21.15.46:0/1578188839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bc2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 >> 172.21.15.46:0/1578188839 conn(0x557f16bb4010 msgr2=0x557f16bb5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 shutdown_connections 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 1 -- 172.21.15.46:0/1578188839 wait complete. 2024-09-19T09:24:19.760 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.746+0000 7fd910402740 20 client.26149 trim_cache size 0 max 16384 2024-09-19T09:24:19.765 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.761+0000 7fd910402740 1 Processor -- start 2024-09-19T09:24:19.765 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.761+0000 7fd910402740 1 -- start start 2024-09-19T09:24:19.765 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd910402740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bb30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.765 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd910402740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 0x557f16bca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd910402740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bb5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd910402740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081ab190 con 0x557f16bb92e0 2024-09-19T09:24:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd910402740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081accd0 con 0x557f16bb89a0 2024-09-19T09:24:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd910402740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081ab860 con 0x557f16bbe370 2024-09-19T09:24:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 0x557f16bca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.766 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 0x557f16bca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47170/0 (socket says 172.21.15.46:47170) 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bb30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd9067fc640 1 -- 172.21.15.46:0/1333903462 learned_addr learned my addr 172.21.15.46:0/1333903462 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd9077fe640 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bb5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 -- 172.21.15.46:0/1333903462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 msgr2=0x557f16bb5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bb5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 -- 172.21.15.46:0/1333903462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 msgr2=0x557f16bca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 0x557f16bca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 -- 172.21.15.46:0/1333903462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f16bc1520 con 0x557f16bb89a0 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd9077fe640 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bb5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:19.767 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd9067fc640 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 0x557f16bca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.762+0000 7fd906ffd640 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bb30b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8031440 tx=0x7fd8f803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b741af3395a6c88d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.763+0000 7fd8ecff9640 1 -- 172.21.15.46:0/1333903462 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8035040 con 0x557f16bb89a0 2024-09-19T09:24:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.763+0000 7fd8ecff9640 1 -- 172.21.15.46:0/1333903462 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8f8059070 con 0x557f16bb89a0 2024-09-19T09:24:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.763+0000 7fd8ecff9640 1 -- 172.21.15.46:0/1333903462 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8003850 con 0x557f16bb89a0 2024-09-19T09:24:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.763+0000 7fd910402740 1 -- 172.21.15.46:0/1333903462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 msgr2=0x557f16bb30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.768 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.763+0000 7fd910402740 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bb30b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8031440 tx=0x7fd8f803f000 comp rx=0 tx=0).stop 2024-09-19T09:24:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.764+0000 7fd910402740 1 -- 172.21.15.46:0/1333903462 shutdown_connections 2024-09-19T09:24:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.764+0000 7fd910402740 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb92e0 0x557f16bca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.764+0000 7fd910402740 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bb5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.773 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.764+0000 7fd910402740 1 --2- 172.21.15.46:0/1333903462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb89a0 0x557f16bb30b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.764+0000 7fd910402740 1 -- 172.21.15.46:0/1333903462 >> 172.21.15.46:0/1333903462 conn(0x557f16bb4010 msgr2=0x557f16bb29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.765+0000 7fd910402740 1 -- 172.21.15.46:0/1333903462 shutdown_connections 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.765+0000 7fd910402740 1 -- 172.21.15.46:0/1333903462 wait complete. 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.765+0000 7fd910402740 1 -- start start 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.765+0000 7fd910402740 1 Processor -- start 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bc7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.774 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 0x557f16bc7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bc8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd906ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bc7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 0x557f16bc7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd906ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bc7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47172/0 (socket says 172.21.15.46:47172) 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd906ffd640 1 -- 172.21.15.46:0/4015626319 learned_addr learned my addr 172.21.15.46:0/4015626319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd9067fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 0x557f16bc7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.46:38598/0 (socket says 172.21.15.46:38598) 2024-09-19T09:24:19.775 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081ac600 con 0x557f16bb89a0 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081abf30 con 0x557f16bb92e0 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd9081a9170 con 0x557f16bbe370 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd910402740 10 client.0 _ll_register_callbacks cb 0x7fd8fc0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd9077fe640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bc8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.766+0000 7fd906ffd640 1 -- 172.21.15.46:0/4015626319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 msgr2=0x557f16bc8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd906ffd640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bc8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd906ffd640 1 -- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 msgr2=0x557f16bc7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.776 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd906ffd640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 0x557f16bc7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd906ffd640 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f16bc95f0 con 0x557f16bb89a0 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd9067fc640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 0x557f16bc7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd906ffd640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bc7a90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd8f802a930 tx=0x7fd8f8004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff354f760d4fe4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd8eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd8eaff5640 1 -- 172.21.15.46:0/4015626319 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8061070 con 0x557f16bb89a0 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd8eaff5640 1 -- 172.21.15.46:0/4015626319 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd8f8003a00 con 0x557f16bb89a0 2024-09-19T09:24:19.777 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f8059070 con 0x557f16bb89a0 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd8eaff5640 1 -- 172.21.15.46:0/4015626319 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd8f806d070 con 0x557f16bb89a0 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd910402740 10 client.16755 fetch_fsmap learned FSMap version 40 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.767+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x557f16c39840 con 0x557f16bb89a0 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd8eaff5640 1 -- 172.21.15.46:0/4015626319 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8f8059070 con 0x557f16bb89a0 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd8eaff5640 1 -- 172.21.15.46:0/4015626319 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fd8f80533a0 con 0x557f16bb89a0 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd910402740 10 client.16755 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd910402740 10 client.16755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:19.778 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd910402740 20 client.16755 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd910402740 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16c3c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd910402740 4 client.16755 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f16b23d70 con 0x557f16bce870 2024-09-19T09:24:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd9067fc640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16c3c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd8eaff5640 10 client.16755 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:19.779 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.768+0000 7fd9067fc640 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16c3c1f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bda3888b803d76b server_cookie=d376f28ffe853706 in_seq=0 out_seq=0 2024-09-19T09:24:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.783+0000 7fd8eaff5640 1 -- 172.21.15.46:0/4015626319 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f16b23d70 con 0x557f16bce870 2024-09-19T09:24:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.783+0000 7fd8eaff5640 10 client.16755 handle_command_reply: tid=0 2024-09-19T09:24:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.783+0000 7fd910402740 1 client.16755 shutdown 2024-09-19T09:24:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 msgr2=0x557f16bc7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bc7a90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd8f802a930 tx=0x7fd8f8004990 comp rx=0 tx=0).stop 2024-09-19T09:24:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 shutdown_connections 2024-09-19T09:24:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x557f16bce870 0x557f16c3c1f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557f16bbe370 0x557f16bc8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd8eaff5640 0 client.16755 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557f16bb92e0 0x557f16bc7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 --2- 172.21.15.46:0/4015626319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x557f16bb89a0 0x557f16bc7a90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 >> 172.21.15.46:0/4015626319 conn(0x557f16bb4010 msgr2=0x557f16bb31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 shutdown_connections 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 1 -- 172.21.15.46:0/4015626319 wait complete. 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd910402740 20 client.16755 trim_cache size 0 max 16384 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:24:19.787 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:24:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8f00a32f0 msgr2=0x7fd8f00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.788 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8f00a32f0 0x7fd8f00a57b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80314e0 tx=0x7fd8f8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 msgr2=0x7fd90819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 0x7fd90819a5d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00e9f0 tx=0x7fd8fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 shutdown_connections 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd8f00a32f0 0x7fd8f00a57b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd908104f00 0x7fd90819a5d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd908107830 0x7fd9081a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 --2- 172.21.15.46:0/238777905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9081025d0 0x7fd90819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.789 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.784+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 >> 172.21.15.46:0/238777905 conn(0x7fd9080fc1b0 msgr2=0x7fd908101ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.785+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 shutdown_connections 2024-09-19T09:24:19.790 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:19.785+0000 7fd90d665640 1 -- 172.21.15.46:0/238777905 wait complete. 2024-09-19T09:24:20.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:20 smithi115 ceph-mon[35055]: pgmap v520: 97 pgs: 97 active+clean; 73 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.09k op/s 2024-09-19T09:24:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:20 smithi046 ceph-mon[31203]: pgmap v520: 97 pgs: 97 active+clean; 73 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.09k op/s 2024-09-19T09:24:20.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:20 smithi099 ceph-mon[35256]: pgmap v520: 97 pgs: 97 active+clean; 73 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 MiB/s rd, 2.7 MiB/s wr, 1.09k op/s 2024-09-19T09:24:22.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:22 smithi115 ceph-mon[35055]: pgmap v521: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 2.9 MiB/s wr, 1.08k op/s 2024-09-19T09:24:22.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:22 smithi046 ceph-mon[31203]: pgmap v521: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 2.9 MiB/s wr, 1.08k op/s 2024-09-19T09:24:22.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:22 smithi099 ceph-mon[35256]: pgmap v521: 97 pgs: 97 active+clean; 74 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 2.9 MiB/s wr, 1.08k op/s 2024-09-19T09:24:24.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:24 smithi115 ceph-mon[35055]: pgmap v522: 97 pgs: 97 active+clean; 70 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.11k op/s 2024-09-19T09:24:24.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:24 smithi046 ceph-mon[31203]: pgmap v522: 97 pgs: 97 active+clean; 70 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.11k op/s 2024-09-19T09:24:24.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:24 smithi099 ceph-mon[35256]: pgmap v522: 97 pgs: 97 active+clean; 70 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.11k op/s 2024-09-19T09:24:26.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:26 smithi115 ceph-mon[35055]: pgmap v523: 97 pgs: 97 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 1.07k op/s 2024-09-19T09:24:26.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:26 smithi046 ceph-mon[31203]: pgmap v523: 97 pgs: 97 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 1.07k op/s 2024-09-19T09:24:26.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:26 smithi099 ceph-mon[35256]: pgmap v523: 97 pgs: 97 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 1.07k op/s 2024-09-19T09:24:28.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:28 smithi046 ceph-mon[31203]: pgmap v524: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-19T09:24:28.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:28 smithi099 ceph-mon[35256]: pgmap v524: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-19T09:24:28.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:28 smithi115 ceph-mon[35055]: pgmap v524: 97 pgs: 97 active+clean; 71 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 MiB/s rd, 2.8 MiB/s wr, 1.06k op/s 2024-09-19T09:24:29.221 INFO:tasks.workunit.client.0.smithi046.stdout:All 50000 operations completed A-OK! 2024-09-19T09:24:29.226 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:24:29.226 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:24:30.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:30 smithi046 ceph-mon[31203]: pgmap v525: 97 pgs: 97 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-19T09:24:30.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:30 smithi099 ceph-mon[35256]: pgmap v525: 97 pgs: 97 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-19T09:24:30.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:30 smithi115 ceph-mon[35055]: pgmap v525: 97 pgs: 97 active+clean; 72 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.8 MiB/s wr, 1.07k op/s 2024-09-19T09:24:32.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:32 smithi046 ceph-mon[31203]: pgmap v526: 97 pgs: 97 active+clean; 69 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 1.02k op/s 2024-09-19T09:24:32.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:32 smithi099 ceph-mon[35256]: pgmap v526: 97 pgs: 97 active+clean; 69 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 1.02k op/s 2024-09-19T09:24:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 -- 172.21.15.46:0/3135381941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5594100a40 msgr2=0x7f5594100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 --2- 172.21.15.46:0/3135381941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5594100a40 0x7f5594100e40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5584009900 tx=0x7f558402a410 comp rx=0 tx=0).stop 2024-09-19T09:24:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 -- 172.21.15.46:0/3135381941 shutdown_connections 2024-09-19T09:24:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 --2- 172.21.15.46:0/3135381941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f55941025f0 0x7f5594108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.881 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 --2- 172.21.15.46:0/3135381941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594101c30 0x7f55941020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 --2- 172.21.15.46:0/3135381941 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5594100a40 0x7f5594100e40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 -- 172.21.15.46:0/3135381941 >> 172.21.15.46:0/3135381941 conn(0x7f55940fc1e0 msgr2=0x7f55940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 -- 172.21.15.46:0/3135381941 shutdown_connections 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.878+0000 7f559a65a640 1 -- 172.21.15.46:0/3135381941 wait complete. 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 Processor -- start 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 -- start start 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594100a40 0x7f55941049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5594101c30 0x7f5594103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55941025f0 0x7f5594103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f559410c6a0 con 0x7f55941025f0 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f559410c520 con 0x7f5594101c30 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f559a65a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f559410c820 con 0x7f5594100a40 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55941025f0 0x7f5594103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55941025f0 0x7f5594103550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59266/0 (socket says 172.21.15.46:59266) 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f5598bf7640 1 -- 172.21.15.46:0/3150310618 learned_addr learned my addr 172.21.15.46:0/3150310618 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f5593fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594100a40 0x7f55941049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.879+0000 7f55937fe640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5594101c30 0x7f5594103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f5593fff640 1 -- 172.21.15.46:0/3150310618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5594101c30 msgr2=0x7f5594103010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f5593fff640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5594101c30 0x7f5594103010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.883 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f5593fff640 1 -- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55941025f0 msgr2=0x7f5594103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f5593fff640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55941025f0 0x7f5594103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f5593fff640 1 -- 172.21.15.46:0/3150310618 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5594103de0 con 0x7f5594100a40 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f5593fff640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594100a40 0x7f55941049d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5584006010 tx=0x7f5584031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f55917fa640 1 -- 172.21.15.46:0/3150310618 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558403f070 con 0x7f5594100a40 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f55917fa640 1 -- 172.21.15.46:0/3150310618 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5584003cd0 con 0x7f5594100a40 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55941a1f60 con 0x7f5594100a40 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f55917fa640 1 -- 172.21.15.46:0/3150310618 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584035070 con 0x7f5594100a40 2024-09-19T09:24:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.880+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55941a2370 con 0x7f5594100a40 2024-09-19T09:24:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 Processor -- start 2024-09-19T09:24:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 -- start start 2024-09-19T09:24:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c29ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.889 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29b2e0 0x55cc6c29fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c2a0370 0x55cc6c2a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f55917fa640 1 -- 172.21.15.46:0/3150310618 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f558403b460 con 0x7f5594100a40 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cc6c1fe2f0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cc6c1a6270 con 0x55cc6c2a0370 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f559d3f5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cc6c1fa2b0 con 0x55cc6c29b2e0 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c29ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c29ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59280/0 (socket says 172.21.15.46:59280) 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f5598bf7640 1 -- 172.21.15.46:0/1565187516 learned_addr learned my addr 172.21.15.46:0/1565187516 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f55937fe640 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c2a0370 0x55cc6c2a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.883+0000 7f5593fff640 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29b2e0 0x55cc6c29fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5598bf7640 1 -- 172.21.15.46:0/1565187516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29b2e0 msgr2=0x55cc6c29fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.890 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5598bf7640 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29b2e0 0x55cc6c29fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5598bf7640 1 -- 172.21.15.46:0/1565187516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c2a0370 msgr2=0x55cc6c2a2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5598bf7640 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c2a0370 0x55cc6c2a2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5598bf7640 1 -- 172.21.15.46:0/1565187516 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc6c1a5340 con 0x55cc6c29a9a0 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f55937fe640 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c2a0370 0x55cc6c2a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5598bf7640 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c29ada0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f558c0104d0 tx=0x7f558c010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeb60bce28d1c30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f55917fa640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f557c0a32f0 0x7f557c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f557a7fc640 1 -- 172.21.15.46:0/1565187516 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c011760 con 0x55cc6c29a9a0 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f5593fff640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f557c0a32f0 0x7f557c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f55917fa640 1 -- 172.21.15.46:0/3150310618 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f55840efd60 con 0x7f5594100a40 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f557a7fc640 1 -- 172.21.15.46:0/1565187516 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f558c011de0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.884+0000 7f557a7fc640 1 -- 172.21.15.46:0/1565187516 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0193d0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.891 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 -- 172.21.15.46:0/1565187516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 msgr2=0x55cc6c29ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f5593fff640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f557c0a32f0 0x7f557c0a57b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f55840edc00 tx=0x7f55840f3840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c29ada0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f558c0104d0 tx=0x7f558c010990 comp rx=0 tx=0).stop 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 -- 172.21.15.46:0/1565187516 shutdown_connections 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c2a0370 0x55cc6c2a2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29b2e0 0x55cc6c29fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 --2- 172.21.15.46:0/1565187516 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c29ada0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.885+0000 7f559d3f5740 1 -- 172.21.15.46:0/1565187516 >> 172.21.15.46:0/1565187516 conn(0x55cc6c296010 msgr2=0x55cc6c296410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 -- 172.21.15.46:0/1565187516 shutdown_connections 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 -- 172.21.15.46:0/1565187516 wait complete. 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 -- start start 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 Processor -- start 2024-09-19T09:24:32.892 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c2a0370 0x55cc6c2ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x55cc6c2a3340 con 0x55cc6c29a9a0 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x55cc6c187290 con 0x55cc6c29b2e0 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55cc6c2a34c0 con 0x55cc6c2a0370 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f559d3f5740 10 client.0 _ll_register_callbacks cb 0x55cc6c1b8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.886+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59284/0 (socket says 172.21.15.46:59284) 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 -- 172.21.15.46:0/3794110770 learned_addr learned my addr 172.21.15.46:0/3794110770 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f55937fe640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c2a0370 0x55cc6c2ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.893 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 -- 172.21.15.46:0/3794110770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c2a0370 msgr2=0x55cc6c2ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c2a0370 0x55cc6c2ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 -- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 msgr2=0x55cc6c2a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 -- 172.21.15.46:0/3794110770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc6bf11210 con 0x55cc6c29a9a0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f55937fe640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a4ba0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f558c00ea00 tx=0x7f558c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0b3c671b2a33e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f55737fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f55737fe640 1 -- 172.21.15.46:0/3794110770 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c004e50 con 0x55cc6c29a9a0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f558c011de0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f55737fe640 1 -- 172.21.15.46:0/3794110770 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f558c003970 con 0x55cc6c29a9a0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f55737fe640 1 -- 172.21.15.46:0/3794110770 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f558c030070 con 0x55cc6c29a9a0 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f559d3f5740 10 client.16767 fetch_fsmap learned FSMap version 41 2024-09-19T09:24:32.894 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.887+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55cc6bfdd620 con 0x55cc6c29a9a0 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f55737fe640 1 -- 172.21.15.46:0/3794110770 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f558c011de0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f55737fe640 1 -- 172.21.15.46:0/3794110770 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f558c0052b0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f559d3f5740 10 client.16767 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f559d3f5740 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f559d3f5740 20 client.16767 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c2b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f559d3f5740 4 client.16767 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc6c20ba20 con 0x55cc6c2b05e0 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.888+0000 7f55937fe640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c2b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.889+0000 7f55737fe640 10 client.16767 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:32.895 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.889+0000 7f55937fe640 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c2b29d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=318ac8c756dcd649 server_cookie=dcfe0636de9f6412 in_seq=0 out_seq=0 2024-09-19T09:24:32.896 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.889+0000 7f55737fe640 1 -- 172.21.15.46:0/3794110770 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc6c20ba20 con 0x55cc6c2b05e0 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.889+0000 7f55737fe640 10 client.16767 handle_command_reply: tid=0 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.889+0000 7f559d3f5740 1 client.16767 shutdown 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 msgr2=0x55cc6c2a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a4ba0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f558c00ea00 tx=0x7f558c009c90 comp rx=0 tx=0).stop 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 shutdown_connections 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c2b29d0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c2a0370 0x55cc6c2ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f55737fe640 0 client.16767 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3794110770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a4ba0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.897 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 >> 172.21.15.46:0/3794110770 conn(0x55cc6c296010 msgr2=0x55cc6c297820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 shutdown_connections 2024-09-19T09:24:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 1 -- 172.21.15.46:0/3794110770 wait complete. 2024-09-19T09:24:32.898 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.890+0000 7f559d3f5740 20 client.16767 trim_cache size 0 max 16384 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 Processor -- start 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 -- start start 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c296ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c297400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f55941ab110 con 0x55cc6c2a0370 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f55941acc50 con 0x55cc6c29b2e0 2024-09-19T09:24:32.907 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f559d3f5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f55941ab7e0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c297400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c297400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59292/0 (socket says 172.21.15.46:59292) 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f5598bf7640 1 -- 172.21.15.46:0/3789563537 learned_addr learned my addr 172.21.15.46:0/3789563537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f55937fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.905+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c296ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5598bf7640 1 -- 172.21.15.46:0/3789563537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 msgr2=0x55cc6c296ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c296ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5598bf7640 1 -- 172.21.15.46:0/3789563537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 msgr2=0x55cc6c2ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5598bf7640 1 -- 172.21.15.46:0/3789563537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc6c2b2f40 con 0x55cc6c2a0370 2024-09-19T09:24:32.908 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f55937fe640 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5598bf7640 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c297400 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55cc6c29b7e0 tx=0x7f558c010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3901d85e7027f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5579ffb640 1 -- 172.21.15.46:0/3789563537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0058f0 con 0x55cc6c2a0370 2024-09-19T09:24:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5579ffb640 1 -- 172.21.15.46:0/3789563537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f558c020040 con 0x55cc6c2a0370 2024-09-19T09:24:32.909 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.906+0000 7f5579ffb640 1 -- 172.21.15.46:0/3789563537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c004310 con 0x55cc6c2a0370 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 -- 172.21.15.46:0/3789563537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 msgr2=0x55cc6c297400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c297400 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55cc6c29b7e0 tx=0x7f558c010990 comp rx=0 tx=0).stop 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 -- 172.21.15.46:0/3789563537 shutdown_connections 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c297400 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 --2- 172.21.15.46:0/3789563537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c296ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 -- 172.21.15.46:0/3789563537 >> 172.21.15.46:0/3789563537 conn(0x55cc6c296010 msgr2=0x55cc6c2a4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 -- 172.21.15.46:0/3789563537 shutdown_connections 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.907+0000 7f559d3f5740 1 -- 172.21.15.46:0/3789563537 wait complete. 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 -- start start 2024-09-19T09:24:32.913 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 Processor -- start 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c2aab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f55941ac580 con 0x55cc6c2a0370 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f55941abeb0 con 0x55cc6c29b2e0 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f55941a90f0 con 0x55cc6c29a9a0 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.908+0000 7f559d3f5740 10 client.0 _ll_register_callbacks cb 0x7f55880097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c2aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.914 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c2aab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59296/0 (socket says 172.21.15.46:59296) 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 -- 172.21.15.46:0/2603119274 learned_addr learned my addr 172.21.15.46:0/2603119274 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f55937fe640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 -- 172.21.15.46:0/2603119274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 msgr2=0x55cc6c2a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 -- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 msgr2=0x55cc6c2a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 -- 172.21.15.46:0/2603119274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc6c2ab160 con 0x55cc6c2a0370 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f5598bf7640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c2aab50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f558c00a010 tx=0x7f558c009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c300a40f322671d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f55737fe640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f55737fe640 1 -- 172.21.15.46:0/2603119274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c003970 con 0x55cc6c2a0370 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f55737fe640 1 -- 172.21.15.46:0/2603119274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f558c003b10 con 0x55cc6c2a0370 2024-09-19T09:24:32.915 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.909+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f558c020040 con 0x55cc6c2a0370 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f55737fe640 1 -- 172.21.15.46:0/2603119274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f558c003d10 con 0x55cc6c2a0370 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 10 client.16773 fetch_fsmap learned FSMap version 41 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55cc6c31b1d0 con 0x55cc6c2a0370 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f55737fe640 1 -- 172.21.15.46:0/2603119274 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f558c020040 con 0x55cc6c2a0370 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f55737fe640 1 -- 172.21.15.46:0/2603119274 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 41) ==== 8370+0+0 (secure 0 0 0) 0x7f558c042040 con 0x55cc6c2a0370 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 10 client.16773 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 10 client.16773 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 20 client.16773 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c31d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 4 client.16773 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc6c205d70 con 0x55cc6c2b05e0 2024-09-19T09:24:32.916 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.910+0000 7f55937fe640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c31d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.911+0000 7f55937fe640 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c31d960 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465922d072961087 server_cookie=db633b1c31f21d44 in_seq=0 out_seq=0 2024-09-19T09:24:32.917 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.911+0000 7f55737fe640 10 client.16773 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f55737fe640 1 -- 172.21.15.46:0/2603119274 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc6c205d70 con 0x55cc6c2b05e0 2024-09-19T09:24:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f55737fe640 10 client.16773 handle_command_reply: tid=0 2024-09-19T09:24:32.931 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 client.16773 shutdown 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 msgr2=0x55cc6c2aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c2aab50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f558c00a010 tx=0x7f558c009e50 comp rx=0 tx=0).stop 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 shutdown_connections 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x55cc6c2b05e0 0x55cc6c31d960 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x55cc6c2a0370 0x55cc6c2aab50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55cc6c29b2e0 0x55cc6c2a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f55737fe640 0 client.16773 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 --2- 172.21.15.46:0/2603119274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55cc6c29a9a0 0x55cc6c2a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 >> 172.21.15.46:0/2603119274 conn(0x55cc6c296010 msgr2=0x55cc6c2949a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 shutdown_connections 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 1 -- 172.21.15.46:0/2603119274 wait complete. 2024-09-19T09:24:32.932 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.930+0000 7f559d3f5740 20 client.16773 trim_cache size 0 max 16384 2024-09-19T09:24:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:{ 2024-09-19T09:24:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "message": "", 2024-09-19T09:24:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout: "return_code": 0 2024-09-19T09:24:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stdout:} 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f557c0a32f0 msgr2=0x7f557c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f557c0a32f0 0x7f557c0a57b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f55840edc00 tx=0x7f55840f3840 comp rx=0 tx=0).stop 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594100a40 msgr2=0x7f55941049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594100a40 0x7f55941049d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5584006010 tx=0x7f5584031b60 comp rx=0 tx=0).stop 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 shutdown_connections 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f557c0a32f0 0x7f557c0a57b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55941025f0 0x7f5594103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.934 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5594101c30 0x7f5594103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 --2- 172.21.15.46:0/3150310618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5594100a40 0x7f55941049d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 >> 172.21.15.46:0/3150310618 conn(0x7f55940fc1e0 msgr2=0x7f55940fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 shutdown_connections 2024-09-19T09:24:32.935 INFO:teuthology.task.background_exec.ubuntu@smithi046.front.sepia.ceph.com.smithi046.stderr:2024-09-19T09:24:32.931+0000 7f559a65a640 1 -- 172.21.15.46:0/3150310618 wait complete. 2024-09-19T09:24:32.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:32 smithi115 ceph-mon[35055]: pgmap v526: 97 pgs: 97 active+clean; 69 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 MiB/s rd, 2.7 MiB/s wr, 1.02k op/s 2024-09-19T09:24:33.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:33 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:33.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:33 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:33.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:33 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:34.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:34 smithi046 ceph-mon[31203]: pgmap v527: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 937 op/s 2024-09-19T09:24:34.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:34 smithi099 ceph-mon[35256]: pgmap v527: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 937 op/s 2024-09-19T09:24:34.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:34 smithi115 ceph-mon[35055]: pgmap v527: 97 pgs: 97 active+clean; 67 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 2.4 MiB/s wr, 937 op/s 2024-09-19T09:24:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:36 smithi099 ceph-mon[35256]: pgmap v528: 97 pgs: 97 active+clean; 65 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 804 op/s 2024-09-19T09:24:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:36 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:24:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:24:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:24:36.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:36 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:24:36.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:36 smithi115 ceph-mon[35055]: pgmap v528: 97 pgs: 97 active+clean; 65 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 804 op/s 2024-09-19T09:24:36.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:36 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:36.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:24:36.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:24:36.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:24:36.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:36 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:24:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:36 smithi046 ceph-mon[31203]: pgmap v528: 97 pgs: 97 active+clean; 65 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 2.3 MiB/s wr, 804 op/s 2024-09-19T09:24:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:36 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:24:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:24:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:24:36.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:36 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' 2024-09-19T09:24:38.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:38 smithi099 ceph-mon[35256]: pgmap v529: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 775 op/s 2024-09-19T09:24:38.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:38 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:38.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:38 smithi115 ceph-mon[35055]: pgmap v529: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 775 op/s 2024-09-19T09:24:38.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:38 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:38 smithi046 ceph-mon[31203]: pgmap v529: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 775 op/s 2024-09-19T09:24:38.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:38 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:40.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:40 smithi099 ceph-mon[35256]: pgmap v530: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.8 MiB/s wr, 679 op/s 2024-09-19T09:24:40.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:40 smithi115 ceph-mon[35055]: pgmap v530: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.8 MiB/s wr, 679 op/s 2024-09-19T09:24:40.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:40 smithi046 ceph-mon[31203]: pgmap v530: 97 pgs: 97 active+clean; 56 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 1.8 MiB/s wr, 679 op/s 2024-09-19T09:24:41.146 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-09-19T09:24:41.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:24:41.466 DEBUG:teuthology.parallel:result is None 2024-09-19T09:24:41.467 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:24:41.512 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:24:41.513 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:24:41.593 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:24:41.593 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:24:41.594 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:24:41.848 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:42.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 -- 172.21.15.46:0/4023759396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854102dd0 msgr2=0x7f98541031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 --2- 172.21.15.46:0/4023759396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854102dd0 0x7f98541031b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9844009930 tx=0x7f984402a420 comp rx=0 tx=0).stop 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 -- 172.21.15.46:0/4023759396 shutdown_connections 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 --2- 172.21.15.46:0/4023759396 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 0x7f985410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 --2- 172.21.15.46:0/4023759396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854103780 0x7f9854107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 --2- 172.21.15.46:0/4023759396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854102dd0 0x7f98541031b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 -- 172.21.15.46:0/4023759396 >> 172.21.15.46:0/4023759396 conn(0x7f98540fc7d0 msgr2=0x7f98540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 -- 172.21.15.46:0/4023759396 shutdown_connections 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.309+0000 7f9859cb0640 1 -- 172.21.15.46:0/4023759396 wait complete. 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 Processor -- start 2024-09-19T09:24:42.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 -- start start 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854102dd0 0x7f9854100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 0x7f9854100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 0x7f98541014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9854112090 con 0x7f9854103780 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9854111f10 con 0x7f9854102dd0 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9859cb0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9854112210 con 0x7f9854108300 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9852ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 0x7f9854100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f98537fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854102dd0 0x7f9854100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9852ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 0x7f9854100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58518/0 (socket says 172.21.15.46:58518) 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.310+0000 7f9852ffd640 1 -- 172.21.15.46:0/1252103935 learned_addr learned my addr 172.21.15.46:0/1252103935 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9853fff640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 0x7f98541014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:42.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f98537fe640 1 -- 172.21.15.46:0/1252103935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 msgr2=0x7f98541014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f98537fe640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 0x7f98541014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f98537fe640 1 -- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 msgr2=0x7f9854100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f98537fe640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 0x7f9854100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f98537fe640 1 -- 172.21.15.46:0/1252103935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98541a6a10 con 0x7f9854102dd0 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9852ffd640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 0x7f9854100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9853fff640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 0x7f98541014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f98537fe640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854102dd0 0x7f9854100a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9844005940 tx=0x7f98440042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984403f070 con 0x7f9854102dd0 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98541a6ca0 con 0x7f9854102dd0 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f984403b460 con 0x7f9854102dd0 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844035070 con 0x7f9854102dd0 2024-09-19T09:24:42.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.311+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98541a7180 con 0x7f9854102dd0 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.313+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98541031b0 con 0x7f9854102dd0 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.314+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f984403b610 con 0x7f9854102dd0 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.314+0000 7f9850ff9640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f983c0a3240 0x7f983c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.314+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f98440efeb0 con 0x7f9854102dd0 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.314+0000 7f9852ffd640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f983c0a3240 0x7f983c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.315+0000 7f9852ffd640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f983c0a3240 0x7f983c0a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f98541024c0 tx=0x7f984800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:42.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.319+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98440bcba0 con 0x7f9854102dd0 2024-09-19T09:24:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.570+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f985410a290 con 0x7f9854102dd0 2024-09-19T09:24:42.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.571+0000 7f9850ff9640 1 -- 172.21.15.46:0/1252103935 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11970 (secure 0 0 0) 0x7f98440bc4a0 con 0x7f9854102dd0 2024-09-19T09:24:42.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:24:42.572 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":44,"btime":"2024-09-19T09:24:42:491703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:24:41.930472+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24446,24472,24451,24463,24476]},"id":1}]} 2024-09-19T09:24:42.573 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 44 2024-09-19T09:24:42.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f983c0a3240 msgr2=0x7f983c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f983c0a3240 0x7f983c0a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f98541024c0 tx=0x7f984800b410 comp rx=0 tx=0).stop 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854102dd0 msgr2=0x7f9854100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854102dd0 0x7f9854100a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9844005940 tx=0x7f98440042f0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 shutdown_connections 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f983c0a3240 0x7f983c0a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9854103780 0x7f9854100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9854108300 0x7f98541014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 --2- 172.21.15.46:0/1252103935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9854102dd0 0x7f9854100a30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.574+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 >> 172.21.15.46:0/1252103935 conn(0x7f98540fc7d0 msgr2=0x7f9854105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.575+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 shutdown_connections 2024-09-19T09:24:42.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:42.575+0000 7f9859cb0640 1 -- 172.21.15.46:0/1252103935 wait complete. 2024-09-19T09:24:42.762 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:42 smithi115 ceph-mon[35055]: pgmap v531: 97 pgs: 97 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.6 MiB/s wr, 559 op/s 2024-09-19T09:24:42.762 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:42 smithi099 ceph-mon[35256]: pgmap v531: 97 pgs: 97 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.6 MiB/s wr, 559 op/s 2024-09-19T09:24:42.768 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:42 smithi046 ceph-mon[31203]: pgmap v531: 97 pgs: 97 active+clean; 58 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 1.6 MiB/s wr, 559 op/s 2024-09-19T09:24:43.395 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --cancel --all' 2024-09-19T09:24:43.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --cancel --all 2024-09-19T09:24:43.660 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:43 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:43.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:43 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1252103935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:43.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:43 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:43.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:43 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1252103935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:43.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:43 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:43.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:43 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1252103935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:24:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 -- 172.21.15.46:0/2330448807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 msgr2=0x7f8db8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 --2- 172.21.15.46:0/2330448807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db8100ee0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009930 tx=0x7f8da802a420 comp rx=0 tx=0).stop 2024-09-19T09:24:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 -- 172.21.15.46:0/2330448807 shutdown_connections 2024-09-19T09:24:44.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 --2- 172.21.15.46:0/2330448807 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db8100ee0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 --2- 172.21.15.46:0/2330448807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db8101420 0x7f8db810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 --2- 172.21.15.46:0/2330448807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8db8106a80 0x7f8db8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 -- 172.21.15.46:0/2330448807 >> 172.21.15.46:0/2330448807 conn(0x7f8db80fc7a0 msgr2=0x7f8db80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 -- 172.21.15.46:0/2330448807 shutdown_connections 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.131+0000 7f8dbf927640 1 -- 172.21.15.46:0/2330448807 wait complete. 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 Processor -- start 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 -- start start 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8db8101420 0x7f8db81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db8106a80 0x7f8db81a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8110e80 con 0x7f8db8100a80 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8110d00 con 0x7f8db8101420 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbf927640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8111000 con 0x7f8db8106a80 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db81992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58542/0 (socket says 172.21.15.46:58542) 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3115041751 learned_addr learned my addr 172.21.15.46:0/3115041751 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8db8101420 0x7f8db81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db8106a80 0x7f8db81a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3115041751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db8106a80 msgr2=0x7f8db81a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db8106a80 0x7f8db81a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3115041751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8db8101420 msgr2=0x7f8db81997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8db8101420 0x7f8db81997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.132+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3115041751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db81a4870 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.133+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db81992b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8db400d950 tx=0x7f8db400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.133+0000 7f8dae7fc640 1 -- 172.21.15.46:0/3115041751 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4017070 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.133+0000 7f8dae7fc640 1 -- 172.21.15.46:0/3115041751 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db4009c30 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.133+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db81a4a40 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.133+0000 7f8dae7fc640 1 -- 172.21.15.46:0/3115041751 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db400f6b0 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.133+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db81a4f50 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.136+0000 7f8dae7fc640 1 -- 172.21.15.46:0/3115041751 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8db40109d0 con 0x7f8db8100a80 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.136+0000 7f8dc1d00740 1 Processor -- start 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.136+0000 7f8dc1d00740 1 -- start start 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebe900 0x5608e0ebece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0ecdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ecdff0 0x5608e0ed03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5608e0e23200 con 0x5608e0ebf220 2024-09-19T09:24:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5608e0dc9dc0 con 0x5608e0ebe900 2024-09-19T09:24:44.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5608e0e1f1c0 con 0x5608e0ecdff0 2024-09-19T09:24:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0ecdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0ecdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58552/0 (socket says 172.21.15.46:58552) 2024-09-19T09:24:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/1350882077 learned_addr learned my addr 172.21.15.46:0/1350882077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebe900 0x5608e0ebece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ecdff0 0x5608e0ed03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dae7fc640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8da40a32c0 0x7f8da40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/1350882077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ecdff0 msgr2=0x5608e0ed03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ecdff0 0x5608e0ed03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/1350882077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebe900 msgr2=0x5608e0ebece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebe900 0x5608e0ebece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/1350882077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e0b94620 con 0x5608e0ebf220 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebe900 0x5608e0ebece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8da40a32c0 0x7f8da40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dae7fc640 1 -- 172.21.15.46:0/3115041751 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8db40cf500 con 0x7f8db8100a80 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.137+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0ecdab0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8db401c790 tx=0x7f8db4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b46a3c8084697a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8da37fe640 1 -- 172.21.15.46:0/1350882077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db409b690 con 0x5608e0ebf220 2024-09-19T09:24:44.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8da40a32c0 0x7f8da40a5780 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8db0005fd0 tx=0x7f8db0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8da37fe640 1 -- 172.21.15.46:0/1350882077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db4009de0 con 0x5608e0ebf220 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8da37fe640 1 -- 172.21.15.46:0/1350882077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db4011030 con 0x5608e0ebf220 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dc1d00740 1 -- 172.21.15.46:0/1350882077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 msgr2=0x5608e0ecdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0ecdab0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8db401c790 tx=0x7f8db4022000 comp rx=0 tx=0).stop 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dc1d00740 1 -- 172.21.15.46:0/1350882077 shutdown_connections 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0ecdab0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ecdff0 0x5608e0ed03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.138+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/1350882077 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebe900 0x5608e0ebece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- 172.21.15.46:0/1350882077 >> 172.21.15.46:0/1350882077 conn(0x5608e0ebaf90 msgr2=0x5608e0ebb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- 172.21.15.46:0/1350882077 shutdown_connections 2024-09-19T09:24:44.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- 172.21.15.46:0/1350882077 wait complete. 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- start start 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 Processor -- start 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ecd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ecab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ecdff0 0x5608e0ecb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x5608e0ed0bc0 con 0x5608e0ebe900 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x5608e0dbdc50 con 0x5608e0ecdff0 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5608e0ed0d40 con 0x5608e0ebf220 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dc1d00740 10 client.0 _ll_register_callbacks cb 0x5608e0dcfba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.139+0000 7f8dbd6c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ecd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ecd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58560/0 (socket says 172.21.15.46:58560) 2024-09-19T09:24:44.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3184777240 learned_addr learned my addr 172.21.15.46:0/3184777240 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ecdff0 0x5608e0ecb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ecab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3184777240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 msgr2=0x5608e0ecab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ecab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ecdff0 msgr2=0x5608e0ecb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ecdff0 0x5608e0ecb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 -- 172.21.15.46:0/3184777240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e0ecb880 con 0x5608e0ebe900 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ecd860 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8db40a4290 tx=0x7f8db4010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7eed5c2628b929 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8da0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3184777240 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db406dbd0 con 0x5608e0ebe900 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3184777240 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8db40d2c70 con 0x5608e0ebe900 2024-09-19T09:24:44.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8db4009de0 con 0x5608e0ebe900 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3184777240 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8db409b4b0 con 0x5608e0ebe900 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dc1d00740 10 client.16791 fetch_fsmap learned FSMap version 44 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.140+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5608e0edc6b0 con 0x5608e0ebe900 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3184777240 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db4009de0 con 0x5608e0ebe900 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3184777240 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 44) ==== 8390+0+0 (secure 0 0 0) 0x7f8db40981c0 con 0x5608e0ebe900 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dc1d00740 10 client.16791 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dc1d00740 10 client.16791 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dc1d00740 20 client.16791 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0edda00 0x5608e0edfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dc1d00740 4 client.16791 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608e0e30770 con 0x5608e0edda00 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.141+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0edda00 0x5608e0edfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0edda00 0x5608e0edfdf0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a545f76c93ee0a7 server_cookie=dd8f5dd8e87a9f7b in_seq=0 out_seq=0 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8da0ff9640 10 client.16791 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3184777240 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608e0e30770 con 0x5608e0edda00 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8da0ff9640 10 client.16791 handle_command_reply: tid=0 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 client.16791 shutdown 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 msgr2=0x5608e0ecd860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ecd860 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f8db40a4290 tx=0x7f8db4010d70 comp rx=0 tx=0).stop 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 shutdown_connections 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0edda00 0x5608e0edfdf0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ecdff0 0x5608e0ecb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ecab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8da0ff9640 0 client.16791 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3184777240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ecd860 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.142+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 >> 172.21.15.46:0/3184777240 conn(0x5608e0ebaf90 msgr2=0x5608e0eba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.143+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 shutdown_connections 2024-09-19T09:24:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.143+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3184777240 wait complete. 2024-09-19T09:24:44.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.143+0000 7f8dc1d00740 20 client.16791 trim_cache size 0 max 16384 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 Processor -- start 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 -- start start 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ed9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ec7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ec82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81ab290 con 0x5608e0ebe900 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81ace30 con 0x5608e0ebaf90 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.160+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81ab990 con 0x5608e0ebf220 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ec7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ec7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58568/0 (socket says 172.21.15.46:58568) 2024-09-19T09:24:44.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 -- 172.21.15.46:0/2610328289 learned_addr learned my addr 172.21.15.46:0/2610328289 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ed9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ec82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 -- 172.21.15.46:0/2610328289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 msgr2=0x5608e0ec82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ec82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 -- 172.21.15.46:0/2610328289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 msgr2=0x5608e0ed9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ed9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 -- 172.21.15.46:0/2610328289 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e0ebadc0 con 0x5608e0ebe900 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ec82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ec7d70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8da8005940 tx=0x7f8da80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d4ebc298316a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8da2ffd640 1 -- 172.21.15.46:0/2610328289 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8049070 con 0x5608e0ebe900 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8da2ffd640 1 -- 172.21.15.46:0/2610328289 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da8005520 con 0x5608e0ebe900 2024-09-19T09:24:44.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.161+0000 7f8da2ffd640 1 -- 172.21.15.46:0/2610328289 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8035040 con 0x5608e0ebe900 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 -- 172.21.15.46:0/2610328289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 msgr2=0x5608e0ec7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ec7d70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f8da8005940 tx=0x7f8da80058b0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 -- 172.21.15.46:0/2610328289 shutdown_connections 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebe900 0x5608e0ec7d70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebf220 0x5608e0ec82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/2610328289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ed9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 -- 172.21.15.46:0/2610328289 >> 172.21.15.46:0/2610328289 conn(0x5608e0ec6360 msgr2=0x5608e0ecc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 -- 172.21.15.46:0/2610328289 shutdown_connections 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 -- 172.21.15.46:0/2610328289 wait complete. 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 -- start start 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.162+0000 7f8dc1d00740 1 Processor -- start 2024-09-19T09:24:44.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ee3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebe900 0x5608e0ede950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0edeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81ac760 con 0x5608e0ebf220 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81ac090 con 0x5608e0ebaf90 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81a9270 con 0x5608e0ebe900 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dc1d00740 10 client.0 _ll_register_callbacks cb 0x7f8db409b9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0edeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0edeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58576/0 (socket says 172.21.15.46:58576) 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 -- 172.21.15.46:0/3913216699 learned_addr learned my addr 172.21.15.46:0/3913216699 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ee3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbcec2640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebe900 0x5608e0ede950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 -- 172.21.15.46:0/3913216699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebe900 msgr2=0x5608e0ede950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebe900 0x5608e0ede950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 -- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 msgr2=0x5608e0ee3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ee3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.163+0000 7f8dbdec4640 1 -- 172.21.15.46:0/3913216699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e0edf700 con 0x5608e0ebf220 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8dbdec4640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0edeed0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8db001d9e0 tx=0x7f8db0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a27c3274871768 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8da0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.46:3300/0 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3913216699 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db002c060 con 0x5608e0ebf220 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3913216699 <== mon.0 v2:172.21.15.46:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f8db001cd10 con 0x5608e0ebf220 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da8005520 con 0x5608e0ebf220 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3913216699 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8db001a430 con 0x5608e0ebf220 2024-09-19T09:24:44.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8dc1d00740 10 client.16797 fetch_fsmap learned FSMap version 44 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5608e0f48450 con 0x5608e0ebf220 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3913216699 <== mon.0 v2:172.21.15.46:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8da8005520 con 0x5608e0ebf220 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3913216699 <== mon.0 v2:172.21.15.46:3300/0 5 ==== fsmap(e 44) ==== 8390+0+0 (secure 0 0 0) 0x7f8db0026030 con 0x5608e0ebf220 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.164+0000 7f8dc1d00740 10 client.16797 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dc1d00740 10 client.16797 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dc1d00740 20 client.16797 populate_metadata read hostname 'smithi046' 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0ecdff0 0x5608e0f4ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dc1d00740 4 client.16797 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:24:44.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 --> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5608e0e2ac80 con 0x5608e0ecdff0 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0ecdff0 0x5608e0f4ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8dbd6c3640 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0ecdff0 0x5608e0f4ac30 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6edd78e5e0e45e73 server_cookie=22b32dbd38339686 in_seq=0 out_seq=0 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8da0ff9640 10 client.16797 ms_handle_connect on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8da0ff9640 1 -- 172.21.15.46:0/3913216699 <== mds.0 v2:172.21.15.99:6838/718433968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5608e0e2ac80 con 0x5608e0ecdff0 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.165+0000 7f8da0ff9640 10 client.16797 handle_command_reply: tid=0 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 client.16797 shutdown 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 msgr2=0x5608e0edeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0edeed0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8db001d9e0 tx=0x7f8db0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 shutdown_connections 2024-09-19T09:24:44.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:6838/718433968,v1:172.21.15.99:6839/718433968] conn(0x5608e0ecdff0 0x5608e0f4ac30 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x5608e0ebf220 0x5608e0edeed0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5608e0ebe900 0x5608e0ede950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8da0ff9640 0 client.16797 ms_handle_reset on v2:172.21.15.99:6838/718433968 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 --2- 172.21.15.46:0/3913216699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5608e0ebaf90 0x5608e0ee3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 >> 172.21.15.46:0/3913216699 conn(0x5608e0ec6360 msgr2=0x5608e0ec0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 shutdown_connections 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 1 -- 172.21.15.46:0/3913216699 wait complete. 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dc1d00740 20 client.16797 trim_cache size 0 max 16384 2024-09-19T09:24:44.191 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:24:44.192 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 44, 2024-09-19T09:24:44.192 INFO:teuthology.orchestra.run.smithi046.stdout: "leader": 24476, 2024-09-19T09:24:44.192 INFO:teuthology.orchestra.run.smithi046.stdout: "set_version": 24, 2024-09-19T09:24:44.192 INFO:teuthology.orchestra.run.smithi046.stdout: "sets": {} 2024-09-19T09:24:44.192 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8da40a32c0 msgr2=0x7f8da40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dbf927640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8da40a32c0 0x7f8da40a5780 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8db0005fd0 tx=0x7f8db0004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 msgr2=0x7f8db81992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.166+0000 7f8dbf927640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db81992b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8db400d950 tx=0x7f8db400de10 comp rx=0 tx=0).stop 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 shutdown_connections 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f8da40a32c0 0x7f8da40a5780 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8db8106a80 0x7f8db81a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8db8101420 0x7f8db81997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 --2- 172.21.15.46:0/3115041751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8db8100a80 0x7f8db81992b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 >> 172.21.15.46:0/3115041751 conn(0x7f8db80fc7a0 msgr2=0x7f8db80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 shutdown_connections 2024-09-19T09:24:44.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:44.167+0000 7f8dbf927640 1 -- 172.21.15.46:0/3115041751 wait complete. 2024-09-19T09:24:44.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:44 smithi099 ceph-mon[35256]: pgmap v532: 97 pgs: 97 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 527 op/s 2024-09-19T09:24:44.883 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:44 smithi046 ceph-mon[31203]: pgmap v532: 97 pgs: 97 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 527 op/s 2024-09-19T09:24:44.911 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:24:44.911 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:24:45.128 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:24:45.129 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:44 smithi115 ceph-mon[35055]: pgmap v532: 97 pgs: 97 active+clean; 57 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 527 op/s 2024-09-19T09:24:45.136 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:24:45.159 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:24:45.159 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T09:24:45.160 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:24:45.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 -- 172.21.15.46:0/395841338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff908101b30 msgr2=0x7ff908101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 --2- 172.21.15.46:0/395841338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff908101b30 0x7ff908101f30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009900 tx=0x7ff8f802a410 comp rx=0 tx=0).stop 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 -- 172.21.15.46:0/395841338 shutdown_connections 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 --2- 172.21.15.46:0/395841338 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9081036e0 0x7ff908109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 --2- 172.21.15.46:0/395841338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908102d20 0x7ff9081031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 --2- 172.21.15.46:0/395841338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff908101b30 0x7ff908101f30 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.282+0000 7ff90e35b640 1 -- 172.21.15.46:0/395841338 >> 172.21.15.46:0/395841338 conn(0x7ff9080fd2b0 msgr2=0x7ff9080ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 -- 172.21.15.46:0/395841338 shutdown_connections 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 -- 172.21.15.46:0/395841338 wait complete. 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 Processor -- start 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 -- start start 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908101b30 0x7ff908197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff908102d20 0x7ff9081983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 0x7ff90819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff90810d800 con 0x7ff9081036e0 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff90810d680 con 0x7ff908101b30 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.283+0000 7ff90e35b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff90810d980 con 0x7ff908102d20 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 0x7ff90819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 0x7ff90819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58602/0 (socket says 172.21.15.46:58602) 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 -- 172.21.15.46:0/2108824071 learned_addr learned my addr 172.21.15.46:0/2108824071 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff907fff640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908101b30 0x7ff908197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff9077fe640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff908102d20 0x7ff9081983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 -- 172.21.15.46:0/2108824071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff908102d20 msgr2=0x7ff9081983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff908102d20 0x7ff9081983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 -- 172.21.15.46:0/2108824071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908101b30 msgr2=0x7ff908197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908101b30 0x7ff908197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 -- 172.21.15.46:0/2108824071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90819fad0 con 0x7ff9081036e0 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff907fff640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908101b30 0x7ff908197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90c8f8640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 0x7ff90819f460 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff90000cad0 tx=0x7ff90000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90000ae20 con 0x7ff9081036e0 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff900005020 con 0x7ff9081036e0 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90819fdc0 con 0x7ff9081036e0 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90000f6f0 con 0x7ff9081036e0 2024-09-19T09:24:45.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.284+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9081a02e0 con 0x7ff9081036e0 2024-09-19T09:24:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.285+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff908108f20 con 0x7ff9081036e0 2024-09-19T09:24:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.287+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff9000051d0 con 0x7ff9081036e0 2024-09-19T09:24:45.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.287+0000 7ff9057fa640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff8f00a32d0 0x7ff8f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.287+0000 7ff907fff640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff8f00a32d0 0x7ff8f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.287+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7ff9000cfc40 con 0x7ff9081036e0 2024-09-19T09:24:45.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.288+0000 7ff907fff640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff8f00a32d0 0x7ff8f00a5790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8f802aa00 tx=0x7ff8f8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.291+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff900014030 con 0x7ff9081036e0 2024-09-19T09:24:45.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.467+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff90802da10 con 0x7ff9081036e0 2024-09-19T09:24:45.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.468+0000 7ff9057fa640 1 -- 172.21.15.46:0/2108824071 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22631 (secure 0 0 0) 0x7ff90009ca10 con 0x7ff9081036e0 2024-09-19T09:24:45.470 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:24:45.470 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":85,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:21:28.876836+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:45.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff8f00a32d0 msgr2=0x7ff8f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff8f00a32d0 0x7ff8f00a5790 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8f802aa00 tx=0x7ff8f8031400 comp rx=0 tx=0).stop 2024-09-19T09:24:45.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 msgr2=0x7ff90819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 0x7ff90819f460 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff90000cad0 tx=0x7ff90000cf90 comp rx=0 tx=0).stop 2024-09-19T09:24:45.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 shutdown_connections 2024-09-19T09:24:45.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff8f00a32d0 0x7ff8f00a5790 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9081036e0 0x7ff90819f460 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff908102d20 0x7ff9081983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 --2- 172.21.15.46:0/2108824071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff908101b30 0x7ff908197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 >> 172.21.15.46:0/2108824071 conn(0x7ff9080fd2b0 msgr2=0x7ff9081060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 shutdown_connections 2024-09-19T09:24:45.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.471+0000 7ff90e35b640 1 -- 172.21.15.46:0/2108824071 wait complete. 2024-09-19T09:24:45.483 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:11:45.380119+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:16:20.505085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:16:22.965130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:24:45.484 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:24:45.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 -- 172.21.15.46:0/1882215621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508104f40 msgr2=0x7fd508107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/1882215621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508104f40 0x7fd508107330 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009900 tx=0x7fd4fc02a410 comp rx=0 tx=0).stop 2024-09-19T09:24:45.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 -- 172.21.15.46:0/1882215621 shutdown_connections 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/1882215621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508104f40 0x7fd508107330 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/1882215621 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508107870 0x7fd508109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/1882215621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd508102610 0x7fd508104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 -- 172.21.15.46:0/1882215621 >> 172.21.15.46:0/1882215621 conn(0x7fd5080fc1b0 msgr2=0x7fd5080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 -- 172.21.15.46:0/1882215621 shutdown_connections 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.591+0000 7fd50e7cd640 1 -- 172.21.15.46:0/1882215621 wait complete. 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 Processor -- start 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 -- start start 2024-09-19T09:24:45.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508102610 0x7fd508197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd508104f40 0x7fd508198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 0x7fd50819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810d7e0 con 0x7fd508107870 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810d660 con 0x7fd508104f40 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50e7cd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd50810d960 con 0x7fd508102610 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.592+0000 7fd50cd6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 0x7fd50819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 0x7fd50819f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58616/0 (socket says 172.21.15.46:58616) 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 -- 172.21.15.46:0/3177016485 learned_addr learned my addr 172.21.15.46:0/3177016485 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd5077fe640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd508104f40 0x7fd508198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd507fff640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508102610 0x7fd508197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 -- 172.21.15.46:0/3177016485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508102610 msgr2=0x7fd508197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508102610 0x7fd508197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 -- 172.21.15.46:0/3177016485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd508104f40 msgr2=0x7fd508198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd508104f40 0x7fd508198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 -- 172.21.15.46:0/3177016485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50819fb70 con 0x7fd508107870 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50cd6a640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 0x7fd50819f500 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e9d0 tx=0x7fd50000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50000cd80 con 0x7fd508107870 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50819fe60 con 0x7fd508107870 2024-09-19T09:24:45.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd500005020 con 0x7fd508107870 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5000116d0 con 0x7fd508107870 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.593+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5081a0320 con 0x7fd508107870 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.594+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5080fdca0 con 0x7fd508107870 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.595+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd5000051d0 con 0x7fd508107870 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.596+0000 7fd5057fa640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f00a3250 0x7fd4f00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.596+0000 7fd507fff640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f00a3250 0x7fd4f00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.596+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7fd5000cfd90 con 0x7fd508107870 2024-09-19T09:24:45.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.597+0000 7fd507fff640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f00a3250 0x7fd4f00a5710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005d00 tx=0x7fd4f800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.599+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd500016030 con 0x7fd508107870 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.775+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd50802da10 con 0x7fd508107870 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.776+0000 7fd5057fa640 1 -- 172.21.15.46:0/3177016485 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7fd50009c430 con 0x7fd508107870 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f00a3250 msgr2=0x7fd4f00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f00a3250 0x7fd4f00a5710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8005d00 tx=0x7fd4f800b410 comp rx=0 tx=0).stop 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 msgr2=0x7fd50819f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 0x7fd50819f500 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e9d0 tx=0x7fd50000ee90 comp rx=0 tx=0).stop 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 shutdown_connections 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7fd4f00a3250 0x7fd4f00a5710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd508107870 0x7fd50819f500 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd508104f40 0x7fd508198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 --2- 172.21.15.46:0/3177016485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd508102610 0x7fd508197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 >> 172.21.15.46:0/3177016485 conn(0x7fd5080fc1b0 msgr2=0x7fd508103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 shutdown_connections 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.778+0000 7fd50e7cd640 1 -- 172.21.15.46:0/3177016485 wait complete. 2024-09-19T09:24:45.789 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:45 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/2108824071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:24:45.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:24:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 -- 172.21.15.46:0/880816176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec104ee0 msgr2=0x7f98ec1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 --2- 172.21.15.46:0/880816176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec104ee0 0x7f98ec1072d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f98dc009900 tx=0x7f98dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:24:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 -- 172.21.15.46:0/880816176 shutdown_connections 2024-09-19T09:24:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 --2- 172.21.15.46:0/880816176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec104ee0 0x7f98ec1072d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 --2- 172.21.15.46:0/880816176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec107810 0x7f98ec109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 --2- 172.21.15.46:0/880816176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec1025b0 0x7f98ec1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 -- 172.21.15.46:0/880816176 >> 172.21.15.46:0/880816176 conn(0x7f98ec0fc1b0 msgr2=0x7f98ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 -- 172.21.15.46:0/880816176 shutdown_connections 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.898+0000 7f98f34e4640 1 -- 172.21.15.46:0/880816176 wait complete. 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 Processor -- start 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 -- start start 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 0x7f98ec197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec104ee0 0x7f98ec1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec107810 0x7f98ec19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec10d7e0 con 0x7f98ec1025b0 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec10d660 con 0x7f98ec104ee0 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f34e4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec10d960 con 0x7f98ec107810 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f1280640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 0x7f98ec197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f1280640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 0x7f98ec197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58636/0 (socket says 172.21.15.46:58636) 2024-09-19T09:24:45.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f1280640 1 -- 172.21.15.46:0/1370541050 learned_addr learned my addr 172.21.15.46:0/1370541050 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.899+0000 7f98f0a7f640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec104ee0 0x7f98ec1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1a81640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec107810 0x7f98ec19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1280640 1 -- 172.21.15.46:0/1370541050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec107810 msgr2=0x7f98ec19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1280640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec107810 0x7f98ec19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1280640 1 -- 172.21.15.46:0/1370541050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec104ee0 msgr2=0x7f98ec1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1280640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec104ee0 0x7f98ec1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1280640 1 -- 172.21.15.46:0/1370541050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec19fbb0 con 0x7f98ec1025b0 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f0a7f640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec104ee0 0x7f98ec1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1a81640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec107810 0x7f98ec19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f1280640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 0x7f98ec197f90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c970 tx=0x7f98e800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8007bb0 con 0x7f98ec1025b0 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98e8007d50 con 0x7f98ec1025b0 2024-09-19T09:24:45.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ec19fea0 con 0x7f98ec1025b0 2024-09-19T09:24:45.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e800f450 con 0x7f98ec1025b0 2024-09-19T09:24:45.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.900+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ec1a0300 con 0x7f98ec1025b0 2024-09-19T09:24:45.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.901+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ec0fdca0 con 0x7f98ec1025b0 2024-09-19T09:24:45.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.902+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f98e8005020 con 0x7f98ec1025b0 2024-09-19T09:24:45.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.903+0000 7f98e27fc640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98d80a32d0 0x7f98d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.903+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f98e80cf750 con 0x7f98ec1025b0 2024-09-19T09:24:45.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.903+0000 7f98f0a7f640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98d80a32d0 0x7f98d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.903+0000 7f98f0a7f640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98d80a32d0 0x7f98d80a5790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f98dc000c00 tx=0x7f98dc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:45.907+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98e8014030 con 0x7f98ec1025b0 2024-09-19T09:24:45.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:45 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/2108824071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:24:46.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:45 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/2108824071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:24:46.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.083+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f98ec062ef0 con 0x7f98ec1025b0 2024-09-19T09:24:46.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.084+0000 7f98e27fc640 1 -- 172.21.15.46:0/1370541050 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f98e809c440 con 0x7f98ec1025b0 2024-09-19T09:24:46.085 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 32 2024-09-19T09:24:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.086+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98d80a32d0 msgr2=0x7f98d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.086+0000 7f98f34e4640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98d80a32d0 0x7f98d80a5790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f98dc000c00 tx=0x7f98dc009560 comp rx=0 tx=0).stop 2024-09-19T09:24:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.086+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 msgr2=0x7f98ec197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.086+0000 7f98f34e4640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 0x7f98ec197f90 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c970 tx=0x7f98e800ce30 comp rx=0 tx=0).stop 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.086+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 shutdown_connections 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.086+0000 7f98f34e4640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f98d80a32d0 0x7f98d80a5790 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.087+0000 7f98f34e4640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f98ec107810 0x7f98ec19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.087+0000 7f98f34e4640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98ec104ee0 0x7f98ec1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.087+0000 7f98f34e4640 1 --2- 172.21.15.46:0/1370541050 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f98ec1025b0 0x7f98ec197f90 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.087+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 >> 172.21.15.46:0/1370541050 conn(0x7f98ec0fc1b0 msgr2=0x7f98ec102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.087+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 shutdown_connections 2024-09-19T09:24:46.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.087+0000 7f98f34e4640 1 -- 172.21.15.46:0/1370541050 wait complete. 2024-09-19T09:24:46.099 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:24:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 -- 172.21.15.46:0/2143398183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 msgr2=0x7f22d4109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 --2- 172.21.15.46:0/2143398183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d4109f60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009ca0 tx=0x7f22cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 -- 172.21.15.46:0/2143398183 shutdown_connections 2024-09-19T09:24:46.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 --2- 172.21.15.46:0/2143398183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d4109f60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 --2- 172.21.15.46:0/2143398183 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22d4102d10 0x7f22d4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 --2- 172.21.15.46:0/2143398183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 0x7f22d4101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 -- 172.21.15.46:0/2143398183 >> 172.21.15.46:0/2143398183 conn(0x7f22d40fd2a0 msgr2=0x7f22d40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 -- 172.21.15.46:0/2143398183 shutdown_connections 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.205+0000 7f22db8dd640 1 -- 172.21.15.46:0/2143398183 wait complete. 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 Processor -- start 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 -- start start 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 0x7f22d4197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22d4102d10 0x7f22d41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f22d410d780 con 0x7f22d41036d0 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22d410d600 con 0x7f22d4102d10 2024-09-19T09:24:46.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22db8dd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22d410d900 con 0x7f22d4101b20 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d419f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58652/0 (socket says 172.21.15.46:58652) 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 -- 172.21.15.46:0/218851293 learned_addr learned my addr 172.21.15.46:0/218851293 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d8e78640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22d4102d10 0x7f22d41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9679640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 0x7f22d4197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 -- 172.21.15.46:0/218851293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 msgr2=0x7f22d4197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 0x7f22d4197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 -- 172.21.15.46:0/218851293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22d4102d10 msgr2=0x7f22d41982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22d4102d10 0x7f22d41982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 -- 172.21.15.46:0/218851293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d419f9b0 con 0x7f22d41036d0 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9679640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 0x7f22d4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.206+0000 7f22d9e7a640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d419f310 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098d0 tx=0x7f22cc02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.207+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc02fc30 con 0x7f22d41036d0 2024-09-19T09:24:46.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.207+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22cc003e50 con 0x7f22d41036d0 2024-09-19T09:24:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.207+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d419fc40 con 0x7f22d41036d0 2024-09-19T09:24:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.207+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0305c0 con 0x7f22d41036d0 2024-09-19T09:24:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.207+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d41a0190 con 0x7f22d41036d0 2024-09-19T09:24:46.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.208+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d4108e40 con 0x7f22d41036d0 2024-09-19T09:24:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.209+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f22cc003970 con 0x7f22d41036d0 2024-09-19T09:24:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.209+0000 7f22ca7fc640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22c00a32d0 0x7f22c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.210+0000 7f22d9679640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22c00a32d0 0x7f22c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.210+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f22cc0f0cb0 con 0x7f22d41036d0 2024-09-19T09:24:46.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.210+0000 7f22d9679640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22c00a32d0 0x7f22c00a5790 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f22d00058c0 tx=0x7f22d0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.213+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22cc0bdb20 con 0x7f22d41036d0 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.391+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f22d4062e90 con 0x7f22d41036d0 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.392+0000 7f22ca7fc640 1 -- 172.21.15.46:0/218851293 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f22cc0bd420 con 0x7f22d41036d0 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 64 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22c00a32d0 msgr2=0x7f22c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22c00a32d0 0x7f22c00a5790 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f22d00058c0 tx=0x7f22d0005850 comp rx=0 tx=0).stop 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 msgr2=0x7f22d419f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d419f310 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098d0 tx=0x7f22cc02f840 comp rx=0 tx=0).stop 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 shutdown_connections 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f22c00a32d0 0x7f22c00a5790 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f22d41036d0 0x7f22d419f310 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22d4102d10 0x7f22d41982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 --2- 172.21.15.46:0/218851293 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22d4101b20 0x7f22d4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 >> 172.21.15.46:0/218851293 conn(0x7f22d40fd2a0 msgr2=0x7f22d4106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 shutdown_connections 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.394+0000 7f22db8dd640 1 -- 172.21.15.46:0/218851293 wait complete. 2024-09-19T09:24:46.408 DEBUG:teuthology.orchestra.run.smithi046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:24:46.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 -- 172.21.15.46:0/3536141937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd81025e0 msgr2=0x7f9dd8108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 --2- 172.21.15.46:0/3536141937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd81025e0 0x7f9dd8108e70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009900 tx=0x7f9dd002a410 comp rx=0 tx=0).stop 2024-09-19T09:24:46.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 -- 172.21.15.46:0/3536141937 shutdown_connections 2024-09-19T09:24:46.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 --2- 172.21.15.46:0/3536141937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd81025e0 0x7f9dd8108e70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 --2- 172.21.15.46:0/3536141937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd8101c20 0x7f9dd81020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 --2- 172.21.15.46:0/3536141937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dd8100a30 0x7f9dd8100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 -- 172.21.15.46:0/3536141937 >> 172.21.15.46:0/3536141937 conn(0x7f9dd80fc1b0 msgr2=0x7f9dd80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 -- 172.21.15.46:0/3536141937 shutdown_connections 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.511+0000 7f9ddec82640 1 -- 172.21.15.46:0/3536141937 wait complete. 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 Processor -- start 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 -- start start 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 0x7f9dd8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dd8101c20 0x7f9dd81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd81025e0 0x7f9dd819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd810c6e0 con 0x7f9dd8100a30 2024-09-19T09:24:46.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd810c560 con 0x7f9dd8101c20 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddec82640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd810c860 con 0x7f9dd81025e0 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 0x7f9dd8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 0x7f9dd8197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58660/0 (socket says 172.21.15.46:58660) 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 -- 172.21.15.46:0/789066929 learned_addr learned my addr 172.21.15.46:0/789066929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9dd7fff640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dd8101c20 0x7f9dd81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddd21f640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd81025e0 0x7f9dd819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 -- 172.21.15.46:0/789066929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd81025e0 msgr2=0x7f9dd819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd81025e0 0x7f9dd819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 -- 172.21.15.46:0/789066929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dd8101c20 msgr2=0x7f9dd81982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dd8101c20 0x7f9dd81982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.512+0000 7f9ddca1e640 1 -- 172.21.15.46:0/789066929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd819f990 con 0x7f9dd8100a30 2024-09-19T09:24:46.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.513+0000 7f9ddca1e640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 0x7f9dd8197d70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000c970 tx=0x7f9dc000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.513+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0007c10 con 0x7f9dd8100a30 2024-09-19T09:24:46.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.513+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd819fc80 con 0x7f9dd8100a30 2024-09-19T09:24:46.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.513+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc0007db0 con 0x7f9dd8100a30 2024-09-19T09:24:46.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.513+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000f8a0 con 0x7f9dd8100a30 2024-09-19T09:24:46.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.513+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd81a01d0 con 0x7f9dd8100a30 2024-09-19T09:24:46.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.514+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd81a0400 con 0x7f9dd8100a30 2024-09-19T09:24:46.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.515+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9dc000fa60 con 0x7f9dd8100a30 2024-09-19T09:24:46.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.516+0000 7f9dd5ffb640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9dc40a3250 0x7f9dc40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.516+0000 7f9dd7fff640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9dc40a3250 0x7f9dc40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.517+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f9dc00cd920 con 0x7f9dd8100a30 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.517+0000 7f9dd7fff640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9dc40a3250 0x7f9dc40a5710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8199280 tx=0x7f9dc800a780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.521+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9dc009cac0 con 0x7f9dd8100a30 2024-09-19T09:24:46.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:46 smithi046 ceph-mon[31203]: pgmap v533: 97 pgs: 97 active+clean; 51 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 480 op/s 2024-09-19T09:24:46.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:46 smithi046 ceph-mon[31203]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:46.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:46 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3177016485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:24:46.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:46 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1370541050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:24:46.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:46 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/218851293' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:24:46.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.746+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9dd81a05d0 con 0x7f9dd8100a30 2024-09-19T09:24:46.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.753+0000 7f9dd5ffb640 1 -- 172.21.15.46:0/789066929 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742341 (secure 0 0 0) 0x7f9dc009c3c0 con 0x7f9dd8100a30 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi046.stdout: "epoch": 18, 2024-09-19T09:24:46.764 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "active_gid": 14150, 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "active_name": "x", 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "active_addrs": { 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:6800", 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1744336406 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:6801", 2024-09-19T09:24:46.765 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1744336406 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "active_addr": "172.21.15.46:6801/1744336406", 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "active_change": "2024-09-19T09:09:28.870293+0000", 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "available": true, 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "standbys": [ 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "gid": 24109, 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "z", 2024-09-19T09:24:46.766 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:46.767 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.769 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.770 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.771 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.772 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.773 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:24:46.774 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.775 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.776 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.777 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2024-09-19T09:24:46.778 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.779 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2024-09-19T09:24:46.780 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2024-09-19T09:24:46.781 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.782 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.783 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.784 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2024-09-19T09:24:46.785 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.786 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.787 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:24:46.788 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:24:46.789 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.790 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-19T09:24:46.791 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.792 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.793 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.794 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.795 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.796 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.798 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2024-09-19T09:24:46.799 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2024-09-19T09:24:46.800 INFO:teuthology.orchestra.run.smithi046.stdout: "read", 2024-09-19T09:24:46.800 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap", 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap-read" 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.801 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.802 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.803 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:46.804 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2024-09-19T09:24:46.805 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.806 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-19T09:24:46.807 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.808 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.809 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.810 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.812 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:24:46.813 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.814 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2024-09-19T09:24:46.815 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2024-09-19T09:24:46.816 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.816 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:24:46.816 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.816 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.816 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.817 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.818 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.819 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.820 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.821 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.822 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.823 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2024-09-19T09:24:46.824 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2024-09-19T09:24:46.825 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.825 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.825 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.825 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:24:46.825 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.825 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.826 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2024-09-19T09:24:46.827 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2024-09-19T09:24:46.827 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.827 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.827 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.827 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:24:46.828 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.828 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.828 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.828 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2024-09-19T09:24:46.828 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.828 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2024-09-19T09:24:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:24:46.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.830 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:24:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.831 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2024-09-19T09:24:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:24:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:24:46.832 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:24:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.833 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2024-09-19T09:24:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:24:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.834 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:24:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.835 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2024-09-19T09:24:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.836 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2024-09-19T09:24:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2024-09-19T09:24:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:24:46.837 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.838 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2024-09-19T09:24:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2024-09-19T09:24:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.839 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:24:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2024-09-19T09:24:46.840 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2024-09-19T09:24:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2024-09-19T09:24:46.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:24:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.843 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:46.843 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.843 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.843 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.843 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2024-09-19T09:24:46.844 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2024-09-19T09:24:46.844 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.844 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.844 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.845 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:24:46.845 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.845 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.845 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.845 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2024-09-19T09:24:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2024-09-19T09:24:46.846 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2024-09-19T09:24:46.847 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.847 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.847 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.847 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:24:46.847 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.847 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.848 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.848 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:46.848 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.848 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.849 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.850 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba": { 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba", 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.851 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.852 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:24:46.853 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2024-09-19T09:24:46.854 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.855 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:46.856 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.857 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.858 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:24:46.859 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.860 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.861 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.862 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.863 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "grafana_dashboards_path": { 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:24:46.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.865 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.866 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "hw_monitoring": { 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hw_monitoring", 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.867 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.868 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.869 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.870 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2024-09-19T09:24:46.871 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.872 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.873 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.874 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.875 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.876 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.876 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.876 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:46.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:46.876 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.878 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.878 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.878 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.878 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.878 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.879 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.880 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.880 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:24:46.880 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.880 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.880 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.880 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:24:46.881 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.882 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.884 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.885 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-19T09:24:46.886 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2024-09-19T09:24:46.887 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "oob_default_addr": { 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "oob_default_addr", 2024-09-19T09:24:46.888 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "169.254.1.1", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:24:46.889 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.890 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.891 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:24:46.892 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.893 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.894 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2024-09-19T09:24:46.896 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.897 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.898 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.898 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.898 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.898 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.898 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.899 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.900 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.901 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.902 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.904 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.905 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.906 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.907 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:46.908 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.909 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.910 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:24:46.911 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.912 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:24:46.913 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.914 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.915 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.916 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.917 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.918 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.919 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.920 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.921 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.922 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.923 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:24:46.924 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:24:46.925 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.926 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.927 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.928 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.929 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.930 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.931 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.932 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.933 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.934 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.935 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.936 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:24:46.937 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.938 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.939 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.940 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.941 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.942 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.943 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.944 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:24:46.945 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:24:46.946 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.947 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.948 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.949 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.950 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.951 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.952 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.953 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.954 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.955 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:24:46.956 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:24:46.957 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:24:46.958 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.959 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.960 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.961 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.962 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.963 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.964 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.965 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.966 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.967 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.968 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.969 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:46.970 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.971 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.972 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.973 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.974 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.975 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.976 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.977 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.978 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:46.979 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2024-09-19T09:24:46.980 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.981 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.982 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.983 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.984 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.985 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.986 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.987 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.988 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2024-09-19T09:24:46.989 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2024-09-19T09:24:46.990 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2024-09-19T09:24:46.991 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.992 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.993 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:24:46.994 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.995 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:46.996 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:46.997 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:46.998 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:46.999 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.000 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.001 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.002 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2024-09-19T09:24:47.003 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.004 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2024-09-19T09:24:47.005 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.006 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.007 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.008 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2024-09-19T09:24:47.009 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.010 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.011 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.012 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.013 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.014 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2024-09-19T09:24:47.015 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2024-09-19T09:24:47.016 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.017 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.018 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.019 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.020 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:24:47.021 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.022 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.023 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.024 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.025 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.026 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.027 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.028 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.029 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.030 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.031 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.032 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.033 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.034 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.035 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.036 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.037 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.038 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.039 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.040 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.041 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.042 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.043 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.044 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.045 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.046 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.048 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.049 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-19T09:24:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.051 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.052 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.053 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.054 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.055 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.056 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.057 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.058 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.059 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2024-09-19T09:24:47.060 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.061 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.062 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.063 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.064 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.065 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.066 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.067 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.068 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.069 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.070 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.071 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.072 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.073 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.074 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.075 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.076 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.077 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.078 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.079 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.080 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.081 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.082 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.083 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.084 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.085 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2024-09-19T09:24:47.086 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.087 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.088 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.089 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.090 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.091 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.092 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.093 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.094 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.095 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.096 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.097 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.098 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-19T09:24:47.099 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.100 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.101 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2024-09-19T09:24:47.108 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.113 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.114 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.116 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.117 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.118 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.119 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.120 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.121 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:24:47.122 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:24:47.123 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2024-09-19T09:24:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-19T09:24:47.126 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.127 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.128 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.129 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.130 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.131 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.132 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.133 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.134 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2024-09-19T09:24:47.135 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.136 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.137 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.138 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.140 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.141 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.142 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.143 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.144 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.145 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.146 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.147 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.148 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.149 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.150 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.151 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.152 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.153 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.154 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.155 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.156 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.157 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.158 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.159 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.160 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.161 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2024-09-19T09:24:47.162 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.163 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.164 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.165 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.166 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.167 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.168 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.169 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.170 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.171 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.172 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.173 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.174 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2024-09-19T09:24:47.175 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.176 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.177 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.178 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.179 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.180 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.181 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.182 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.183 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.184 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:24:47.185 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.186 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.187 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.188 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.189 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.190 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2024-09-19T09:24:47.191 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.192 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.193 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.194 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.195 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.196 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.197 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.198 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.199 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.200 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.201 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.202 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.203 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.204 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.205 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.206 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.207 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.208 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.209 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.210 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.211 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.212 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.213 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.214 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.215 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.216 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2024-09-19T09:24:47.217 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.218 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.219 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.220 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.221 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.222 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.223 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2024-09-19T09:24:47.224 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.226 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.227 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.228 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.229 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.230 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.231 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.232 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.233 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2024-09-19T09:24:47.234 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.235 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.236 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.237 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.238 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.239 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.240 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.241 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.242 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.243 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.244 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.245 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.246 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.247 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.248 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.249 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.250 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.251 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:24:47.252 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.253 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2024-09-19T09:24:47.254 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.255 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.256 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.257 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.258 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.259 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.260 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.261 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.262 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.263 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.264 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2024-09-19T09:24:47.265 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.266 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: "gid": 24113, 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "y", 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.267 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.268 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.269 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.270 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.271 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.272 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.273 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.274 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:24:47.275 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.276 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.277 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.278 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2024-09-19T09:24:47.279 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.280 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2024-09-19T09:24:47.281 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2024-09-19T09:24:47.282 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.283 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.284 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.285 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2024-09-19T09:24:47.286 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.287 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.288 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:24:47.289 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:24:47.290 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "read", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap-read" 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba": { 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "grafana_dashboards_path": { 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "hw_monitoring": { 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hw_monitoring", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "oob_default_addr": { 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "oob_default_addr", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "169.254.1.1", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:24:47.369 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.371 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.372 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.373 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2024-09-19T09:24:47.374 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2024-09-19T09:24:47.375 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.376 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.377 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:24:47.378 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.379 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.380 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.381 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.382 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.383 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.384 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.385 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2024-09-19T09:24:47.386 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.387 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.388 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.389 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.390 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.391 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:24:47.392 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:24:47.393 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.394 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.396 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.397 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:24:47.398 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.399 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.400 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.401 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.402 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.403 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:24:47.404 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.405 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.406 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.407 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.408 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.409 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:24:47.410 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.411 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.412 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.413 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.414 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.415 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.416 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:24:47.417 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.418 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.419 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.420 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.421 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.422 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.423 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.424 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:24:47.425 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:24:47.426 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.427 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.428 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.429 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.430 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2024-09-19T09:24:47.431 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.432 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:24:47.433 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:24:47.434 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:24:47.435 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.436 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.437 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.438 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.439 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.440 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.441 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.442 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.443 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-19T09:24:47.444 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.445 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.446 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.448 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.450 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.451 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.452 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:47.453 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.454 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.455 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.456 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.457 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2024-09-19T09:24:47.458 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-19T09:24:47.459 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2024-09-19T09:24:47.460 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.461 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.462 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.463 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.464 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.465 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.466 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.467 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.468 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.469 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.470 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.471 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2024-09-19T09:24:47.472 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.473 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.474 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:24:47.475 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.476 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.477 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.478 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.479 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.480 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.481 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.482 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.483 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.484 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.485 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.486 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2024-09-19T09:24:47.487 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.488 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.489 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.490 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.491 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.492 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.493 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.494 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.495 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.496 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2024-09-19T09:24:47.497 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.498 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.499 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:24:47.500 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2024-09-19T09:24:47.501 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.502 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.503 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.504 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.505 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.506 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.507 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.508 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.509 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.510 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.511 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.512 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.513 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.516 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.517 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2024-09-19T09:24:47.518 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.519 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.520 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.521 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.522 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.523 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.524 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.525 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.526 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.527 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:24:47.528 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.529 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.530 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.531 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.532 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.533 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2024-09-19T09:24:47.534 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2024-09-19T09:24:47.535 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:24:47.536 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.537 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.538 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.539 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.540 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.541 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.542 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.543 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.544 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.545 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.548 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.549 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.550 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.551 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.552 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.553 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.554 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.555 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.556 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.557 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.558 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.559 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.560 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.561 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.562 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.563 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.564 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.565 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.566 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.567 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.568 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.569 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2024-09-19T09:24:47.570 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.571 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.572 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.573 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.574 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.575 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.576 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.577 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.578 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.579 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.580 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.581 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.582 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.583 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.584 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.585 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.586 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.587 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.588 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.589 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.590 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2024-09-19T09:24:47.591 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.592 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.593 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.594 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.595 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.596 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.597 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.598 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.599 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.600 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.601 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:24:47.602 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2024-09-19T09:24:47.603 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.604 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.605 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.606 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.607 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.608 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.609 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.610 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.611 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.612 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.613 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.614 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.615 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:24:47.616 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.617 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2024-09-19T09:24:47.618 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-19T09:24:47.619 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.620 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.621 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.622 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.623 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.624 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.625 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.626 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:24:47.627 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.628 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.629 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.630 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.631 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.632 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.633 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.634 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.635 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.636 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.637 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.638 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.639 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.640 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.641 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.642 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.643 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.644 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.645 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.646 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2024-09-19T09:24:47.647 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.648 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.649 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.650 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.651 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.652 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.653 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.654 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.655 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.656 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.657 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.658 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.660 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.661 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.662 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.663 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.664 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.665 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.666 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2024-09-19T09:24:47.667 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.668 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.669 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.670 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.671 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.672 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.673 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-19T09:24:47.674 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:24:47.675 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.676 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.677 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.678 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.679 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.680 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.681 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.682 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.683 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.684 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.685 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.686 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.687 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.688 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.689 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.690 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.691 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.692 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.693 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.694 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.695 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.696 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.697 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.698 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.699 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.700 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.701 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.702 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2024-09-19T09:24:47.703 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2024-09-19T09:24:47.704 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.705 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.706 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.707 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.709 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.710 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.711 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.712 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.713 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2024-09-19T09:24:47.714 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.715 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.716 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.717 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.718 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.719 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.720 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.721 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.722 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.723 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2024-09-19T09:24:47.724 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.725 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.726 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.727 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.728 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.729 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.730 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.731 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.732 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.733 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.734 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.735 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.736 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.737 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.738 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.739 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2024-09-19T09:24:47.740 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.741 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.742 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:24:47.743 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2024-09-19T09:24:47.744 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.745 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.746 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.747 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.748 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.749 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.750 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.751 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.755 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.756 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.757 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.758 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.759 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.760 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:24:47.761 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:47.762 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "modules": [ 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "dashboard", 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "iostat", 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "nfs", 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "restful" 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "available_modules": [ 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "alerts", 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.763 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:24:47.764 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.765 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.766 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.767 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.768 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.769 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_destination": { 2024-09-19T09:24:47.770 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_destination", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.771 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_from_name": { 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_from_name", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "Ceph", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Email From: name", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.772 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_host": { 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_host", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP server", 2024-09-19T09:24:47.773 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_password": { 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_password", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.774 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Password to authenticate with", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_port": { 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_port", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "465", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.775 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP port", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_sender": { 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_sender", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.776 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_ssl": { 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_ssl", 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.777 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "smtp_user": { 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "smtp_user", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.778 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "User to authenticate as", 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.779 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "balancer", 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "active": { 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "active", 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.780 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_time": { 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_time", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.781 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0000", 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "begin_weekday": { 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "begin_weekday", 2024-09-19T09:24:47.782 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_max_iterations": { 2024-09-19T09:24:47.783 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "25", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "250", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.784 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_metrics": { 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_metrics", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:24:47.785 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "crush_compat_step": { 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crush_compat_step", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.5", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0.001", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "0.999", 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.786 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "end_time": { 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_time", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2359", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.787 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "end_weekday": { 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "end_weekday", 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.788 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "0", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "6", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.789 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.790 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.791 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.792 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.793 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.794 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "min_score": { 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_score", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:24:47.795 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "upmap", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.796 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "crush-compat", 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "none", 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "read", 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap", 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap-read" 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Balancer mode", 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.797 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_ids": { 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_ids", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.798 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_deviation": { 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_deviation", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:24:47.800 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "upmap_max_optimizations": { 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.801 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm", 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.802 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_down_multiplier": { 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_down_multiplier", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.803 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_refresh_rate": { 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_refresh_rate", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "20", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.804 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "agent_starting_port": { 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "agent_starting_port", 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4721", 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.805 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_ptrace": { 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_ptrace", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.806 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_interval": { 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_interval", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.807 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.808 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0.7", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm_log_destination": { 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cephadm_log_destination", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.809 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "file", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "file,syslog", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "syslog" 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.810 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "cgroups_split": { 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cgroups_split", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:24:47.811 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "config_checks_enabled": { 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_checks_enabled", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.812 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "config_dashboard": { 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_dashboard", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.813 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_alertmanager": { 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_alertmanager", 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.814 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_base": { 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_base", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.815 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_elasticsearch": { 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:24:47.816 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "elasticsearch container image", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_grafana": { 2024-09-19T09:24:47.817 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_grafana", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.818 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_haproxy": { 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_haproxy", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "HAproxy container image", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.819 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_agent": { 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:24:47.820 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_collector": { 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.821 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_jaeger_query": { 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.822 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Jaeger query container image", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_keepalived": { 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_keepalived", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.823 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Keepalived container image", 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_loki": { 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_loki", 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.824 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Loki container image", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_node_exporter": { 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_node_exporter", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.825 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_nvmeof": { 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_nvmeof", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.826 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Nvme-of container image", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_prometheus": { 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_prometheus", 2024-09-19T09:24:47.827 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Prometheus container image", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.828 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_promtail": { 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_promtail", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Promtail container image", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_samba": { 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_samba", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.830 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "container_image_snmp_gateway": { 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:24:47.831 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "container_init": { 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "container_init", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.832 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "daemon_cache_timeout": { 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.833 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "900", 2024-09-19T09:24:47.834 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "default_registry": { 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "default_registry", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.835 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "docker.io", 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "device_cache_timeout": { 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_cache_timeout", 2024-09-19T09:24:47.836 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1800", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "device_enhanced_scan": { 2024-09-19T09:24:47.837 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_enhanced_scan", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.838 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "facts_cache_timeout": { 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "facts_cache_timeout", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "grafana_dashboards_path": { 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.840 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "host_check_interval": { 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "host_check_interval", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:24:47.841 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "hw_monitoring": { 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hw_monitoring", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "inventory_list_all": { 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "inventory_list_all", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.843 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.844 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.845 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "log_refresh_metadata": { 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_refresh_metadata", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.846 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.847 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.848 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.849 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.850 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.851 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "*", 2024-09-19T09:24:47.852 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "max_count_per_host": { 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_count_per_host", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.853 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "max_osd_draining_count": { 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_osd_draining_count", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.854 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "migration_current": { 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "migration_current", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.855 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "internal - do not modify", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "mode": { 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mode", 2024-09-19T09:24:47.856 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "root", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm-package", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "root" 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.857 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "oob_default_addr": { 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "oob_default_addr", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "169.254.1.1", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:24:47.858 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "prometheus_alerts_path": { 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.859 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_insecure": { 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_insecure", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.860 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_password": { 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_password", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.861 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_url": { 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_url", 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.862 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "registry_username": { 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "registry_username", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.863 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "secure_monitoring_stack": { 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:24:47.864 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "service_discovery_port": { 2024-09-19T09:24:47.865 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "service_discovery_port", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8765", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.866 INFO:teuthology.orchestra.run.smithi046.stdout: "ssh_config_file": { 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssh_config_file", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.867 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "use_agent": { 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_agent", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:24:47.868 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "use_repo_digest": { 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "use_repo_digest", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.869 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_failed_host_check": { 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.870 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_daemons": { 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.871 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_on_stray_hosts": { 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.872 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.873 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crash", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.874 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.875 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.876 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.877 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.878 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.879 INFO:teuthology.orchestra.run.smithi046.stdout: "retain_interval": { 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retain_interval", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "31536000", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.880 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_recent_interval": { 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_recent_interval", 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1209600", 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.881 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dashboard", 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.882 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.883 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.884 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.885 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.886 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.887 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.888 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.889 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:24:47.890 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:24:47.891 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.892 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.893 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.894 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.895 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.896 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.897 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:47.898 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.899 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_URL": { 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.900 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:24:47.901 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.902 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.903 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.904 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.905 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.906 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.907 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.908 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.909 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.910 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.911 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:24:47.912 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:24:47.913 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:24:47.914 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.915 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.916 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.917 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.918 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.919 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.920 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.921 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "45", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:24:47.922 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:24:47.923 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "admin", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.924 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.925 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.926 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.927 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.928 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.929 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "cross_origin_url": { 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cross_origin_url", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.930 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "crt_file": { 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "crt_file", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.931 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "debug": { 2024-09-19T09:24:47.932 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "debug", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.933 INFO:teuthology.orchestra.run.smithi046.stdout: "jwt_token_ttl": { 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "jwt_token_ttl", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "28800", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.934 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.935 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.936 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.937 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.938 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.939 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.940 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "motd": { 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "motd", 2024-09-19T09:24:47.941 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "The message of the day", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:24:47.942 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.943 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.944 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8080", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.945 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.946 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl_server_port": { 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl_server_port", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8443", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.947 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "redirect", 2024-09-19T09:24:47.948 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "redirect" 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-19T09:24:47.949 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "url_prefix": { 2024-09-19T09:24:47.950 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url_prefix", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.951 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_monitoring": { 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_monitoring", 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.952 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "monitor device health metrics", 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.953 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.954 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.955 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.956 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.957 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.958 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.959 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.960 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "mark_out_threshold": { 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mark_out_threshold", 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.961 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "2419200", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "pool_name": { 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pool_name", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.962 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "device_health_metrics", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "retention_period": { 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "retention_period", 2024-09-19T09:24:47.963 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15552000", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.964 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_frequency": { 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_frequency", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.965 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "self_heal": { 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "self_heal", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.966 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:24:47.967 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "warn_threshold": { 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "warn_threshold", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7257600", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.968 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "diskprediction_local", 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.969 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.970 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.971 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.972 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.973 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.974 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "predict_interval": { 2024-09-19T09:24:47.975 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predict_interval", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "86400", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.976 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "predictor_model": { 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "predictor_model", 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "prophetstor", 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.977 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "600", 2024-09-19T09:24:47.978 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "influx", 2024-09-19T09:24:47.979 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": false, 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "batch_size": { 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "batch_size", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5000", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.980 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "database": { 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "database", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "ceph", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.981 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": { 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "hostname", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.982 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.983 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "30", 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "5", 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.984 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.985 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.986 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:47.987 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.988 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.989 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "password": { 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "password", 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.990 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "port": { 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "port", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.991 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "8086", 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "InfluxDB server port", 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "ssl": { 2024-09-19T09:24:47.992 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ssl", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "false", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.993 INFO:teuthology.orchestra.run.smithi046.stdout: "threads": { 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threads", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "32", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.994 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "username": { 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "username", 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.995 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "verify_ssl": { 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "verify_ssl", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "true", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.996 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "insights", 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:47.997 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:47.998 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:47.999 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.000 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.001 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.002 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.003 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "iostat", 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.004 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.005 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.006 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.007 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.008 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.009 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "k8sevents", 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_event_retention_days": { 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:24:48.010 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "7", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "config_check_secs": { 2024-09-19T09:24:48.011 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "config_check_secs", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "10", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.012 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.013 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.014 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.015 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.016 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.017 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "localpool", 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.018 INFO:teuthology.orchestra.run.smithi046.stdout: "failure_domain": { 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "failure_domain", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "host", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.019 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.020 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.021 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.022 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.023 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.024 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "min_size": { 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "min_size", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.025 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "num_rep": { 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "num_rep", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.026 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_num": { 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_num", 2024-09-19T09:24:48.027 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "128", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.028 INFO:teuthology.orchestra.run.smithi046.stdout: "prefix": { 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prefix", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.029 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "subtree": { 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "subtree", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "rack", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.030 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mds_autoscaler", 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.031 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.032 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.033 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.034 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.035 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.036 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirroring", 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.037 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.038 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.039 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.040 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.041 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.042 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "nfs", 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.043 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.044 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.045 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.046 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.047 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.048 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.049 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "fail_fs": { 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "fail_fs", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:24:48.050 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.051 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.052 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.053 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.054 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.055 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.056 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator": { 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "orchestrator", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "cephadm", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "rook", 2024-09-19T09:24:48.057 INFO:teuthology.orchestra.run.smithi046.stdout: "test_orchestrator" 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Orchestrator backend", 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_perf_query", 2024-09-19T09:24:48.058 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.059 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.060 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.061 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.062 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.063 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.064 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "osd_support", 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.065 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.066 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.067 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.068 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.069 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.070 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.071 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.072 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "pg_autoscaler", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.073 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.074 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.075 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.076 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.077 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.078 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.079 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "threshold": { 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "threshold", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "3.0", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1.0", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.080 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "scaling threshold", 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "progress", 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_pg_recovery_event": { 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:24:48.081 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-19T09:24:48.082 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.083 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.084 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.085 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.086 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.087 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.088 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "max_completed_events": { 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_completed_events", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "50", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.089 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "sleep_interval": { 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "sleep_interval", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.090 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.091 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "prometheus", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "cache": { 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "cache", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.092 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "exclude_perf_counters": { 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "exclude_perf_counters", 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.093 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.094 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.095 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.096 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.097 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.098 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.099 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools": { 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.100 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "300", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.101 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "scrape_interval": { 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "scrape_interval", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15.0", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.102 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "::", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.103 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.104 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "9283", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "stale_cache_strategy": { 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stale_cache_strategy", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.105 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "log", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_behaviour": { 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_behaviour", 2024-09-19T09:24:48.106 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "default", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "default", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "error" 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.107 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "standby_error_status_code": { 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "standby_error_status_code", 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "500", 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "400", 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "599", 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.108 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.109 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.110 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.111 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.112 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.113 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.114 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_snap_create": { 2024-09-19T09:24:48.115 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.117 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "trash_purge_schedule": { 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "trash_purge_schedule", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.118 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "restful", 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "enable_auth": { 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enable_auth", 2024-09-19T09:24:48.119 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.120 INFO:teuthology.orchestra.run.smithi046.stdout: "key_file": { 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "key_file", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.121 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.122 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.123 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.124 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.125 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.126 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "server_addr": { 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_addr", 2024-09-19T09:24:48.127 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.128 INFO:teuthology.orchestra.run.smithi046.stdout: "server_port": { 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "server_port", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.129 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rgw", 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.130 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.131 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.132 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.133 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.134 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.135 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "5", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.136 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rook", 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.137 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.138 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.139 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.140 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.141 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.142 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "storage_class": { 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "storage_class", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "local", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.143 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "selftest", 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.144 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.147 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.148 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.149 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "roption1": { 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption1", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.150 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "roption2": { 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "roption2", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "xyz", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.151 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption1": { 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption1", 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.152 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption2": { 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption2", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption3": { 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption3", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "float", 2024-09-19T09:24:48.154 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption4": { 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption4", 2024-09-19T09:24:48.155 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.156 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption5": { 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption5", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.157 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption6": { 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption6", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.158 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "rwoption7": { 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rwoption7", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "1", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "42", 2024-09-19T09:24:48.159 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "testkey": { 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testkey", 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.160 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "testlkey": { 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testlkey", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.161 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "testnewline": { 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "testnewline", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.162 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.163 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snap_schedule", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "allow_m_granularity": { 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "allow_m_granularity", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.164 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "dump_on_update": { 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "dump_on_update", 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.165 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.166 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.167 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.168 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.169 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.170 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.171 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "stats", 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.172 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.173 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.174 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.175 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.176 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.177 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "status", 2024-09-19T09:24:48.178 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.179 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.180 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.181 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.182 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.183 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telegraf", 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.184 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "address": { 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "address", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.185 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "15", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.186 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.187 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.188 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.189 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.190 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.191 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "telemetry", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_basic": { 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_basic", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.193 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_crash": { 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_crash", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.194 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_device": { 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_device", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.195 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_ident": { 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_ident", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.196 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "channel_perf": { 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "channel_perf", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.197 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "contact": { 2024-09-19T09:24:48.198 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "contact", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.199 INFO:teuthology.orchestra.run.smithi046.stdout: "description": { 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "description", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.200 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "device_url": { 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "device_url", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.201 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "enabled": { 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "enabled", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.202 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "24", 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "8", 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.203 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "last_opt_revision": { 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "last_opt_revision", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "1", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.204 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard": { 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.205 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "leaderboard_description": { 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "leaderboard_description", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.206 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.207 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.208 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.209 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.210 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.211 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.212 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "organization": { 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "organization", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.213 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "proxy": { 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "proxy", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.214 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "url": { 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "url", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.215 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "test_orchestrator", 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.216 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.217 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.218 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.219 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.220 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.221 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.222 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.223 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.224 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.225 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.226 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.227 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "max_concurrent_clones": { 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "max_concurrent_clones", 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.228 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "4", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "periodic_async_work": { 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "periodic_async_work", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.229 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Periodically check for async work", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_delay": { 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:24:48.230 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "0", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.231 INFO:teuthology.orchestra.run.smithi046.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "True", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.232 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix", 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "can_run": true, 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "error_string": "", 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "module_options": { 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "discovery_interval": { 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "discovery_interval", 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "uint", 2024-09-19T09:24:48.233 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "100", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "identifier": { 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "identifier", 2024-09-19T09:24:48.234 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "interval": { 2024-09-19T09:24:48.235 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "interval", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "secs", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "60", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.236 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "log_level": { 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_level", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.237 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster": { 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster", 2024-09-19T09:24:48.238 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_cluster_level": { 2024-09-19T09:24:48.239 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_cluster_level", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "info", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [ 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "critical", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "debug", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "error", 2024-09-19T09:24:48.240 INFO:teuthology.orchestra.run.smithi046.stdout: "info", 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "warning" 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "log_to_file": { 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "log_to_file", 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "bool", 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 1, 2024-09-19T09:24:48.241 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "False", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_host": { 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_host", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.242 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_port": { 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_port", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "int", 2024-09-19T09:24:48.243 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "10051", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "zabbix_sender": { 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "zabbix_sender", 2024-09-19T09:24:48.244 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "str", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "level": "advanced", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "flags": 0, 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "min": "", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "max": "", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "enum_allowed": [], 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "desc": "", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "long_desc": "", 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "tags": [], 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: "see_also": [] 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.245 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "services": { 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "dashboard": "https://172.21.15.46:8443/" 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "always_on_modules": { 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "octopus": [ 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-19T09:24:48.246 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "pacific": [ 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-19T09:24:48.247 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "quincy": [ 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-19T09:24:48.248 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "reef": [ 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-19T09:24:48.249 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "squid": [ 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "balancer", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "devicehealth", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "orchestrator", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "pg_autoscaler", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "progress", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "rbd_support", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "status", 2024-09-19T09:24:48.250 INFO:teuthology.orchestra.run.smithi046.stdout: "telemetry", 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "volumes" 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "active_clients": [ 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "devicehealth", 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 4145036145 2024-09-19T09:24:48.251 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "libcephsqlite", 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1508192985 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.252 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "rbd_support", 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1356655432 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "name": "volumes", 2024-09-19T09:24:48.253 INFO:teuthology.orchestra.run.smithi046.stdout: "addrvec": [ 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: { 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v2", 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "172.21.15.46:0", 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 3120025951 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-19T09:24:48.254 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:46 smithi099 ceph-mon[35256]: pgmap v533: 97 pgs: 97 active+clean; 51 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 480 op/s 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:46 smithi099 ceph-mon[35256]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:46 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3177016485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:46 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1370541050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:46 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/218851293' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:47 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/789066929' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:46 smithi115 ceph-mon[35055]: pgmap v533: 97 pgs: 97 active+clean; 51 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 480 op/s 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:46 smithi115 ceph-mon[35055]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:46 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3177016485' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:24:48.256 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:46 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1370541050' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:24:48.257 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:46 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/218851293' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:24:48.257 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:47 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/789066929' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:24:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9dc40a3250 msgr2=0x7f9dc40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9dc40a3250 0x7f9dc40a5710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8199280 tx=0x7f9dc800a780 comp rx=0 tx=0).stop 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 msgr2=0x7f9dd8197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 0x7f9dd8197d70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000c970 tx=0x7f9dc000ce30 comp rx=0 tx=0).stop 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 shutdown_connections 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f9dc40a3250 0x7f9dc40a5710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9dd81025e0 0x7f9dd819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9dd8101c20 0x7f9dd81982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 --2- 172.21.15.46:0/789066929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9dd8100a30 0x7f9dd8197d70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 >> 172.21.15.46:0/789066929 conn(0x7f9dd80fc1b0 msgr2=0x7f9dd80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 shutdown_connections 2024-09-19T09:24:48.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:24:46.759+0000 7f9ddec82640 1 -- 172.21.15.46:0/789066929 wait complete. 2024-09-19T09:24:48.264 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:24:48.264 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:24:48.265 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:47 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/789066929' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:24:48.570 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:48.693 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:48 smithi046 ceph-mon[31203]: pgmap v534: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 435 op/s 2024-09-19T09:24:48.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:48 smithi115 ceph-mon[35055]: pgmap v534: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 435 op/s 2024-09-19T09:24:49.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:48 smithi099 ceph-mon[35256]: pgmap v534: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 435 op/s 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 848, 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 850, 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 4457041, 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 269665, 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 6, 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-19T09:24:49.076 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.074463590, 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.023123231, 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.021959757, 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.022124070, 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 848, 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.026174322, 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000030865 2024-09-19T09:24:49.077 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 603, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 580, 2024-09-19T09:24:49.078 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 4902138, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 224410, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 3, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.058526924, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.019314466, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.028029423, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.011804157, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 580, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.025185678, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000043423 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.079 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 598736, 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 87920 2024-09-19T09:24:49.080 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.081 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:49.081 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 168, 2024-09-19T09:24:49.082 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 274, 2024-09-19T09:24:49.082 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 612484, 2024-09-19T09:24:49.082 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 319682, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 5, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 4, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.023323285, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.011109850, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.005223843, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.004842094, 2024-09-19T09:24:49.083 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 272, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.011544111, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000042441 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:24:49.084 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 266576 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 1, 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-MDSRank": { 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 2411, 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.060672477, 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000025164 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.085 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-PurgeQueue": { 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "request": 0, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "reply": 0, 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "reply_latency": { 2024-09-19T09:24:49.086 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_reply": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "forward": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_complete": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_keys": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_commit": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_split": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_merge": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes": 2785, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_top": 0, 2024-09-19T09:24:49.087 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_bottom": 2785, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pin_tail": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pinned": 2784, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_expired": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_with_caps": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "subtrees": 1, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_hit": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_forward": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_discover": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_remote_ino": 0, 2024-09-19T09:24:49.088 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_lock": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "load_cent": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "q": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "exported": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "exported_inodes": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "imported": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "imported_inodes": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_dir_fetch": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_peer_discover": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rfiles": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rbytes": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rsnaps": 0, 2024-09-19T09:24:49.089 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_set_tag": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_file_inodes": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:24:49.090 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_cap_release": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "process_request_cap_release": 0 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache": { 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update_receipt": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_try_discover": 0, 2024-09-19T09:24:49.091 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_send_discover": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_handle_discover": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_delayed": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_created": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_enqueued": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_reintegrated": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_migrated": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_processing": 0, 2024-09-19T09:24:49.092 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_started": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_completed": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:24:49.093 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_exportdir": 0, 2024-09-19T09:24:49.094 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_flush": 0, 2024-09-19T09:24:49.094 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:24:49.094 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragstats": 0, 2024-09-19T09:24:49.094 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_inodestats": 0 2024-09-19T09:24:49.095 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.095 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log": { 2024-09-19T09:24:49.095 INFO:teuthology.orchestra.run.smithi046.stdout: "evlrg": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "evadd": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "evex": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "evtrm": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "ev": 4486, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "evexg": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "evexd": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "segadd": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "segex": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "segtrm": 0, 2024-09-19T09:24:49.096 INFO:teuthology.orchestra.run.smithi046.stdout: "seg": 7, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "segmjr": 2, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "segexg": 0, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "segexd": 0, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "expos": 4194304, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "wrpos": 13153988, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "rdpos": 13148636, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "jlat": { 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.097 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "replayed": 4486 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_mem": { 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 11, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "ino+": 1270, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "ino-": 1259, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "dir": 142, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "dir+": 196, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "dir-": 54, 2024-09-19T09:24:49.098 INFO:teuthology.orchestra.run.smithi046.stdout: "dn": 2785, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "dn+": 3299, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "dn-": 514, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "cap": 0, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "cap+": 0, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "cap-": 0, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "rss": 55524, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "heap": 215328 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_server": { 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_client_request": 0, 2024-09-19T09:24:49.099 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_server_request": 0, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_request": 0, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_session": 0, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_peer_request": 0, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "req_create_latency": { 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getattr_latency": { 2024-09-19T09:24:49.100 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getfilelock_latency": { 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "req_link_latency": { 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.101 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookup_latency": { 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookuphash_latency": { 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.102 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupino_latency": { 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupname_latency": { 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.103 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupparent_latency": { 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupsnap_latency": { 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.104 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lssnap_latency": { 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.105 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mkdir_latency": { 2024-09-19T09:24:49.106 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.106 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.106 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.106 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mknod_latency": { 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mksnap_latency": { 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "req_open_latency": { 2024-09-19T09:24:49.107 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "req_readdir_latency": { 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rename_latency": { 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.108 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "req_renamesnap_latency": { 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "req_snapdiff_latency": { 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmdir_latency": { 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.109 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmsnap_latency": { 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmxattr_latency": { 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.110 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setattr_latency": { 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setdirlayout_latency": { 2024-09-19T09:24:49.111 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setfilelock_latency": { 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.112 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setlayout_latency": { 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setxattr_latency": { 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.113 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "req_symlink_latency": { 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "req_unlink_latency": { 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.114 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getvxattr_latency": { 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sessions": { 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "session_count": 1, 2024-09-19T09:24:49.115 INFO:teuthology.orchestra.run.smithi046.stdout: "session_add": 2, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "session_remove": 1, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_open": 1, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_stale": 0, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "total_load": 0, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "average_load": 0, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "avg_session_uptime": 1400, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "mdthresh_evicted": 0 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:49.116 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:49.117 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:49.118 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 198358, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 59, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:49.119 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 7400, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 152, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 2179751, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 11420, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-19T09:24:49.120 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter": { 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_active": 0, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_laggy": 0, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send": 1444, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send_bytes": 21, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_resend": 3, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_reply": 1444, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "op_latency": { 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 1444, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.849990727, 2024-09-19T09:24:49.121 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000588636 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "op_inflight": 0, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "oplen_avg": { 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 1444, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 1445 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "op": 1444, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "op_r": 1444, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "op_w": 0, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "op_rmw": 0, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "op_pg": 0, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_stat": 901, 2024-09-19T09:24:49.122 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_create": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_read": 541, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_write": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writefull": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writesame": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_append": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_zero": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_truncate": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_delete": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_mapext": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_sparse_read": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_clonerange": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_getxattr": 1, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_setxattr": 0, 2024-09-19T09:24:49.123 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_rmxattr": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_call": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_watch": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_notify": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_other": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_active": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_send": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_resend": 0, 2024-09-19T09:24:49.124 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_ping": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_active": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_send": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_resend": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_active": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_send": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_resend": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_active": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_send": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_resend": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "command_active": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "command_send": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "command_resend": 0, 2024-09-19T09:24:49.125 INFO:teuthology.orchestra.run.smithi046.stdout: "map_epoch": 85, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "map_full": 0, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "map_inc": 3, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_sessions": 6, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_open": 6, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_close": 0, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_laggy": 0, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_wr": 0, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_rd": 2, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_del": 0 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "oft": { 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_objs": 0, 2024-09-19T09:24:49.126 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_updates": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_removes": 0 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "osd-slow-ops": { 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_ops_count": 0 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "purge_queue": { 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_high_water": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executed_ops": 0, 2024-09-19T09:24:49.127 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executed": 0, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_item_in_journal": 0 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 1615, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 9814673, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 1615, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:49.128 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 1615, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 9814673, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_bytes": { 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:49.129 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 1444, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 8964207, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 1444, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 8964207, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.130 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_ops": { 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 1024, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 1444, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 1444, 2024-09-19T09:24:49.131 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 1444, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 1444, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:49.132 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.133 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle-0x5619c8780b40": { 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2024-09-19T09:24:49.134 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:49.135 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:49.135 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:49.135 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:49.135 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.135 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:49.135 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:24:49.861 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T09:24:49.861 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T09:24:49.861 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-19T09:24:49.861 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:24:49.861 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:24:50.127 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:50.749 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:24:50.749 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:50.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 0, 2024-09-19T09:24:50.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 2, 2024-09-19T09:24:50.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:24:50.749 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 0, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.001191797, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.000156578, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:50.750 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 5, 2024-09-19T09:24:50.751 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 113, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 3152, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 98464, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 3, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.010557837, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.006261288, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.003131979, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 112, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.008851924, 2024-09-19T09:24:50.752 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000079035 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-19T09:24:50.753 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 98464 2024-09-19T09:24:50.754 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.754 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:50.754 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 149, 2024-09-19T09:24:50.754 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 146, 2024-09-19T09:24:50.754 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 459408, 2024-09-19T09:24:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 89312, 2024-09-19T09:24:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2024-09-19T09:24:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2024-09-19T09:24:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.021000209, 2024-09-19T09:24:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.009709635, 2024-09-19T09:24:50.755 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.014610504, 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 145, 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.007257794, 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000050053 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.756 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:50.757 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:50.757 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:50.757 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:50.757 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 459408, 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 89312 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-19T09:24:50.758 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:50.759 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:50.760 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:50.761 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 148967, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 29, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-19T09:24:50.762 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 928, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:50.763 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 150, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 438352, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 150, 2024-09-19T09:24:50.764 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 150, 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 438352, 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:50.765 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:24:50.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:50 smithi115 ceph-mon[35055]: pgmap v535: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 782 KiB/s wr, 314 op/s 2024-09-19T09:24:50.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:50 smithi046 ceph-mon[31203]: pgmap v535: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 782 KiB/s wr, 314 op/s 2024-09-19T09:24:51.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:50 smithi099 ceph-mon[35256]: pgmap v535: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 782 KiB/s wr, 314 op/s 2024-09-19T09:24:51.557 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T09:24:51.557 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T09:24:51.557 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T09:24:51.557 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:24:51.558 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:24:51.820 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:52.318 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:24:52.318 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:52.318 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 497, 2024-09-19T09:24:52.318 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 499, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 166937, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 158047, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 6, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.053163038, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.021747534, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.012139189, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.013664429, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 497, 2024-09-19T09:24:52.319 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.022454372, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000045179 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:52.320 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 956, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 1063, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 7246963, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 570499, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 5, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 4, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.068375719, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.021498978, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.020945522, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.020890152, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 1061, 2024-09-19T09:24:52.321 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.029860889, 2024-09-19T09:24:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000028144 2024-09-19T09:24:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.322 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 266752 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 179, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 156, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 600628, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 90165, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-19T09:24:52.323 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 3, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.023621146, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.008705701, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.019426344, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000064543, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 156, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.012893683, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000082651 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.324 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 599280, 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 89200 2024-09-19T09:24:52.325 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 1, 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-MDSRank": { 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 2476, 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.058521084, 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000023635 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.326 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "finisher-PurgeQueue": { 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "queue_len": 0, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "complete_latency": { 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "request": 0, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "reply": 0, 2024-09-19T09:24:52.327 INFO:teuthology.orchestra.run.smithi046.stdout: "reply_latency": { 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_reply": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "forward": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_complete": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_fetch_keys": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_commit": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_split": 0, 2024-09-19T09:24:52.328 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_merge": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes": 1201, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_top": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_bottom": 1201, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pin_tail": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_pinned": 1201, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_expired": 1, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "inodes_with_caps": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "caps": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "subtrees": 1, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_hit": 0, 2024-09-19T09:24:52.329 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_forward": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_discover": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_remote_ino": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "traverse_lock": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "load_cent": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "q": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "exported": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "exported_inodes": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "imported": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "imported_inodes": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_dir_fetch": 0, 2024-09-19T09:24:52.330 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "openino_peer_discover": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rfiles": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rbytes": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "root_rsnaps": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_set_tag": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "scrub_file_inodes": 0, 2024-09-19T09:24:52.331 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_cap_release": 0, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "process_request_cap_release": 0 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_cache": { 2024-09-19T09:24:52.332 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_update_receipt": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_try_discover": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_send_discover": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "dir_handle_discover": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_delayed": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_created": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_enqueued": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_reintegrated": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "strays_migrated": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_processing": 0, 2024-09-19T09:24:52.333 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_started": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "recovery_completed": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_exportdir": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_flush": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_fragstats": 0, 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: "ireq_inodestats": 0 2024-09-19T09:24:52.334 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_log": { 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "evlrg": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "evadd": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "evex": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "evtrm": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "ev": 3974, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "evexg": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "evexd": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "segadd": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "segex": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "segtrm": 0, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "seg": 6, 2024-09-19T09:24:52.335 INFO:teuthology.orchestra.run.smithi046.stdout: "segmjr": 2, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "segexg": 0, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "segexd": 0, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "expos": 4194304, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "wrpos": 11197937, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "rdpos": 11196799, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "jlat": { 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: "replayed": 3974 2024-09-19T09:24:52.336 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_mem": { 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "ino": 8, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "ino+": 1251, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "ino-": 1243, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dir": 6, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dir+": 100, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dir-": 94, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dn": 1201, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dn+": 2485, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "dn-": 1284, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "cap": 0, 2024-09-19T09:24:52.337 INFO:teuthology.orchestra.run.smithi046.stdout: "cap+": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "cap-": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "rss": 50824, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "heap": 215328 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_server": { 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_client_request": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "dispatch_server_request": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_request": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_client_session": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "handle_peer_request": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "req_create_latency": { 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.338 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getattr_latency": { 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getfilelock_latency": { 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.339 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "req_link_latency": { 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookup_latency": { 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookuphash_latency": { 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.340 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupino_latency": { 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupname_latency": { 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.341 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupparent_latency": { 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lookupsnap_latency": { 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "req_lssnap_latency": { 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.342 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.343 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mkdir_latency": { 2024-09-19T09:24:52.343 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.343 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mknod_latency": { 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "req_mksnap_latency": { 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.344 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "req_open_latency": { 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "req_readdir_latency": { 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.345 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rename_latency": { 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "req_renamesnap_latency": { 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "req_snapdiff_latency": { 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.346 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmdir_latency": { 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmsnap_latency": { 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.347 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "req_rmxattr_latency": { 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setattr_latency": { 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.348 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setdirlayout_latency": { 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setfilelock_latency": { 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setlayout_latency": { 2024-09-19T09:24:52.349 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "req_setxattr_latency": { 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "req_symlink_latency": { 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.350 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "req_unlink_latency": { 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "req_getvxattr_latency": { 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.351 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_sessions": { 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "session_count": 1, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "session_add": 2, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "session_remove": 1, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_open": 1, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "sessions_stale": 0, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "total_load": 0, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "average_load": 0, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "avg_session_uptime": 1402, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "mdthresh_evicted": 0 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.352 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:52.353 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:52.354 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 197463, 2024-09-19T09:24:52.355 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 54, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 7400, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 152, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:52.356 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 871576, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 4877, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "objecter": { 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "op_active": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "op_laggy": 0, 2024-09-19T09:24:52.357 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send": 1455, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "op_send_bytes": 21, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "op_resend": 3, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "op_reply": 1455, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "op_latency": { 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 1455, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.759991725, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000522331 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "op_inflight": 0, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "oplen_avg": { 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 1455, 2024-09-19T09:24:52.358 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 1456 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "op": 1455, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "op_r": 1455, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "op_w": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "op_rmw": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "op_pg": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_stat": 909, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_create": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_read": 544, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_write": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writefull": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_writesame": 0, 2024-09-19T09:24:52.359 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_append": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_zero": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_truncate": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_delete": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_mapext": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_sparse_read": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_clonerange": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_getxattr": 1, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_setxattr": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_rmxattr": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_call": 0, 2024-09-19T09:24:52.360 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_watch": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_notify": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "osdop_other": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_active": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_send": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_resend": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "linger_ping": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_active": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_send": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "poolop_resend": 0, 2024-09-19T09:24:52.361 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_active": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_send": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "poolstat_resend": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_active": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_send": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "statfs_resend": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "command_active": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "command_send": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "command_resend": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "map_epoch": 85, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "map_full": 0, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "map_inc": 3, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_sessions": 6, 2024-09-19T09:24:52.362 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_open": 6, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_session_close": 0, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_laggy": 0, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_wr": 0, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_rd": 2, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_del": 0 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "oft": { 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_objs": 0, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_updates": 0, 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: "omap_total_removes": 0 2024-09-19T09:24:52.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "osd-slow-ops": { 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "slow_ops_count": 0 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "purge_queue": { 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops": 0, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing": 0, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executing_high_water": 0, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executed_ops": 0, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_executed": 0, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "pq_item_in_journal": 0 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.364 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 1628, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 7856264, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 1628, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 1628, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 7856264, 2024-09-19T09:24:52.365 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_bytes": { 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:52.366 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 1455, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 7003638, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 1455, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 7003638, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-objecter_ops": { 2024-09-19T09:24:52.367 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 1024, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 1455, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 1455, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 1455, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 1455, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.368 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:52.369 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-write_buf_throttle-0x5602adfe0b40": { 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 3758096384, 2024-09-19T09:24:52.370 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:52.371 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.372 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:52.372 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:24:52.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:52 smithi115 ceph-mon[35055]: pgmap v536: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 656 KiB/s wr, 267 op/s 2024-09-19T09:24:52.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:52 smithi046 ceph-mon[31203]: pgmap v536: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 656 KiB/s wr, 267 op/s 2024-09-19T09:24:53.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:52 smithi099 ceph-mon[35256]: pgmap v536: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 656 KiB/s wr, 267 op/s 2024-09-19T09:24:53.063 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T09:24:53.063 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T09:24:53.063 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-19T09:24:53.063 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:24:53.063 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:24:53.323 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:24:53.841 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-19T09:24:53.841 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:53.841 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 4, 2024-09-19T09:24:53.841 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 4, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 448, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 4, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 0, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.003343624, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.000041908, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.002337415, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 3, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.004191606, 2024-09-19T09:24:53.842 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.001397202 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 152, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 149, 2024-09-19T09:24:53.843 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 460848, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 90928, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 2, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 1, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.021307112, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.009296222, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.015363912, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 148, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.007319466, 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000049455 2024-09-19T09:24:53.844 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 460848, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 90928 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_messages": 1, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages": 113, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:24:53.845 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_bytes": 98368, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_created_connections": 3, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_active_connections": 2, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_total_time": 0.009032781, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_send_time": 0.006773246, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_recv_time": 0.001114852, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 111, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.005091627, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000045870 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.846 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "msgr_send_encrypted_bytes": 98368 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "cct": { 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "total_workers": 0, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "unhealthy_workers": 0 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "mempool": { 2024-09-19T09:24:53.847 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bloom_filter_items": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:53.848 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:53.849 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_items": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_bytes": 149007, 2024-09-19T09:24:53.850 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_anon_items": 30, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_bytes": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_items": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_bytes": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_items": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:53.851 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "pgmap_items": 0, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_bytes": 928, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_co_items": 2, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_1_items": 0, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "unittest_2_items": 0 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "val": 0, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "max": 104857600, 2024-09-19T09:24:53.852 INFO:teuthology.orchestra.run.smithi046.stdout: "get_started": 0, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "get": 153, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "get_sum": 439379, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "get_or_fail_success": 153, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "take": 0, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "take_sum": 0, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "put": 153, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "put_sum": 439379, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "wait": { 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "avgcount": 0, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "sum": 0.000000000, 2024-09-19T09:24:53.853 INFO:teuthology.orchestra.run.smithi046.stdout: "avgtime": 0.000000000 2024-09-19T09:24:53.854 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:53.854 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-19T09:24:53.854 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-19T09:24:54.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:54 smithi046 ceph-mon[31203]: pgmap v537: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 382 KiB/s wr, 161 op/s 2024-09-19T09:24:54.788 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T09:24:54.788 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T09:24:54.788 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T09:24:54.788 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:24:54.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:24:54.817 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:54 smithi099 ceph-mon[35256]: pgmap v537: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 382 KiB/s wr, 161 op/s 2024-09-19T09:24:54.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:54 smithi115 ceph-mon[35055]: pgmap v537: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 382 KiB/s wr, 161 op/s 2024-09-19T09:24:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 32043, 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 30559, 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 9539142, 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 37415281, 2024-09-19T09:24:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 11, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 3, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 1.685001374, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.584067633, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.572020287, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.475840224, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 30564, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 5.002256609, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000163664 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 10926, 2024-09-19T09:24:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001809873, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000165 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 630816, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 98736 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 34049, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 33971, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 9342590, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 45144143, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 11, 2024-09-19T09:24:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 1.675494627, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.592008865, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.465900630, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.541575849, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 33973, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 6.612513386, 2024-09-19T09:24:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000194640 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3464, 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000578987, 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000167 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 273984 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 54666, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 109270, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 19020736, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 82263584, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 129, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 10, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 4.305889771, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 2.028115348, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 3.435135581, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.348220262, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 109259, 2024-09-19T09:24:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 6.599886289, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000060405 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 111442, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.017681705, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000158 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 14279904, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 41769056 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 89875, 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 24.500235635, 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000272603 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3989, 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.969160655, 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000242958 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T09:24:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 21135, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 20696, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 20696, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 72.778111138, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.003516530 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 439, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 8, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 3, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 685, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 22, 2024-09-19T09:24:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 27, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 5, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 8, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 14, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 19, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 5362, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 2, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 2, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 6, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 23831, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 20944, 2024-09-19T09:24:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 361, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 0, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 4, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 7555, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 7, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 180, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 4864, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 1, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 8, 2024-09-19T09:24:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 1920, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 4215, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 81948287, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 0, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 1920, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 87, 2024-09-19T09:24:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 4, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 83, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 1833, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 18, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 9859, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 17694, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 7863, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 15350, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 12567, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 210, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 11898 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 245, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 2343, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 2340, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 3, 2024-09-19T09:24:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-09-19T09:24:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-09-19T09:24:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:24:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:24:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-09-19T09:24:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-09-19T09:24:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_path": 6, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_inode": 1228, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 4, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 184, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 23, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 43355, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 43304, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 43304, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 51, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 1337, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 71, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 70, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 70, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 1, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 1, 2024-09-19T09:24:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 2, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 95811331, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 95915035, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 0, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 25614, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 104.869947764, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.004094243 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 0 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 30, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 6976, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 6946, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 28, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 275, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 247, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 27, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 7911, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 7884, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 1, 2024-09-19T09:24:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 7301, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 7300, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 99184, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 231712 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 39133, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 738, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 21135, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 194, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 1472, 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-09-19T09:24:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6848, 2024-09-19T09:24:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 36.292054142, 2024-09-19T09:24:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.005299657 2024-09-19T09:24:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-09-19T09:24:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 199, 2024-09-19T09:24:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.098194461, 2024-09-19T09:24:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.005518565 2024-09-19T09:24:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-09-19T09:24:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3, 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.002985438, 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000995146 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1596, 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.991859757, 2024-09-19T09:24:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000621466 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-09-19T09:24:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-09-19T09:24:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 70, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.055285391, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000789791 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 417, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.163150229, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000391247 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 186, 2024-09-19T09:24:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.672625807, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.003616267 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 94, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.318509227, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.003388396 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-09-19T09:24:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 15, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.078135471, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.005209031 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 8974, 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 28.554290598, 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.003181891 2024-09-19T09:24:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 8, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.003902626, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000487828 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 7, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.020337788, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.002905398 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.007648187, 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001274697 2024-09-19T09:24:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2273, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 4.519132016, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001988179 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 1, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 2, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 1, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 1, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 3440, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 3440, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 400, 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-09-19T09:24:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 360, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 360, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 306724, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 105, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 7400, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 152, 2024-09-19T09:24:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 129894, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 873, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 72893, 2024-09-19T09:24:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 99648171, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 32, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 72893, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 72893, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 859.744550142, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.011794610 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 72893, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 83379 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 72893, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 1988, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 70905, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 441, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 4603, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 53, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 25663, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 139, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-09-19T09:24:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 6, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 2937, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 1935, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 9209, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-09-19T09:24:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 36717, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-09-19T09:24:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 85, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 3, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 12, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 12, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-09-19T09:24:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 1554, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 22, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 100 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 1, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-09-19T09:24:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 1235 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 30, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 6, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 2367, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 2340, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 120754, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 25208905, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 120754, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 120754, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 25208905, 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 72893, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 99884371, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 72893, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 99884371, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 72893, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 72893, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 72893, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 72893, 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 2340, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 236340, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 2340, 2024-09-19T09:24:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 49, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 236340, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x564d9130c960": { 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 599, 2024-09-19T09:24:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 43355, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 91720731, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 43355, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 25614, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 91720132, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:55.601 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T09:24:56.343 INFO:tasks.check_counter:Daemon mds.b mds.exported=180 2024-09-19T09:24:56.343 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-19T09:24:56.343 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=22 2024-09-19T09:24:56.343 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:24:56.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:24:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:24:56.877 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:56 smithi099 ceph-mon[35256]: pgmap v538: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 173 KiB/s wr, 68 op/s 2024-09-19T09:24:56.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:56 smithi115 ceph-mon[35055]: pgmap v538: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 173 KiB/s wr, 68 op/s 2024-09-19T09:24:56.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:56 smithi046 ceph-mon[31203]: pgmap v538: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 173 KiB/s wr, 68 op/s 2024-09-19T09:24:57.130 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 187, 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 187, 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 11898868, 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 58648, 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 7, 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 3, 2024-09-19T09:24:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.019863309, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.002983981, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.011104127, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.003963258, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 186, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.009980860, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000053660 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 414, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 405, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 12914680, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 144727, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 5, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 4, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.041160372, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.013442592, 2024-09-19T09:24:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.019082169, 2024-09-19T09:24:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.007726831, 2024-09-19T09:24:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 404, 2024-09-19T09:24:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.015972246, 2024-09-19T09:24:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000039535 2024-09-19T09:24:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 227824, 2024-09-19T09:24:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 36864 2024-09-19T09:24:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 249, 2024-09-19T09:24:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 293, 2024-09-19T09:24:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 16841009, 2024-09-19T09:24:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 242426, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 6, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 5, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.029902002, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.006172386, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.016058668, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.005830458, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 291, 2024-09-19T09:24:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.009935794, 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000034143 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:24:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 163552 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:24:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1299, 2024-09-19T09:24:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.027015332, 2024-09-19T09:24:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000020797 2024-09-19T09:24:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-09-19T09:24:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-09-19T09:24:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 0, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 0, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-09-19T09:24:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 0, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 23, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 1, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 22, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 0, 2024-09-19T09:24:57.144 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 21, 2024-09-19T09:24:57.145 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 0, 2024-09-19T09:24:57.145 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 0, 2024-09-19T09:24:57.145 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 0, 2024-09-19T09:24:57.145 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 2, 2024-09-19T09:24:57.146 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 0, 2024-09-19T09:24:57.146 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 0, 2024-09-19T09:24:57.146 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 0, 2024-09-19T09:24:57.146 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 0, 2024-09-19T09:24:57.146 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:24:57.146 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:24:57.147 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 4215, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 81948287, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:24:57.148 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:24:57.149 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 0, 2024-09-19T09:24:57.150 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:24:57.150 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 0, 2024-09-19T09:24:57.150 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 0 2024-09-19T09:24:57.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 0, 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 0, 2024-09-19T09:24:57.151 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-09-19T09:24:57.152 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-09-19T09:24:57.153 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:24:57.153 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:24:57.153 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-09-19T09:24:57.153 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-09-19T09:24:57.153 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:24:57.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:24:57.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:24:57.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 0, 2024-09-19T09:24:57.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-09-19T09:24:57.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:24:57.154 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 0, 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-09-19T09:24:57.155 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 19538, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 2, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 15, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-09-19T09:24:57.156 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 95811331, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 95914436, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 95911804, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 19538 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 11, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 25, 2024-09-19T09:24:57.157 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 14, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 9, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 12, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 3, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 23, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 43, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 20, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 0, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 0, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 0, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 50040, 2024-09-19T09:24:57.158 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 215328 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 0, 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 0, 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 0, 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 0, 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 0, 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-09-19T09:24:57.160 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-09-19T09:24:57.162 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-09-19T09:24:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.166 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.167 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-09-19T09:24:57.169 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.171 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.173 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-09-19T09:24:57.173 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.173 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.173 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.173 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-09-19T09:24:57.174 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.174 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.174 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.174 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:24:57.174 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:24:57.175 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-09-19T09:24:57.175 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.175 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.175 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.175 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.176 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-09-19T09:24:57.176 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 1, 2024-09-19T09:24:57.176 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 1, 2024-09-19T09:24:57.176 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 0, 2024-09-19T09:24:57.176 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 0, 2024-09-19T09:24:57.177 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-09-19T09:24:57.177 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 0, 2024-09-19T09:24:57.177 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 0, 2024-09-19T09:24:57.177 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 1639, 2024-09-19T09:24:57.177 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-09-19T09:24:57.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.178 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-09-19T09:24:57.178 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:24:57.178 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-09-19T09:24:57.178 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:57.179 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:57.179 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:57.179 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:57.179 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:57.179 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:57.179 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:57.180 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:57.180 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:57.180 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:57.180 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:57.180 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:57.180 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:57.181 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:57.182 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 221596, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 65, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-09-19T09:24:57.183 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 7400, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 152, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-09-19T09:24:57.184 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 53118, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 329, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 770, 2024-09-19T09:24:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 26, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 4, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 770, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 770, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.516987725, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000671412 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 770, 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 771 2024-09-19T09:24:57.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.187 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 770, 2024-09-19T09:24:57.187 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 770, 2024-09-19T09:24:57.187 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 0, 2024-09-19T09:24:57.187 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-09-19T09:24:57.187 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-09-19T09:24:57.188 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 415, 2024-09-19T09:24:57.188 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 0, 2024-09-19T09:24:57.188 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 352, 2024-09-19T09:24:57.188 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 0, 2024-09-19T09:24:57.188 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 0, 2024-09-19T09:24:57.188 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-09-19T09:24:57.189 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-09-19T09:24:57.189 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-09-19T09:24:57.189 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-09-19T09:24:57.189 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 0, 2024-09-19T09:24:57.189 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-09-19T09:24:57.190 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-09-19T09:24:57.190 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-09-19T09:24:57.190 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 2, 2024-09-19T09:24:57.190 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 0, 2024-09-19T09:24:57.190 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:24:57.190 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-09-19T09:24:57.191 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-09-19T09:24:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-09-19T09:24:57.193 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-09-19T09:24:57.193 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-09-19T09:24:57.193 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-09-19T09:24:57.193 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-09-19T09:24:57.194 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 9, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 9, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 2, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 0 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-09-19T09:24:57.195 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 0, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 0, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 0, 2024-09-19T09:24:57.196 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 846, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 41571615, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 846, 2024-09-19T09:24:57.197 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 846, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 41571615, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:57.198 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 770, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 41209867, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 770, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 41209867, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.199 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 770, 2024-09-19T09:24:57.200 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 770, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 770, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 770, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:57.201 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x5600803326e0": { 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:57.203 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:57.204 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T09:24:58.104 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T09:24:58.104 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T09:24:58.104 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-19T09:24:58.105 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:24:58.105 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:24:58.351 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:24:58.756 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:24:58 smithi099 ceph-mon[35256]: pgmap v539: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 32 op/s 2024-09-19T09:24:58.857 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T09:24:58.857 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:24:58.857 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 4822, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 8564, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 1933164, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 9676961, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 15, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 3, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.379158610, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.180086070, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.194017789, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.031396193, 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:58.858 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 8562, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.320652316, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000037450 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 9285, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001535325, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000165 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 1414944, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 4941920 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:24:58.859 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 5008, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 6137, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 3716713, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 2191676, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 9, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.338623240, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.146280484, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.206948321, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.019321026, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6137, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.227215699, 2024-09-19T09:24:58.860 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000037023 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 9112, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001545178, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000169 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 612864, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 223920 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 1236, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 1455, 2024-09-19T09:24:58.861 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 584750, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 3582794, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 21, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.096758477, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.037690763, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.037116347, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.019172843, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1453, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.069999061, 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000048175 2024-09-19T09:24:58.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 950, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000144660, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000152 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 270544 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-09-19T09:24:58.863 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1036, 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.368506596, 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001320952 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2211, 2024-09-19T09:24:58.864 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.291236929, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000131721 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 2714, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 2713, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2713, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 2.619226132, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000965435 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-09-19T09:24:58.865 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 1, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 19, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 11, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 20, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 2, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 2, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 16, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 16, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 179, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 2, 2024-09-19T09:24:58.866 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 2, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 5, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 5477, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 3840, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 0, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 20, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 3090, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 58, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 459, 2024-09-19T09:24:58.867 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 58, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 1182, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 749, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 4215, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 81948287, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 0, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 749, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-09-19T09:24:58.868 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 2, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 2, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 747, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 613, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 1413, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:24:58.869 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 1019, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 381, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 40, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 2477 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 20, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 58, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-09-19T09:24:58.870 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 1196, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 1196, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_path": 6, 2024-09-19T09:24:58.871 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_inode": 3672, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 58, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 3974, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-09-19T09:24:58.872 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 3974, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 6, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 6, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 2, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 11197937, 2024-09-19T09:24:58.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 0, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 313, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 2.833766503, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.009053567 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 0 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 29, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 1369, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 1340, 2024-09-19T09:24:58.874 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 67, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 98, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 31, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 471, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 2672, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 2201, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 2, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 2403, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 2401, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 69556, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 223520 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-09-19T09:24:58.875 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 4225, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 20, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 2714, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 10, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 1276, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 48, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.086267026, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001797229 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1, 2024-09-19T09:24:58.876 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000772421, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000772421 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1355, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.421165911, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000310823 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1, 2024-09-19T09:24:58.878 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000276240, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000276240 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-09-19T09:24:58.880 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3, 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.003495433, 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001165144 2024-09-19T09:24:58.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-09-19T09:24:58.882 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 11, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.002572628, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000233875 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 98, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.080369697, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000820098 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.883 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.884 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.081344144, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.013557357 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.885 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-09-19T09:24:58.887 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1190, 2024-09-19T09:24:58.888 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.942962632, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001632741 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-09-19T09:24:58.889 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 1, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 2, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 1, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 1, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 2268, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 2268, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 403, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:24:58.890 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:24:58.891 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-09-19T09:24:58.892 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 311542, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 111, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:24:58.893 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 7400, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 152, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-09-19T09:24:58.894 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 540649, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 6650, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 2442, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 7204596, 2024-09-19T09:24:58.895 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 32, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 2442, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2442, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 5.901860383, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.002416814 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2442, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 2545 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.896 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 2442, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 798, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 1644, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 0, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 10, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 30, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 343, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 26, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-09-19T09:24:58.897 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 1209, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 758, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 20, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-09-19T09:24:58.898 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-09-19T09:24:58.899 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 85, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 3, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 12, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 12, 2024-09-19T09:24:58.900 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 89, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 38, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 22 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 1, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-09-19T09:24:58.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 3678 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 6, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 6, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 1196, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 1196, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.902 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 11062, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 5045512, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 11062, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 11062, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 5045512, 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:58.903 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:58.904 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 2442, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 7325088, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 2442, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 7325088, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.905 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 2442, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 2442, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 2442, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 2442, 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:58.906 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 1196, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 120796, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 1196, 2024-09-19T09:24:58.907 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 30, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 120796, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x561f4d002960": { 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:24:58.908 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 3974, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 7003633, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 3974, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 313, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 7003633, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:24:58.909 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:24:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:24:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.910 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:24:58.910 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T09:24:58.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:24:58 smithi115 ceph-mon[35055]: pgmap v539: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 32 op/s 2024-09-19T09:24:58.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:24:58 smithi046 ceph-mon[31203]: pgmap v539: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 32 op/s 2024-09-19T09:24:59.647 INFO:tasks.check_counter:Daemon mds.h mds.exported=58 2024-09-19T09:24:59.648 INFO:tasks.check_counter:Daemon mds.h mds.imported=58 2024-09-19T09:24:59.648 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T09:24:59.648 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:24:59.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:24:59.894 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:25:00.384 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 518, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 520, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 4331024, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 164788, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 6, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 2, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.045641967, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.016514294, 2024-09-19T09:25:00.385 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.013044445, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.011477698, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 518, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.018089519, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000034921 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.386 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 284, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 396, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 2577577, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 360391, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 5, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 4, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.030088935, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.010025611, 2024-09-19T09:25:00.387 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.009675098, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.007438791, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 395, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.017935411, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000045406 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-19T09:25:00.388 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 271664 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 696, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 675, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 771410, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 257978, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 4, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 3, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.073642153, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.025472797, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.031641702, 2024-09-19T09:25:00.389 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.016456207, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 674, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.033657782, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000049937 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 599360, 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 94208 2024-09-19T09:25:00.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2316, 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.060365369, 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000026064 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 0, 2024-09-19T09:25:00.392 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-09-19T09:25:00.393 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 1157, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 1157, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 1157, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 1, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 0, 2024-09-19T09:25:00.394 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-09-19T09:25:00.395 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:25:00.396 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 0 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-09-19T09:25:00.397 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:25:00.398 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-09-19T09:25:00.399 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 3962, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 6, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 2, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-09-19T09:25:00.400 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 10893945, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 10892807, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 3962 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 8, 2024-09-19T09:25:00.401 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 1183, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 1175, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 6, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 62, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 56, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 1157, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 2270, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 1113, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 0, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 0, 2024-09-19T09:25:00.402 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 52280, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 215328 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.403 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-09-19T09:25:00.405 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-09-19T09:25:00.407 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.408 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.408 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.408 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.409 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.410 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.411 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.412 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.413 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-09-19T09:25:00.414 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 1, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 1, 2024-09-19T09:25:00.416 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 1, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 1644, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:25:00.417 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-09-19T09:25:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:25:00.419 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 198225, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 56, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-09-19T09:25:00.420 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 7400, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 152, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 840600, 2024-09-19T09:25:00.421 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 4701, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 1312, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 21, 2024-09-19T09:25:00.422 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 3, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 1312, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1312, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.715982968, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000545718 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1312, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1313 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 1312, 2024-09-19T09:25:00.423 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 1312, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 774, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 536, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-09-19T09:25:00.424 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 1, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-09-19T09:25:00.425 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-09-19T09:25:00.426 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 85, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 3, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 6, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 6, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-09-19T09:25:00.427 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 0, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 2, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 0 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 0, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-09-19T09:25:00.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:25:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 1494, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 7533352, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 1494, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 1494, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 7533352, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 1312, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 6700363, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 1312, 2024-09-19T09:25:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 6700363, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:25:00.432 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 1312, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 1312, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 1312, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 1312, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:25:00.433 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.434 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.435 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x5585978cab40": { 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-09-19T09:25:00.436 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T09:25:00.437 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T09:25:00.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:00 smithi115 ceph-mon[35055]: pgmap v540: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 14 op/s 2024-09-19T09:25:00.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:00 smithi046 ceph-mon[31203]: pgmap v540: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 14 op/s 2024-09-19T09:25:01.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:00 smithi099 ceph-mon[35256]: pgmap v540: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 14 op/s 2024-09-19T09:25:01.100 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T09:25:01.100 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T09:25:01.100 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-19T09:25:01.100 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:25:01.101 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:25:01.357 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:25:01.871 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-19T09:25:01.871 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:25:01.871 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 1050, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 1021, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 408534, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 4431419, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 16, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 4, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.103118717, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.037076447, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.039387588, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.025636032, 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:01.872 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1019, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.094205393, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000092448 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 402, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000077838, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000193 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.873 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 2114, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 3188, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 854273, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 3493262, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 9, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 6, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.200132834, 2024-09-19T09:25:01.874 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.098195672, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.084751815, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.019718330, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3188, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.224485034, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000070415 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3692, 2024-09-19T09:25:01.876 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000592292, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000160 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 272336 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 6092, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 9697, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 3952108, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 5857173, 2024-09-19T09:25:01.877 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 19, 2024-09-19T09:25:01.878 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 6, 2024-09-19T09:25:01.878 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.445595604, 2024-09-19T09:25:01.878 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.199674413, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.282804775, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.021290683, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 9695, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.738780634, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000076202 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 12187, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001962335, 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000161 2024-09-19T09:25:01.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1990016, 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 4748144 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:01.880 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 610, 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.429818666, 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002343965 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2010, 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.205655519, 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000102316 2024-09-19T09:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 2631, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 2612, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2612, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2.307163125, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000883293 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-19T09:25:01.882 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 19, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 2, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 11, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 18, 2024-09-19T09:25:01.883 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 2, 2024-09-19T09:25:01.884 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 3, 2024-09-19T09:25:01.884 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 13, 2024-09-19T09:25:01.884 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 14, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 65, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 0, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 0, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 5, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 5269, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 3933, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 19, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 37, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-19T09:25:01.885 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 449, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 37, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 192, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 37, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 1090, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 613, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 4215, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 81948287, 2024-09-19T09:25:01.886 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 613, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 613, 2024-09-19T09:25:01.887 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 332, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 1267, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 845, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 469, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 23, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 2355 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.888 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 37, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 37, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 0, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 1152, 2024-09-19T09:25:01.889 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 1152, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 6, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 3189, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 37, 2024-09-19T09:25:01.890 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 3962, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 3962, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-19T09:25:01.891 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 6, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 6, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 10893945, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 0, 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-19T09:25:01.892 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 120, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.740970427, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.006174753 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 0 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 25, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 1211, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 1186, 2024-09-19T09:25:01.893 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 41, 2024-09-19T09:25:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 69, 2024-09-19T09:25:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 28, 2024-09-19T09:25:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 190, 2024-09-19T09:25:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 2304, 2024-09-19T09:25:01.894 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 2114, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 0, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 2203, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 2203, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 69124, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 223520 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 3954, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 7, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 2631, 2024-09-19T09:25:01.895 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 5, 2024-09-19T09:25:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 1267, 2024-09-19T09:25:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-19T09:25:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 101, 2024-09-19T09:25:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.121140294, 2024-09-19T09:25:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001199408 2024-09-19T09:25:01.896 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.897 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1304, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.400378579, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000307038 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-19T09:25:01.898 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.899 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-19T09:25:01.900 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.901 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-19T09:25:01.902 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 55, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.038874583, 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000706810 2024-09-19T09:25:01.903 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.904 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.905 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-19T09:25:01.906 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.907 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1152, 2024-09-19T09:25:01.908 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.746769669, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001516293 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 1, 2024-09-19T09:25:01.909 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 1, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 0, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 1, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 2033, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 2033, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 1636, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-19T09:25:01.910 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:25:01.911 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:25:01.912 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 295244, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 102, 2024-09-19T09:25:01.913 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 7400, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 152, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:25:01.914 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 265070, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 2783, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 2016, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 6903917, 2024-09-19T09:25:01.915 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 28, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 2016, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2016, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 5.452893949, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002704808 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2016, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2074 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.916 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 2016, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 636, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 1380, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 0, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 10, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 21, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 141, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 23, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-19T09:25:01.917 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 1165, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 613, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 20, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-19T09:25:01.918 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-19T09:25:01.919 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 85, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 3, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 12, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 12, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-19T09:25:01.920 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 61, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 4, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 16 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 1, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 3195 2024-09-19T09:25:01.921 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 6, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 6, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 1152, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 1152, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:01.922 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 9252, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 4194988, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 9252, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 9252, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 4194988, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2016, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 7020237, 2024-09-19T09:25:01.924 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2016, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 7020237, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:01.925 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2016, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 2016, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2016, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 2016, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:25:01.926 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 1152, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 116352, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 1152, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 21, 2024-09-19T09:25:01.927 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 116352, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55f20cd0e960": { 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 3962, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 6699641, 2024-09-19T09:25:01.928 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 3962, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 120, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 6699641, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:01.929 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-19T09:25:02.808 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:02 smithi115 ceph-mon[35055]: pgmap v541: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T09:25:02.835 INFO:tasks.check_counter:Daemon mds.c mds.exported=37 2024-09-19T09:25:02.835 INFO:tasks.check_counter:Daemon mds.c mds.imported=37 2024-09-19T09:25:02.835 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-19T09:25:02.835 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:25:02.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:25:02.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:02 smithi046 ceph-mon[31203]: pgmap v541: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T09:25:03.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:02 smithi099 ceph-mon[35256]: pgmap v541: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T09:25:03.087 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 6848, 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 10562, 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 3771139, 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 10825236, 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 11, 2024-09-19T09:25:03.629 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 5, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.486187274, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.217869678, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.284689156, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.029379866, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 10560, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.673068230, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000063737 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 13481, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.002363659, 2024-09-19T09:25:03.630 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000175 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1567904, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 4969744 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3877, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 2925, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1692902, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 5474456, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 17, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 7, 2024-09-19T09:25:03.631 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.250013961, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.098673154, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.160946165, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.027490232, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2924, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.150870492, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000051597 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 4370, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001299340, 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000297 2024-09-19T09:25:03.632 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 617840, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 98576 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 5728, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 3970, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1683797, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 1802769, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 17, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 7, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.305909337, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.136697284, 2024-09-19T09:25:03.633 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.205342599, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.014149608, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3969, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.150146712, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000037829 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 8311, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001061950, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000127 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 4080, 2024-09-19T09:25:03.634 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 273696 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 783, 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.601213513, 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002044972 2024-09-19T09:25:03.635 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2333, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.180083597, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000077189 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 2961, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 2883, 2024-09-19T09:25:03.636 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2883, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 3.063567678, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001062631 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 78, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 0, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 11, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 822, 2024-09-19T09:25:03.637 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 133, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 58, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 631, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 631, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 32, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 1, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 1, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 4, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 4866, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 4308, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 17, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 39, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:25:03.638 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 3519, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 9, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 7, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 173, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 2023, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 571, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 4215, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 81948287, 2024-09-19T09:25:03.639 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 571, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 571, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 60, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 418, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 1432, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:25:03.640 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 1025, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 499, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 29, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 2592 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 287, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 7, 2024-09-19T09:25:03.641 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 3, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 1244, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 1241, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 6, 2024-09-19T09:25:03.642 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 3405, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 9, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 4487, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-19T09:25:03.643 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 4487, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 7, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 7, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 13155126, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 0, 2024-09-19T09:25:03.644 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 309, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 7.658513226, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.024784832 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 0 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 24, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 1278, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 1254, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 156, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 206, 2024-09-19T09:25:03.645 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 50, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 537, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 3322, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 2785, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 1, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 2333, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 2332, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 72356, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 223520 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 3489, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 3026, 2024-09-19T09:25:03.646 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 2961, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 10, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 6479, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 127, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.137925600, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001086028 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.647 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.648 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1438, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.451854241, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000314224 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-19T09:25:03.649 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000161268, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000161268 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-19T09:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.651 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.652 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000220536, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000220536 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 72, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.049190337, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000683199 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.653 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-19T09:25:03.654 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 24, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.847297330, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.035304055 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.655 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-19T09:25:03.656 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.657 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1220, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.576918366, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001292556 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:25:03.658 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 1, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 2, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 1, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 1, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 2163, 2024-09-19T09:25:03.659 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 2163, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 385, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:25:03.660 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:25:03.661 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:25:03.662 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 279350, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 99, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-19T09:25:03.663 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 7400, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 152, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 892764, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 6764, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.664 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 2328, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 9186301, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 32, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 2328, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2328, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 5.409894941, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002323838 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-19T09:25:03.665 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2328, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2394 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 2328, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 612, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 1716, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 0, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 10, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 41, 2024-09-19T09:25:03.666 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 350, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 36, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 1274, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 571, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 20, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:25:03.667 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-19T09:25:03.668 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 85, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-19T09:25:03.669 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 3, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 12, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 12, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 71, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 0, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 21 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 1, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-19T09:25:03.670 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 3411 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 6, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 1260, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 1241, 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-19T09:25:03.671 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 16449, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 5454344, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 16449, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 16449, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 5454344, 2024-09-19T09:25:03.672 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:03.673 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2328, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 9311658, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2328, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 9311658, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-19T09:25:03.674 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2328, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 2328, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2328, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 2328, 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:03.675 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 1241, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 125357, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 1241, 2024-09-19T09:25:03.676 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 41, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 125357, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55ab42d9e960": { 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:03.677 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 4487, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 8960822, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 4487, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 309, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 8960822, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:03.678 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:03.679 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:03.679 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.679 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:03.679 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-19T09:25:04.437 INFO:tasks.check_counter:Daemon mds.f mds.exported=9 2024-09-19T09:25:04.437 INFO:tasks.check_counter:Daemon mds.f mds.imported=173 2024-09-19T09:25:04.437 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-19T09:25:04.437 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:25:04.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:25:04.686 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:25:04.709 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:04 smithi115 ceph-mon[35055]: pgmap v542: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T09:25:04.991 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:04 smithi046 ceph-mon[31203]: pgmap v542: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T09:25:05.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:04 smithi099 ceph-mon[35256]: pgmap v542: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T09:25:05.198 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 5620, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 9648, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 2634488, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 13915576, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 21, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 4, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.421149707, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.195300151, 2024-09-19T09:25:05.199 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.231277769, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.032909328, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 9645, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.540528535, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000056042 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 10724, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001738048, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000162 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.200 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 2240384, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 5465920 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3428, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 4762, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 2336773, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 2009760, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 10, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 6, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.256336640, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.106486559, 2024-09-19T09:25:05.201 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.131167490, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.025370139, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 4761, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.170116164, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000035731 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 6110, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001229962, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000201 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-19T09:25:05.202 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 272640 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3055, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 3850, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1227540, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 1490805, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 14, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 5, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.226114789, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.104248365, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.117438760, 2024-09-19T09:25:05.203 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.018002935, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3850, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.183356808, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000047625 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 5540, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000866044, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000156 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:25:05.204 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 791, 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.519782111, 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001921342 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.205 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2431, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.201311051, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000082809 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 2999, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 2961, 2024-09-19T09:25:05.206 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2961, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2.923451089, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000987318 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 38, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 7, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 11, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-19T09:25:05.207 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 12, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 0, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 1, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 11, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 11, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 140, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 0, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 0, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 3, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 5818, 2024-09-19T09:25:05.208 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 4440, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 30, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 14, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 0, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 35, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 192, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 50, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 1411, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-19T09:25:05.209 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 612, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 4215, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 81948287, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 0, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 612, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 8, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 8, 2024-09-19T09:25:05.210 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 604, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 33, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 516, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 1514, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 1137, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 552, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 42, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 2708 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.211 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 37, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 34, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 1344, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 1344, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-19T09:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 6, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 3841, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 35, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-19T09:25:05.213 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 4513, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 4513, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 6, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-19T09:25:05.214 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 6, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 12103024, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 0, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 233, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.177606032, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.005054103 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 0 2024-09-19T09:25:05.215 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 18, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 1401, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 1383, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 30, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 96, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 66, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 197, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 2820, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 2623, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 0, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 2570, 2024-09-19T09:25:05.216 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 2570, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 69988, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 223520 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 4671, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 341, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 2999, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 9, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 1942, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 84, 2024-09-19T09:25:05.217 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.121743393, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001449326 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000174810, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000174810 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.218 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1460, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.435791565, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000298487 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.219 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.220 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.221 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.222 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 72, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.054033801, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000750469 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.224 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 28, 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.465657327, 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.016630618 2024-09-19T09:25:05.225 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.226 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.227 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.228 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1316, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.846050193, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001402773 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.229 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 1, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 2, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 1, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 1, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 2388, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 2388, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 1642, 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-19T09:25:05.230 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:25:05.231 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:25:05.232 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:25:05.233 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 295260, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 102, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 7400, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 152, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:25:05.234 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 177337, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 1844, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 2396, 2024-09-19T09:25:05.235 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 8143716, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 28, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 2396, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2396, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 6.332876788, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002643103 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2396, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2482 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.236 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 2396, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 660, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 1736, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 0, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 10, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 41, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 274, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 35, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-19T09:25:05.237 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 1365, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 617, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 20, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-19T09:25:05.238 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-19T09:25:05.239 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 85, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-19T09:25:05.240 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 3, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 12, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 12, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 80, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 14, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 26 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 1, 2024-09-19T09:25:05.241 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 3847 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 14, 2024-09-19T09:25:05.242 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 6, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 1352, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 1344, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 12099, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 4892097, 2024-09-19T09:25:05.243 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 12099, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 12099, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 4892097, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-19T09:25:05.244 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2396, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 8279356, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2396, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 8279356, 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:05.246 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 2396, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 2396, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 2396, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 2396, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.247 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 1344, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 135752, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 1344, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:05.248 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 41, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 135752, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55c53071c960": { 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 4513, 2024-09-19T09:25:05.249 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 7908720, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 4513, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 233, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 7908720, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:05.250 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-19T09:25:06.072 INFO:tasks.check_counter:Daemon mds.i mds.exported=35 2024-09-19T09:25:06.072 INFO:tasks.check_counter:Daemon mds.i mds.imported=50 2024-09-19T09:25:06.073 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-19T09:25:06.073 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:25:06.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:25:06.317 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:25:06.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:06 smithi115 ceph-mon[35055]: pgmap v543: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:25:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-19T09:25:06.841 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:25:06.841 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 1508, 2024-09-19T09:25:06.841 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 1508, 2024-09-19T09:25:06.841 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 8336603, 2024-09-19T09:25:06.841 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 478727, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 6, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 2, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.124306858, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.039339215, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.035455810, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.039575024, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1507, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.058435906, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000038776 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 119, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 716, 2024-09-19T09:25:06.843 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 275498, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 4, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.006851266, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.004692275, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.000931083, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000065645, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 117, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.007543602, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000064475 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.844 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 274800 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 184, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 163, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 600172, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 95806, 2024-09-19T09:25:06.845 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 3, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 2, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.024275647, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.010353488, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.018058122, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000035627, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 162, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.010394351, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000064162 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:25:06.846 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 599904, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 95488 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:06.847 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2579, 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.063654550, 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000024681 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.848 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 0, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 0, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 0, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 0, 2024-09-19T09:25:06.849 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 1349, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 1349, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 1349, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 0, 2024-09-19T09:25:06.850 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 1, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 0, 2024-09-19T09:25:06.851 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:25:06.852 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 0, 2024-09-19T09:25:06.853 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 0 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 0, 2024-09-19T09:25:06.854 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:25:06.855 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 0, 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-19T09:25:06.856 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 4513, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 6, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-19T09:25:06.857 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 12103024, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 12100740, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 4513 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 8, 2024-09-19T09:25:06.858 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 1377, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 1369, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 6, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 95, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 89, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 1349, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 2786, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 1437, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 0, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 0, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 0, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 51008, 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 215328 2024-09-19T09:25:06.859 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 0, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 0, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 0, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 0, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 0, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-19T09:25:06.860 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.861 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.862 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.863 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.864 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.865 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.866 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.867 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-19T09:25:06.868 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.869 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.870 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.871 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 1, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 2, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 1, 2024-09-19T09:25:06.872 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 1, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 1644, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:25:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-19T09:25:06.874 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-19T09:25:06.875 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 181320, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 47, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-19T09:25:06.876 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 7400, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 152, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 975768, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 5469, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-19T09:25:06.877 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 1507, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 21, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 3, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 1507, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1507, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.657987338, 2024-09-19T09:25:06.878 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000436620 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1507, 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1508 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 1507, 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 1507, 2024-09-19T09:25:06.879 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 937, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 568, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 0, 2024-09-19T09:25:06.880 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 1, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:25:06.881 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-19T09:25:06.882 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 85, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 3, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 4, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 4, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-19T09:25:06.883 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 0, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 2, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 0 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 0, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 0 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.884 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:06.885 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 1691, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 8772998, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 1691, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 1691, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 8772998, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.886 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 1507, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 7908725, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 1507, 2024-09-19T09:25:06.887 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 7908725, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:06.888 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 1507, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 1507, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 1507, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 1507, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.889 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-19T09:25:06.890 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55cfce452b40": { 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-19T09:25:06.891 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-19T09:25:06.892 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-19T09:25:06.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:06 smithi046 ceph-mon[31203]: pgmap v543: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:25:07.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:06 smithi099 ceph-mon[35256]: pgmap v543: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-19T09:25:07.691 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T09:25:07.691 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T09:25:07.691 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-19T09:25:07.691 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:25:07.702 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:25:07.702 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:25:07.702 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:07.724 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:25:07.725 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:07.785 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:25:08.094 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.604+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/4130492945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca010c170 msgr2=0x7f6ca010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.604+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/4130492945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca010c170 0x7f6ca010e610 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009ca0 tx=0x7f6c9802a950 comp rx=0 tx=0).stop 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/4130492945 shutdown_connections 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/4130492945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca010c170 0x7f6ca010e610 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/4130492945 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ca0103660 0x7f6ca010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/4130492945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca0102d40 0x7f6ca0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/4130492945 >> 172.21.15.46:0/4130492945 conn(0x7f6ca00fc7a0 msgr2=0x7f6ca00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/4130492945 shutdown_connections 2024-09-19T09:25:08.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/4130492945 wait complete. 2024-09-19T09:25:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.605+0000 7f6ca4b2f640 1 Processor -- start 2024-09-19T09:25:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 -- start start 2024-09-19T09:25:08.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ca0102d40 0x7f6ca0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 0x7f6ca0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca010c170 0x7f6ca019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0112000 con 0x7f6ca0103660 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0111e80 con 0x7f6ca010c170 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6ca4b2f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca0112180 con 0x7f6ca0102d40 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 0x7f6ca0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 0x7f6ca0198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52908/0 (socket says 172.21.15.46:52908) 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 -- 172.21.15.46:0/995944502 learned_addr learned my addr 172.21.15.46:0/995944502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9e59c640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ca0102d40 0x7f6ca0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9ed9d640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca010c170 0x7f6ca019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 -- 172.21.15.46:0/995944502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ca0102d40 msgr2=0x7f6ca0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ca0102d40 0x7f6ca0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 -- 172.21.15.46:0/995944502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca010c170 msgr2=0x7f6ca019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca010c170 0x7f6ca019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 -- 172.21.15.46:0/995944502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca019d3f0 con 0x7f6ca0103660 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.606+0000 7f6c9dd9b640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 0x7f6ca0198980 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400d740 tx=0x7f6c9400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.607+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c94017070 con 0x7f6ca0103660 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.607+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca019d6e0 con 0x7f6ca0103660 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.607+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c94010460 con 0x7f6ca0103660 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.607+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca01a4fc0 con 0x7f6ca0103660 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.607+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9400f620 con 0x7f6ca0103660 2024-09-19T09:25:08.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.608+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca0103120 con 0x7f6ca0103660 2024-09-19T09:25:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.609+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6c94010610 con 0x7f6ca0103660 2024-09-19T09:25:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.610+0000 7f6c8f7fe640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c880a32c0 0x7f6c880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.610+0000 7f6c9e59c640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c880a32c0 0x7f6c880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.610+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f6c940cf7b0 con 0x7f6ca0103660 2024-09-19T09:25:08.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.610+0000 7f6c9e59c640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c880a32c0 0x7f6c880a5780 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009990 tx=0x7f6c90009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.613+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c9409c520 con 0x7f6ca0103660 2024-09-19T09:25:08.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.800+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ca0106c50 con 0x7f6ca0103660 2024-09-19T09:25:08.802 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:08 smithi046 ceph-mon[31203]: pgmap v544: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T09:25:08.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.800+0000 7f6c8f7fe640 1 -- 172.21.15.46:0/995944502 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+592 (secure 0 0 0) 0x7f6c9409be20 con 0x7f6ca0103660 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3574702566 2024-09-20T09:09:28.870189+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/4173084876 2024-09-20T09:09:28.870189+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2790675564 2024-09-20T09:09:28.870189+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2471470384 2024-09-20T09:09:28.870189+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/4173084876 2024-09-20T09:09:28.870189+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1027758264 2024-09-20T09:09:05.243596+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3215761570 2024-09-20T09:09:05.243596+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2938067554 2024-09-20T09:09:05.243596+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2938067554 2024-09-20T09:09:05.243596+0000 2024-09-19T09:25:08.803 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2165633086 2024-09-20T09:09:05.243596+0000 2024-09-19T09:25:08.804 INFO:teuthology.orchestra.run.smithi046.stderr:listed 10 entries 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c880a32c0 msgr2=0x7f6c880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c880a32c0 0x7f6c880a5780 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009990 tx=0x7f6c90009110 comp rx=0 tx=0).stop 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 msgr2=0x7f6ca0198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 0x7f6ca0198980 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400d740 tx=0x7f6c9400db40 comp rx=0 tx=0).stop 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 shutdown_connections 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6c880a32c0 0x7f6c880a5780 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6ca0103660 0x7f6ca0198980 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ca010c170 0x7f6ca019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 --2- 172.21.15.46:0/995944502 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ca0102d40 0x7f6ca0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 >> 172.21.15.46:0/995944502 conn(0x7f6ca00fc7a0 msgr2=0x7f6ca00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 shutdown_connections 2024-09-19T09:25:08.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:08.803+0000 7f6ca4b2f640 1 -- 172.21.15.46:0/995944502 wait complete. 2024-09-19T09:25:08.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:08 smithi115 ceph-mon[35055]: pgmap v544: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T09:25:09.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:08 smithi099 ceph-mon[35256]: pgmap v544: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T09:25:09.675 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:25:09.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:09.675 DEBUG:teuthology.orchestra.run.smithi046:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:25:09.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:25:09.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:09.786 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:25:09.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:09.825 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-19T09:25:09.906 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:25:09.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:09.907 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:25:09.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:09 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/995944502' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:25:09.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:09 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/995944502' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:25:10.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:10.009 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-19T09:25:10.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:09 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/995944502' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:25:10.106 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:25:10.106 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-19T09:25:10.106 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:10.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056796,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18652 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/d013f92e9eb5bfe70f3cec82304cf4e8509e9e5cb45a268e741e355c1e5b21e2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/d013f92e9eb5bfe70f3cec82304cf4e8509e9e5cb45a268e741e355c1e5b21e2/diff,workdir=/var/lib/containers/storage/overlay/d013f92e9eb5bfe70f3cec82304cf4e8509e9e5cb45a268e741e355c1e5b21e2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1d767e2491aaaaeb61d36d825fc4b6b7ae4161d701860061214a4ee61e6d43df/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/1d767e2491aaaaeb61d36d825fc4b6b7ae4161d701860061214a4ee61e6d43df/diff,workdir=/var/lib/containers/storage/overlay/1d767e2491aaaaeb61d36d825fc4b6b7ae4161d701860061214a4ee61e6d43df/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/623ea49ce4b57a6a1c5a12d748c91e62dd04d6c8c6d30769192fc328d2483766/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/623ea49ce4b57a6a1c5a12d748c91e62dd04d6c8c6d30769192fc328d2483766/diff,workdir=/var/lib/containers/storage/overlay/623ea49ce4b57a6a1c5a12d748c91e62dd04d6c8c6d30769192fc328d2483766/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ca2f8c86f7ffae23be0e2f39728f572e1291aeff7225ad4971fbef1ca6acbf55/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/ca2f8c86f7ffae23be0e2f39728f572e1291aeff7225ad4971fbef1ca6acbf55/diff,workdir=/var/lib/containers/storage/overlay/ca2f8c86f7ffae23be0e2f39728f572e1291aeff7225ad4971fbef1ca6acbf55/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e98a837733bb392598961e0ff21a394a00e3080bbaee65552999b75cc97f8334/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/e98a837733bb392598961e0ff21a394a00e3080bbaee65552999b75cc97f8334/diff,workdir=/var/lib/containers/storage/overlay/e98a837733bb392598961e0ff21a394a00e3080bbaee65552999b75cc97f8334/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d782e6d5d4baeaf0f8c46e9d5228172e41b7d0a7b335d7ccb805620bbfa65798/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/d782e6d5d4baeaf0f8c46e9d5228172e41b7d0a7b335d7ccb805620bbfa65798/diff,workdir=/var/lib/containers/storage/overlay/d782e6d5d4baeaf0f8c46e9d5228172e41b7d0a7b335d7ccb805620bbfa65798/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/083d6e862b942f7e578c3a298fc6021a88fe2ff27aa23f3de519f6923483b4c9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/083d6e862b942f7e578c3a298fc6021a88fe2ff27aa23f3de519f6923483b4c9/diff,workdir=/var/lib/containers/storage/overlay/083d6e862b942f7e578c3a298fc6021a88fe2ff27aa23f3de519f6923483b4c9/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/353ff2340a27fa4c13971c2138625037ad9063937f4a9eda0bc749dcdb391d77/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/353ff2340a27fa4c13971c2138625037ad9063937f4a9eda0bc749dcdb391d77/diff,workdir=/var/lib/containers/storage/overlay/353ff2340a27fa4c13971c2138625037ad9063937f4a9eda0bc749dcdb391d77/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a0e358a41b3310529ba219eef16f28ed87b053aaa146932aefdea841b3facfbe/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/a0e358a41b3310529ba219eef16f28ed87b053aaa146932aefdea841b3facfbe/diff,workdir=/var/lib/containers/storage/overlay/a0e358a41b3310529ba219eef16f28ed87b053aaa146932aefdea841b3facfbe/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b1f1b8659274c670c1762bf7d421417f5d750fddcf39081b77782f0bf3c6fa65/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/3KFXJPODDY3UM5K2L2SDKWQAPN:/var/lib/containers/storage/overlay/l/3WZHE35ELGP3M2PDCY3ZGDKQCO,upperdir=/var/lib/containers/storage/overlay/b1f1b8659274c670c1762bf7d421417f5d750fddcf39081b77782f0bf3c6fa65/diff,workdir=/var/lib/containers/storage/overlay/b1f1b8659274c670c1762bf7d421417f5d750fddcf39081b77782f0bf3c6fa65/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-19T09:25:10.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:10.124 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-19T09:25:10.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:10.181 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-19T09:25:10.251 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-09-19T09:25:10.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:10.252 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:25:10.267 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:25:10.267 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:25:10.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:10.814 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:10 smithi046 ceph-mon[31203]: pgmap v545: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-19T09:25:10.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:10 smithi115 ceph-mon[35055]: pgmap v545: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-19T09:25:11.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:10 smithi099 ceph-mon[35256]: pgmap v545: 97 pgs: 97 active+clean; 34 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-09-19T09:25:11.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 -- 172.21.15.46:0/2255276828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 msgr2=0x7ff0d010bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/2255276828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d010bb40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009900 tx=0x7ff0bc02a480 comp rx=0 tx=0).stop 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 -- 172.21.15.46:0/2255276828 shutdown_connections 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/2255276828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d010bb40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/2255276828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d010c160 0x7ff0d010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/2255276828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d0102d30 0x7ff0d0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 -- 172.21.15.46:0/2255276828 >> 172.21.15.46:0/2255276828 conn(0x7ff0d00fc7d0 msgr2=0x7ff0d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 -- 172.21.15.46:0/2255276828 shutdown_connections 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 -- 172.21.15.46:0/2255276828 wait complete. 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 Processor -- start 2024-09-19T09:25:11.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.140+0000 7ff0d6b59640 1 -- start start 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d6b59640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d0102d30 0x7ff0d0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d6b59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d6b59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d010c160 0x7ff0d019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d6b59640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d0111f60 con 0x7ff0d0103650 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d6b59640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d0111de0 con 0x7ff0d010c160 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d6b59640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01120e0 con 0x7ff0d0102d30 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d0198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52928/0 (socket says 172.21.15.46:52928) 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 -- 172.21.15.46:0/4232035896 learned_addr learned my addr 172.21.15.46:0/4232035896 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d48f5640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d0102d30 0x7ff0d0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0d50f6640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d010c160 0x7ff0d019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 -- 172.21.15.46:0/4232035896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d0102d30 msgr2=0x7ff0d0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d0102d30 0x7ff0d0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 -- 172.21.15.46:0/4232035896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d010c160 msgr2=0x7ff0d019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d010c160 0x7ff0d019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 -- 172.21.15.46:0/4232035896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d019d3f0 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.141+0000 7ff0cffff640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d0198980 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc006010 tx=0x7ff0bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.142+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc03f030 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.142+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0bc003ce0 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.142+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc035070 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.142+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d019d680 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.142+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d01a4fc0 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.143+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d0103110 con 0x7ff0d0103650 2024-09-19T09:25:11.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.144+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0bc042030 con 0x7ff0d0103650 2024-09-19T09:25:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.145+0000 7ff0cdffb640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff0c00a32c0 0x7ff0c00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.145+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7ff0bc0efd90 con 0x7ff0d0103650 2024-09-19T09:25:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.145+0000 7ff0d48f5640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff0c00a32c0 0x7ff0c00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.145+0000 7ff0d48f5640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff0c00a32c0 0x7ff0c00a5780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005fd0 tx=0x7ff0c400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.149+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0bc0bc550 con 0x7ff0d0103650 2024-09-19T09:25:11.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.360+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0d01071d0 con 0x7ff0d0103650 2024-09-19T09:25:11.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.361+0000 7ff0cdffb640 1 -- 172.21.15.46:0/4232035896 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11972 (secure 0 0 0) 0x7ff0bc0c0850 con 0x7ff0d0103650 2024-09-19T09:25:11.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:25:11.363 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":45,"btime":"2024-09-19T09:24:45:505789+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:24:44.883919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:25:11.364 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 45 2024-09-19T09:25:11.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff0c00a32c0 msgr2=0x7ff0c00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff0c00a32c0 0x7ff0c00a5780 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005fd0 tx=0x7ff0c400b390 comp rx=0 tx=0).stop 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 msgr2=0x7ff0d0198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d0198980 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc006010 tx=0x7ff0bc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 shutdown_connections 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7ff0c00a32c0 0x7ff0c00a5780 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0d0103650 0x7ff0d0198980 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0d010c160 0x7ff0d019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 --2- 172.21.15.46:0/4232035896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0d0102d30 0x7ff0d0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.363+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 >> 172.21.15.46:0/4232035896 conn(0x7ff0d00fc7d0 msgr2=0x7ff0d00fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.364+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 shutdown_connections 2024-09-19T09:25:11.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:11.364+0000 7ff0d6b59640 1 -- 172.21.15.46:0/4232035896 wait complete. 2024-09-19T09:25:11.817 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:11 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4232035896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:11.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:11 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4232035896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:12.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:11 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4232035896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:12.064 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:12.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:12 smithi046 ceph-mon[31203]: pgmap v546: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 -- 172.21.15.46:0/93515232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 msgr2=0x7f6c041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/93515232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c041021c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4009900 tx=0x7f6bf402a410 comp rx=0 tx=0).stop 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 -- 172.21.15.46:0/93515232 shutdown_connections 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/93515232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04106f10 0x7f6c0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/93515232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c04102790 0x7f6c041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/93515232 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c041021c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 -- 172.21.15.46:0/93515232 >> 172.21.15.46:0/93515232 conn(0x7f6c040fd8c0 msgr2=0x7f6c040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 -- 172.21.15.46:0/93515232 shutdown_connections 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.764+0000 7f6c0a68c640 1 -- 172.21.15.46:0/93515232 wait complete. 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 Processor -- start 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 -- start start 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04102790 0x7f6c04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c04106f10 0x7f6c04074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04111f70 con 0x7f6c04101de0 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c04111df0 con 0x7f6c04102790 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c0a68c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6c041120f0 con 0x7f6c04106f10 2024-09-19T09:25:12.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52948/0 (socket says 172.21.15.46:52948) 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c03fff640 1 -- 172.21.15.46:0/917037313 learned_addr learned my addr 172.21.15.46:0/917037313 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c08c29640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c04106f10 0x7f6c04074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.765+0000 7f6c037fe640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04102790 0x7f6c04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c03fff640 1 -- 172.21.15.46:0/917037313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c04106f10 msgr2=0x7f6c04074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c03fff640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c04106f10 0x7f6c04074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c03fff640 1 -- 172.21.15.46:0/917037313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04102790 msgr2=0x7f6c04074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c03fff640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04102790 0x7f6c04074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c03fff640 1 -- 172.21.15.46:0/917037313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c041a6890 con 0x7f6c04101de0 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c03fff640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c040744f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4006010 tx=0x7f6bf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf403f030 con 0x7f6c04101de0 2024-09-19T09:25:12.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bf4003ce0 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c041a6b20 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4035070 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.766+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c041a7000 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.767+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c041021c0 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.768+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6bf4042030 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.769+0000 7f6c017fa640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6bec0a3240 0x7f6bec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.769+0000 7f6c037fe640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6bec0a3240 0x7f6bec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.769+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f6bf40efe50 con 0x7f6c04101de0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.769+0000 7f6c037fe640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6bec0a3240 0x7f6bec0a5700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8005fd0 tx=0x7f6bf8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.773+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bf40bcc00 con 0x7f6c04101de0 2024-09-19T09:25:12.861 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:12 smithi115 ceph-mon[35055]: pgmap v546: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:25:12.914 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:12 smithi099 ceph-mon[35256]: pgmap v546: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-19T09:25:12.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.985+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c0410a0f0 con 0x7f6c04101de0 2024-09-19T09:25:12.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.986+0000 7f6c017fa640 1 -- 172.21.15.46:0/917037313 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11972 (secure 0 0 0) 0x7f6bf40bc500 con 0x7f6c04101de0 2024-09-19T09:25:12.988 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:25:12.988 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":45,"btime":"2024-09-19T09:24:45:505789+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14526,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6835/1645318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6834","nonce":1645318124},{"type":"v1","addr":"172.21.15.46:6835","nonce":1645318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14538,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6837/4123039561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6836","nonce":4123039561},{"type":"v1","addr":"172.21.15.46:6837","nonce":4123039561}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:16:24.646046+0000","modified":"2024-09-19T09:24:44.883919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24476,"mds_1":24472,"mds_2":24463,"mds_3":24451,"mds_4":24446},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14589":{"gid":14589,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6839/1918563776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6838","nonce":1918563776},{"type":"v1","addr":"172.21.15.46:6839","nonce":1918563776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14601":{"gid":14601,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6841/321773391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6840","nonce":321773391},{"type":"v1","addr":"172.21.15.46:6841","nonce":321773391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24398":{"gid":24398,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/51140188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":51140188},{"type":"v1","addr":"172.21.15.99:6833","nonce":51140188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6833/2187922257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2187922257},{"type":"v1","addr":"172.21.15.115:6833","nonce":2187922257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24446":{"gid":24446,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":75,"addr":"172.21.15.99:6837/58768930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":58768930},{"type":"v1","addr":"172.21.15.99:6837","nonce":58768930}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.115:6835/3610194671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3610194671},{"type":"v1","addr":"172.21.15.115:6835","nonce":3610194671}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":75,"addr":"172.21.15.115:6837/1753777056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1753777056},{"type":"v1","addr":"172.21.15.115:6837","nonce":1753777056}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":73,"addr":"172.21.15.115:6839/1737720182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1737720182},{"type":"v1","addr":"172.21.15.115:6839","nonce":1737720182}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.99:6839/718433968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":718433968},{"type":"v1","addr":"172.21.15.99:6839","nonce":718433968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25838":{"gid":25838,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6835/4168570416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":4168570416},{"type":"v1","addr":"172.21.15.99:6835","nonce":4168570416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476,24463,24451,24472,24446]},"id":1}]} 2024-09-19T09:25:12.988 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 45 2024-09-19T09:25:12.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6bec0a3240 msgr2=0x7f6bec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6bec0a3240 0x7f6bec0a5700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8005fd0 tx=0x7f6bf8005850 comp rx=0 tx=0).stop 2024-09-19T09:25:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 msgr2=0x7f6c040744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c040744f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4006010 tx=0x7f6bf40042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 shutdown_connections 2024-09-19T09:25:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f6bec0a3240 0x7f6bec0a5700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c04106f10 0x7f6c04074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c04102790 0x7f6c04074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 --2- 172.21.15.46:0/917037313 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6c04101de0 0x7f6c040744f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 >> 172.21.15.46:0/917037313 conn(0x7f6c040fd8c0 msgr2=0x7f6c040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 shutdown_connections 2024-09-19T09:25:12.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:12.988+0000 7f6c0a68c640 1 -- 172.21.15.46:0/917037313 wait complete. 2024-09-19T09:25:13.637 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:25:13.901 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:13.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:13 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/917037313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:13.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:13 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/917037313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:14.012 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:13 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/917037313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 -- 172.21.15.46:0/1964035075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 msgr2=0x7f0424110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 --2- 172.21.15.46:0/1964035075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f0424110870 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f041c009ca0 tx=0x7f041c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 -- 172.21.15.46:0/1964035075 shutdown_connections 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 --2- 172.21.15.46:0/1964035075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f0424110870 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 --2- 172.21.15.46:0/1964035075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 0x7f042410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 --2- 172.21.15.46:0/1964035075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f0424100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 -- 172.21.15.46:0/1964035075 >> 172.21.15.46:0/1964035075 conn(0x7f04240fc7a0 msgr2=0x7f04240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 -- 172.21.15.46:0/1964035075 shutdown_connections 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 -- 172.21.15.46:0/1964035075 wait complete. 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 Processor -- start 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.386+0000 7f042b7e5640 1 -- start start 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f042b7e5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f042419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f042b7e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 0x7f042419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f042b7e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f042419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f042b7e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f04241141c0 con 0x7f042410e480 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f042b7e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0424114040 con 0x7f0424101280 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f042b7e5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0424114340 con 0x7f04241008d0 2024-09-19T09:25:14.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429581640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f042419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429d82640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f042419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0428d80640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 0x7f042419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429581640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f042419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.46:46218/0 (socket says 172.21.15.46:46218) 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429d82640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f042419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:52970/0 (socket says 172.21.15.46:52970) 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429581640 1 -- 172.21.15.46:0/769838519 learned_addr learned my addr 172.21.15.46:0/769838519 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0428d80640 1 -- 172.21.15.46:0/769838519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 msgr2=0x7f042419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0428d80640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f042419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0428d80640 1 -- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 msgr2=0x7f042419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0428d80640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f042419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0428d80640 1 -- 172.21.15.46:0/769838519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042419f6b0 con 0x7f0424101280 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429581640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f042419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:14.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.387+0000 7f0429d82640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f042419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.388+0000 7f0428d80640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 0x7f042419ac40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f041400d6d0 tx=0x7f041400db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.388+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414017070 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.388+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0414009820 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.388+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414004d00 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.388+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042419f9a0 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.388+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04241a7280 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.389+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0424100cb0 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.390+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f04140099d0 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.391+0000 7f041a7fc640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04100a32c0 0x7f04100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.391+0000 7f0429581640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04100a32c0 0x7f04100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.391+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f04140cf380 con 0x7f0424101280 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.391+0000 7f0429581640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04100a32c0 0x7f04100a5780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0420011500 tx=0x7f0420005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:14.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.394+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f041409baa0 con 0x7f0424101280 2024-09-19T09:25:14.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.572+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0424109610 con 0x7f0424101280 2024-09-19T09:25:14.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.573+0000 7f041a7fc640 1 -- 172.21.15.46:0/769838519 <== mon.2 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22631 (secure 0 0 0) 0x7f041409fda0 con 0x7f0424101280 2024-09-19T09:25:14.576 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-19T09:25:14.576 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":85,"fsid":"a514acda-7666-11ef-bceb-c7b262605968","created":"2024-09-19T09:08:41.072871+0000","modified":"2024-09-19T09:21:28.876836+0000","last_up_change":"2024-09-19T09:15:31.233667+0000","last_in_change":"2024-09-19T09:15:07.895406+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:11:45.380119+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:16:20.505085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:16:22.965130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"84984725-789b-44a1-be8f-fef0fb7b9f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6803","nonce":1945664236}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6805","nonce":1945664236}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6809","nonce":1945664236}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":1945664236},{"type":"v1","addr":"172.21.15.46:6807","nonce":1945664236}]},"public_addr":"172.21.15.46:6803/1945664236","cluster_addr":"172.21.15.46:6805/1945664236","heartbeat_back_addr":"172.21.15.46:6809/1945664236","heartbeat_front_addr":"172.21.15.46:6807/1945664236","state":["exists","up"]},{"osd":1,"uuid":"c1fce610-b700-449a-8d05-4f83c4db271b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6801","nonce":469175428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6803","nonce":469175428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6807","nonce":469175428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":469175428},{"type":"v1","addr":"172.21.15.99:6805","nonce":469175428}]},"public_addr":"172.21.15.99:6801/469175428","cluster_addr":"172.21.15.99:6803/469175428","heartbeat_back_addr":"172.21.15.99:6807/469175428","heartbeat_front_addr":"172.21.15.99:6805/469175428","state":["exists","up"]},{"osd":2,"uuid":"61ebc0bf-183f-43b4-85c4-c891cda4dc2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6801","nonce":888012303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6803","nonce":888012303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6807","nonce":888012303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":888012303},{"type":"v1","addr":"172.21.15.115:6805","nonce":888012303}]},"public_addr":"172.21.15.115:6801/888012303","cluster_addr":"172.21.15.115:6803/888012303","heartbeat_back_addr":"172.21.15.115:6807/888012303","heartbeat_front_addr":"172.21.15.115:6805/888012303","state":["exists","up"]},{"osd":3,"uuid":"908f304e-8b1b-4ca4-9eea-b0948e997f0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6811","nonce":3435329392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6813","nonce":3435329392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6817","nonce":3435329392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3435329392},{"type":"v1","addr":"172.21.15.46:6815","nonce":3435329392}]},"public_addr":"172.21.15.46:6811/3435329392","cluster_addr":"172.21.15.46:6813/3435329392","heartbeat_back_addr":"172.21.15.46:6817/3435329392","heartbeat_front_addr":"172.21.15.46:6815/3435329392","state":["exists","up"]},{"osd":4,"uuid":"20a50b73-a051-4d3d-927d-1a9ea780e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6809","nonce":3922710855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6811","nonce":3922710855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6815","nonce":3922710855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":3922710855},{"type":"v1","addr":"172.21.15.99:6813","nonce":3922710855}]},"public_addr":"172.21.15.99:6809/3922710855","cluster_addr":"172.21.15.99:6811/3922710855","heartbeat_back_addr":"172.21.15.99:6815/3922710855","heartbeat_front_addr":"172.21.15.99:6813/3922710855","state":["exists","up"]},{"osd":5,"uuid":"384f0d2b-a76a-423c-8e2e-f53d330e1a6a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6809","nonce":1551008641}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6811","nonce":1551008641}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6815","nonce":1551008641}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1551008641},{"type":"v1","addr":"172.21.15.115:6813","nonce":1551008641}]},"public_addr":"172.21.15.115:6809/1551008641","cluster_addr":"172.21.15.115:6811/1551008641","heartbeat_back_addr":"172.21.15.115:6815/1551008641","heartbeat_front_addr":"172.21.15.115:6813/1551008641","state":["exists","up"]},{"osd":6,"uuid":"c8122b9b-6ca9-4d55-aa49-303e5b409314","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6819","nonce":2376082017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6821","nonce":2376082017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6825","nonce":2376082017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":2376082017},{"type":"v1","addr":"172.21.15.46:6823","nonce":2376082017}]},"public_addr":"172.21.15.46:6819/2376082017","cluster_addr":"172.21.15.46:6821/2376082017","heartbeat_back_addr":"172.21.15.46:6825/2376082017","heartbeat_front_addr":"172.21.15.46:6823/2376082017","state":["exists","up"]},{"osd":7,"uuid":"37c74014-9375-4c7f-acff-71d0156c2d27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6817","nonce":1504821892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6819","nonce":1504821892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6823","nonce":1504821892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1504821892},{"type":"v1","addr":"172.21.15.99:6821","nonce":1504821892}]},"public_addr":"172.21.15.99:6817/1504821892","cluster_addr":"172.21.15.99:6819/1504821892","heartbeat_back_addr":"172.21.15.99:6823/1504821892","heartbeat_front_addr":"172.21.15.99:6821/1504821892","state":["exists","up"]},{"osd":8,"uuid":"6e366800-9368-47ba-be88-2eb812acc566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6817","nonce":849207919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6819","nonce":849207919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6823","nonce":849207919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":849207919},{"type":"v1","addr":"172.21.15.115:6821","nonce":849207919}]},"public_addr":"172.21.15.115:6817/849207919","cluster_addr":"172.21.15.115:6819/849207919","heartbeat_back_addr":"172.21.15.115:6823/849207919","heartbeat_front_addr":"172.21.15.115:6821/849207919","state":["exists","up"]},{"osd":9,"uuid":"e6698a57-d371-439e-9f43-56e1bce6d146","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6827","nonce":4010805716}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6829","nonce":4010805716}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6832","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6833","nonce":4010805716}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6830","nonce":4010805716},{"type":"v1","addr":"172.21.15.46:6831","nonce":4010805716}]},"public_addr":"172.21.15.46:6827/4010805716","cluster_addr":"172.21.15.46:6829/4010805716","heartbeat_back_addr":"172.21.15.46:6833/4010805716","heartbeat_front_addr":"172.21.15.46:6831/4010805716","state":["exists","up"]},{"osd":10,"uuid":"b1b83e9f-8b11-4023-a6e3-476b8c9a2651","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6825","nonce":3505432402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6827","nonce":3505432402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6831","nonce":3505432402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3505432402},{"type":"v1","addr":"172.21.15.99:6829","nonce":3505432402}]},"public_addr":"172.21.15.99:6825/3505432402","cluster_addr":"172.21.15.99:6827/3505432402","heartbeat_back_addr":"172.21.15.99:6831/3505432402","heartbeat_front_addr":"172.21.15.99:6829/3505432402","state":["exists","up"]},{"osd":11,"uuid":"a61643cd-2ec2-494a-8e81-68fd46d421e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6825","nonce":2141739994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6827","nonce":2141739994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6831","nonce":2141739994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2141739994},{"type":"v1","addr":"172.21.15.115:6829","nonce":2141739994}]},"public_addr":"172.21.15.115:6825/2141739994","cluster_addr":"172.21.15.115:6827/2141739994","heartbeat_back_addr":"172.21.15.115:6831/2141739994","heartbeat_front_addr":"172.21.15.115:6829/2141739994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:10:53.517645+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:17.774552+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:11:42.359019+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:06.685153+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:32.272564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:12:57.468105+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:23.284504+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:48.075180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:13.669456+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:14:39.360333+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:04.579233+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:15:29.991499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/3574702566":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6801/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2790675564":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/2471470384":"2024-09-20T09:09:28.870189+0000","172.21.15.46:6800/4173084876":"2024-09-20T09:09:28.870189+0000","172.21.15.46:0/1027758264":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/3215761570":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6801/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:6800/2938067554":"2024-09-20T09:09:05.243596+0000","172.21.15.46:0/2165633086":"2024-09-20T09:09:05.243596+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:25:14.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04100a32c0 msgr2=0x7f04100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04100a32c0 0x7f04100a5780 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0420011500 tx=0x7f0420005f90 comp rx=0 tx=0).stop 2024-09-19T09:25:14.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 msgr2=0x7f042419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 0x7f042419ac40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f041400d6d0 tx=0x7f041400db90 comp rx=0 tx=0).stop 2024-09-19T09:25:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 shutdown_connections 2024-09-19T09:25:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f04100a32c0 0x7f04100a5780 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f042410e480 0x7f042419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0424101280 0x7f042419ac40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 --2- 172.21.15.46:0/769838519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04241008d0 0x7f042419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 >> 172.21.15.46:0/769838519 conn(0x7f04240fc7a0 msgr2=0x7f04240feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:14.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 shutdown_connections 2024-09-19T09:25:14.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:14.576+0000 7f042b7e5640 1 -- 172.21.15.46:0/769838519 wait complete. 2024-09-19T09:25:14.710 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:14 smithi115 ceph-mon[35055]: pgmap v547: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-19T09:25:14.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:14 smithi046 ceph-mon[31203]: pgmap v547: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-19T09:25:15.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:14 smithi099 ceph-mon[35256]: pgmap v547: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.1 KiB/s wr, 13 op/s 2024-09-19T09:25:15.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:25:15.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:15 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/769838519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:25:15.749 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:15.959 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:15 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/769838519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:25:16.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:15 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/769838519' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:25:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 -- 172.21.15.46:0/4257320659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 msgr2=0x7f71b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/4257320659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b41021c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009900 tx=0x7f71a402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 -- 172.21.15.46:0/4257320659 shutdown_connections 2024-09-19T09:25:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/4257320659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b4106f10 0x7f71b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/4257320659 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b4102790 0x7f71b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/4257320659 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b41021c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.259+0000 7f71ba8f6640 1 -- 172.21.15.46:0/4257320659 >> 172.21.15.46:0/4257320659 conn(0x7f71b40fd8c0 msgr2=0x7f71b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.260+0000 7f71ba8f6640 1 -- 172.21.15.46:0/4257320659 shutdown_connections 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.260+0000 7f71ba8f6640 1 -- 172.21.15.46:0/4257320659 wait complete. 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.260+0000 7f71ba8f6640 1 Processor -- start 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.260+0000 7f71ba8f6640 1 -- start start 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.260+0000 7f71ba8f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b4102790 0x7f71b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b4106f10 0x7f71b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4111f30 con 0x7f71b4101de0 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4111db0 con 0x7f71b4102790 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41120b0 con 0x7f71b4106f10 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53000/0 (socket says 172.21.15.46:53000) 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 -- 172.21.15.46:0/3596786033 learned_addr learned my addr 172.21.15.46:0/3596786033 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b37fe640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b4102790 0x7f71b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b8e93640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b4106f10 0x7f71b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 -- 172.21.15.46:0/3596786033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b4106f10 msgr2=0x7f71b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b4106f10 0x7f71b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 -- 172.21.15.46:0/3596786033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b4102790 msgr2=0x7f71b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b4102790 0x7f71b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 -- 172.21.15.46:0/3596786033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b41a67d0 con 0x7f71b4101de0 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b3fff640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b40744f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005ab0 tx=0x7f71a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:16.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a403f030 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b41a6a60 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a4003ce0 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4035070 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.261+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b41a6f40 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.262+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b41021c0 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.264+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f71a4042030 con 0x7f71b4101de0 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.264+0000 7f71b17fa640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f719c0a3240 0x7f719c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:16.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.265+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8182+0+0 (secure 0 0 0) 0x7f71a40f04a0 con 0x7f71b4101de0 2024-09-19T09:25:16.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.265+0000 7f71b37fe640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f719c0a3240 0x7f719c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:16.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.265+0000 7f71b37fe640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f719c0a3240 0x7f719c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f71b4075f80 tx=0x7f71a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:16.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.268+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71a40bd1f0 con 0x7f71b4101de0 2024-09-19T09:25:16.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.482+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f71b41a71e0 con 0x7f71b4101de0 2024-09-19T09:25:16.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.484+0000 7f71b17fa640 1 -- 172.21.15.46:0/3596786033 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) ==== 161+0+0 (secure 0 0 0) 0x7f71a40bcaf0 con 0x7f71b4101de0 2024-09-19T09:25:16.486 INFO:teuthology.orchestra.run.smithi046.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:25:16.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.487+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f719c0a3240 msgr2=0x7f719c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.487+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f719c0a3240 0x7f719c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f71b4075f80 tx=0x7f71a800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.488+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 msgr2=0x7f71b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:16.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.488+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b40744f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f71a4005ab0 tx=0x7f71a40042f0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 shutdown_connections 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f719c0a3240 0x7f719c0a5700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71b4106f10 0x7f71b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f71b4102790 0x7f71b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 --2- 172.21.15.46:0/3596786033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f71b4101de0 0x7f71b40744f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 >> 172.21.15.46:0/3596786033 conn(0x7f71b40fd8c0 msgr2=0x7f71b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 shutdown_connections 2024-09-19T09:25:16.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:16.489+0000 7f71ba8f6640 1 -- 172.21.15.46:0/3596786033 wait complete. 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[31199]: 2024-09-19T09:25:16.483+0000 7f18c14bd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: pgmap v548: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3596786033' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: Health check cleared: MDS_DAMAGE (was: 3 MDSs report damaged metadata) 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/3596786033' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:25:16.879 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mon[31203]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a[72398]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a[72398]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mds[72402]: -- 172.21.15.46:0/3792537685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624b7e95c20 con 0x5624b7e72800 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a[72398]: starting mds.a at 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g[71985]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g[71985]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:16.880 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-mds[72007]: -- 172.21.15.46:0/3459288705 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2a2b8b860 con 0x55e2a2b69400 2024-09-19T09:25:16.881 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:25:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g[71985]: starting mds.g at 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: pgmap v548: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3596786033' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: Health check cleared: MDS_DAMAGE (was: 3 MDSs report damaged metadata) 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/3596786033' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:25:16.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:25:16.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mon[35055]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:25:16.961 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:16.961 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:16.961 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mds[64784]: -- 172.21.15.115:0/1821871511 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c97b4bc20 con 0x557c97b28800 2024-09-19T09:25:16.961 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: starting mds.c at 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l[64174]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l[64174]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mds[64178]: -- 172.21.15.115:0/180443305 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5594dc68d860 con 0x5594dc66a800 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l[64174]: starting mds.l at 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f[64475]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f[64475]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mds[64479]: -- 172.21.15.115:0/3437518043 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e80cb43860 con 0x55e80cb20800 2024-09-19T09:25:16.962 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f[64475]: starting mds.f at 2024-09-19T09:25:16.963 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:16.963 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:16.963 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-mds[65090]: -- 172.21.15.115:0/3095820978 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562461a01860 con 0x5624619df000 2024-09-19T09:25:16.963 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:25:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: starting mds.i at 2024-09-19T09:25:17.013 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:17.013 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:17.013 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mds[64424]: -- 172.21.15.99:0/3362007739 <== mon.1 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555da6f45860 con 0x555da6f23000 2024-09-19T09:25:17.013 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: starting mds.e at 2024-09-19T09:25:17.014 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:17.014 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:17.014 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mds[65042]: -- 172.21.15.99:0/3610108442 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e0ddef860 con 0x560e0ddcc800 2024-09-19T09:25:17.014 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: starting mds.b at 2024-09-19T09:25:17.015 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:17.015 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:17.015 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mds[64728]: -- 172.21.15.99:0/3192393308 <== mon.2 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4fb307860 con 0x55b4fb2e5400 2024-09-19T09:25:17.015 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: starting mds.h at 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: pgmap v548: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3596786033' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: Health check cleared: MDS_DAMAGE (was: 3 MDSs report damaged metadata) 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/3596786033' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:25:17.016 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-mon[35256]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:25:17.017 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k[64108]: ignoring --setuser ceph since I am not root 2024-09-19T09:25:17.017 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k[64108]: ignoring --setgroup ceph since I am not root 2024-09-19T09:25:17.017 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:25:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k[64108]: starting mds.k at 2024-09-19T09:25:17.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:25:17.607 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:18.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.057+0000 7f842c6ec640 1 -- 172.21.15.46:0/3135215696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424100a80 msgr2=0x7f8424100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:18.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.057+0000 7f842c6ec640 1 --2- 172.21.15.46:0/3135215696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424100a80 0x7f8424100ee0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8418009930 tx=0x7f841802a420 comp rx=0 tx=0).stop 2024-09-19T09:25:18.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 -- 172.21.15.46:0/3135215696 shutdown_connections 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 --2- 172.21.15.46:0/3135215696 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424100a80 0x7f8424100ee0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 --2- 172.21.15.46:0/3135215696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424101420 0x7f842410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 --2- 172.21.15.46:0/3135215696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8424106a80 0x7f8424106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 -- 172.21.15.46:0/3135215696 >> 172.21.15.46:0/3135215696 conn(0x7f84240fc7a0 msgr2=0x7f84240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 -- 172.21.15.46:0/3135215696 shutdown_connections 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 -- 172.21.15.46:0/3135215696 wait complete. 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 Processor -- start 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 -- start start 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424100a80 0x7f8424198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8424101420 0x7f8424198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.058+0000 7f842c6ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 0x7f842419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:18.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842c6ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8424110e80 con 0x7f8424106a80 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842c6ec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8424110d00 con 0x7f8424101420 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842c6ec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8424111000 con 0x7f8424100a80 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 0x7f842419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 0x7f842419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53052/0 (socket says 172.21.15.46:53052) 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 -- 172.21.15.46:0/1702794586 learned_addr learned my addr 172.21.15.46:0/1702794586 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842a488640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424100a80 0x7f8424198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f8429c87640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8424101420 0x7f8424198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 -- 172.21.15.46:0/1702794586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424100a80 msgr2=0x7f8424198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:18.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424100a80 0x7f8424198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 -- 172.21.15.46:0/1702794586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8424101420 msgr2=0x7f8424198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8424101420 0x7f8424198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 -- 172.21.15.46:0/1702794586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842419d3e0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842ac89640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 0x7f842419cd00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f841400eaa0 tx=0x7f841400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841400cdb0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842419d6d0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8414005020 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84140116d0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.059+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84241a4fb0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.060+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8424100ee0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.062+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f84140054d0 con 0x7f8424106a80 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.063+0000 7f84237fe640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f840c0a3240 0x7f840c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:18.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.063+0000 7f842a488640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f840c0a3240 0x7f840c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:18.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.063+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8612+0+0 (secure 0 0 0) 0x7f84140cfff0 con 0x7f8424106a80 2024-09-19T09:25:18.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.063+0000 7f842a488640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f840c0a3240 0x7f840c0a5700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f841c00bb60 tx=0x7f841c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:18.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.066+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8414016030 con 0x7f8424106a80 2024-09-19T09:25:18.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.279+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f84241a5250 con 0x7f8424106a80 2024-09-19T09:25:18.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.578+0000 7f84237fe640 1 -- 172.21.15.46:0/1702794586 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) ==== 104+0+0 (secure 0 0 0) 0x7f841409c500 con 0x7f8424106a80 2024-09-19T09:25:18.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: pgmap v550: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-19T09:25:18.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.46:6838/786811932,v1:172.21.15.46:6839/786811932] up:boot 2024-09-19T09:25:18.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6832/1727538078,v1:172.21.15.99:6833/1727538078] up:boot 2024-09-19T09:25:18.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.46:6840/1380620396,v1:172.21.15.46:6841/1380620396] up:boot 2024-09-19T09:25:18.581 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6834/353821309,v1:172.21.15.99:6835/353821309] up:boot 2024-09-19T09:25:18.582 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6833/2502761451,v1:172.21.15.115:6835/2502761451] up:boot 2024-09-19T09:25:18.582 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6832/3196813987,v1:172.21.15.115:6834/3196813987] up:boot 2024-09-19T09:25:18.582 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6836/13316416,v1:172.21.15.115:6838/13316416] up:boot 2024-09-19T09:25:18.582 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.115:6837/169285542,v1:172.21.15.115:6839/169285542] up:boot 2024-09-19T09:25:18.582 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6836/1092112966,v1:172.21.15.99:6838/1092112966] up:boot 2024-09-19T09:25:18.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: mds.? [v2:172.21.15.99:6837/3085664184,v1:172.21.15.99:6839/3085664184] up:boot 2024-09-19T09:25:18.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:25:18.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:25:18.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:25:18.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:25:18.583 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:25:18.584 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:25:18.584 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:25:18.584 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:25:18.584 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:25:18.584 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:25:18.585 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:25:18.585 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:18 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1702794586' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:25:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f840c0a3240 msgr2=0x7f840c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f840c0a3240 0x7f840c0a5700 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f841c00bb60 tx=0x7f841c00b390 comp rx=0 tx=0).stop 2024-09-19T09:25:18.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 msgr2=0x7f842419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 0x7f842419cd00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f841400eaa0 tx=0x7f841400ef60 comp rx=0 tx=0).stop 2024-09-19T09:25:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 shutdown_connections 2024-09-19T09:25:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f840c0a3240 0x7f840c0a5700 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8424106a80 0x7f842419cd00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8424101420 0x7f8424198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 --2- 172.21.15.46:0/1702794586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8424100a80 0x7f8424198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 >> 172.21.15.46:0/1702794586 conn(0x7f84240fc7a0 msgr2=0x7f8424104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 shutdown_connections 2024-09-19T09:25:18.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:18.581+0000 7f842c6ec640 1 -- 172.21.15.46:0/1702794586 wait complete. 2024-09-19T09:25:18.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: pgmap v550: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-19T09:25:18.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.46:6838/786811932,v1:172.21.15.46:6839/786811932] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6832/1727538078,v1:172.21.15.99:6833/1727538078] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.46:6840/1380620396,v1:172.21.15.46:6841/1380620396] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6834/353821309,v1:172.21.15.99:6835/353821309] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6833/2502761451,v1:172.21.15.115:6835/2502761451] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6832/3196813987,v1:172.21.15.115:6834/3196813987] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6836/13316416,v1:172.21.15.115:6838/13316416] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.115:6837/169285542,v1:172.21.15.115:6839/169285542] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6836/1092112966,v1:172.21.15.99:6838/1092112966] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: mds.? [v2:172.21.15.99:6837/3085664184,v1:172.21.15.99:6839/3085664184] up:boot 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:25:18.764 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:25:18.765 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:18 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1702794586' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:25:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: pgmap v550: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-19T09:25:18.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.46:6838/786811932,v1:172.21.15.46:6839/786811932] up:boot 2024-09-19T09:25:18.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6832/1727538078,v1:172.21.15.99:6833/1727538078] up:boot 2024-09-19T09:25:18.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.46:6840/1380620396,v1:172.21.15.46:6841/1380620396] up:boot 2024-09-19T09:25:18.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6834/353821309,v1:172.21.15.99:6835/353821309] up:boot 2024-09-19T09:25:18.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6833/2502761451,v1:172.21.15.115:6835/2502761451] up:boot 2024-09-19T09:25:18.961 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6832/3196813987,v1:172.21.15.115:6834/3196813987] up:boot 2024-09-19T09:25:18.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6836/13316416,v1:172.21.15.115:6838/13316416] up:boot 2024-09-19T09:25:18.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.115:6837/169285542,v1:172.21.15.115:6839/169285542] up:boot 2024-09-19T09:25:18.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6836/1092112966,v1:172.21.15.99:6838/1092112966] up:boot 2024-09-19T09:25:18.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: mds.? [v2:172.21.15.99:6837/3085664184,v1:172.21.15.99:6839/3085664184] up:boot 2024-09-19T09:25:18.962 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:25:18.963 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:25:18.963 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:25:18.963 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:25:18.963 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:25:18.963 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:25:18.964 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:25:18.964 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:25:18.964 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:25:18.964 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:25:18.964 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='mgr.14150 172.21.15.46:0/1629512217' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:25:18.965 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:18 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1702794586' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:25:19.371 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:25:19.633 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:19.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:19 smithi046 ceph-mon[31203]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:25:19.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:19 smithi046 ceph-mon[31203]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:25:19.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:19 smithi046 ceph-mon[31203]: Cluster is now healthy 2024-09-19T09:25:19.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:19 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/1702794586' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:25:19.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:19 smithi046 ceph-mon[31203]: fsmap 12 up:standby 2024-09-19T09:25:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:19 smithi099 ceph-mon[35256]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:25:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:19 smithi099 ceph-mon[35256]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:25:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:19 smithi099 ceph-mon[35256]: Cluster is now healthy 2024-09-19T09:25:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:19 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/1702794586' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:25:19.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:19 smithi099 ceph-mon[35256]: fsmap 12 up:standby 2024-09-19T09:25:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:19 smithi115 ceph-mon[35055]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:25:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:19 smithi115 ceph-mon[35055]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:25:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:19 smithi115 ceph-mon[35055]: Cluster is now healthy 2024-09-19T09:25:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:19 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/1702794586' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:25:19.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:19 smithi115 ceph-mon[35055]: fsmap 12 up:standby 2024-09-19T09:25:20.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 -- 172.21.15.46:0/576506608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0102ef0 msgr2=0x7f15e010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:20.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 --2- 172.21.15.46:0/576506608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0102ef0 0x7f15e010da40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ca0 tx=0x7f15d802a950 comp rx=0 tx=0).stop 2024-09-19T09:25:20.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 -- 172.21.15.46:0/576506608 shutdown_connections 2024-09-19T09:25:20.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 --2- 172.21.15.46:0/576506608 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0102ef0 0x7f15e010da40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 --2- 172.21.15.46:0/576506608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15e0102570 0x7f15e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 --2- 172.21.15.46:0/576506608 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15e0100e20 0x7f15e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 -- 172.21.15.46:0/576506608 >> 172.21.15.46:0/576506608 conn(0x7f15e00fc7d0 msgr2=0x7f15e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 -- 172.21.15.46:0/576506608 shutdown_connections 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 -- 172.21.15.46:0/576506608 wait complete. 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.219+0000 7f15e49b7640 1 Processor -- start 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 -- start start 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 0x7f15e01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15e0102570 0x7f15e01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15e0102ef0 0x7f15e01a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0110fd0 con 0x7f15e0100e20 2024-09-19T09:25:20.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0110e50 con 0x7f15e0102ef0 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15e49b7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0111150 con 0x7f15e0102570 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 0x7f15e01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 0x7f15e01992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48958/0 (socket says 172.21.15.46:48958) 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 -- 172.21.15.46:0/4238589796 learned_addr learned my addr 172.21.15.46:0/4238589796 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15d7fff640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15e0102570 0x7f15e01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15ded9d640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15e0102ef0 0x7f15e01a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 -- 172.21.15.46:0/4238589796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15e0102570 msgr2=0x7f15e01997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:20.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15e0102570 0x7f15e01997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 -- 172.21.15.46:0/4238589796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15e0102ef0 msgr2=0x7f15e01a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15e0102ef0 0x7f15e01a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.220+0000 7f15de59c640 1 -- 172.21.15.46:0/4238589796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e01a4860 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.221+0000 7f15de59c640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 0x7f15e01992a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c970 tx=0x7f15d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.221+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d0007bb0 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.221+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d0007d50 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.221+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d000f450 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.221+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e01a4a30 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.221+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e01a4ef0 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.222+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e0101200 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.223+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f15d000f5f0 con 0x7f15e0100e20 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.224+0000 7f15d77fe640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15cc0a3240 0x7f15cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:20.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.224+0000 7f15d7fff640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15cc0a3240 0x7f15cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.224+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8612+0+0 (secure 0 0 0) 0x7f15d00cf8f0 con 0x7f15e0100e20 2024-09-19T09:25:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.225+0000 7f15d7fff640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15cc0a3240 0x7f15cc0a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f15e006aac0 tx=0x7f15c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:20.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.228+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15d0014030 con 0x7f15e0100e20 2024-09-19T09:25:20.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.404+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f15e006a560 con 0x7f15e0100e20 2024-09-19T09:25:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.581+0000 7f15d77fe640 1 -- 172.21.15.46:0/4238589796 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7f15d009c430 con 0x7f15e0100e20 2024-09-19T09:25:20.583 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:25:20.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15cc0a3240 msgr2=0x7f15cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15cc0a3240 0x7f15cc0a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f15e006aac0 tx=0x7f15c800b390 comp rx=0 tx=0).stop 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 msgr2=0x7f15e01992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 0x7f15e01992a0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c970 tx=0x7f15d000ce30 comp rx=0 tx=0).stop 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 shutdown_connections 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f15cc0a3240 0x7f15cc0a5700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15e0102ef0 0x7f15e01a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15e0102570 0x7f15e01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 --2- 172.21.15.46:0/4238589796 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15e0100e20 0x7f15e01992a0 secure :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f15d000c970 tx=0x7f15d000ce30 comp rx=0 tx=0).stop 2024-09-19T09:25:20.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 >> 172.21.15.46:0/4238589796 conn(0x7f15e00fc7d0 msgr2=0x7f15e00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 shutdown_connections 2024-09-19T09:25:20.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:20.585+0000 7f15e49b7640 1 -- 172.21.15.46:0/4238589796 wait complete. 2024-09-19T09:25:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:20 smithi046 ceph-mon[31203]: pgmap v551: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-19T09:25:20.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:20 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4238589796' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:25:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:20 smithi115 ceph-mon[35055]: pgmap v551: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-19T09:25:20.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:20 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4238589796' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:25:21.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:20 smithi099 ceph-mon[35256]: pgmap v551: 97 pgs: 97 active+clean; 34 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-09-19T09:25:21.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:20 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4238589796' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:25:21.261 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid a514acda-7666-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:25:21.518 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:25:21.845 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:21 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/4238589796' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:25:21.845 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:21 smithi046 ceph-mon[31203]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:25:21.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:21 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/4238589796' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:25:21.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:21 smithi115 ceph-mon[35055]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:25:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:21 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/4238589796' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:25:22.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:21 smithi099 ceph-mon[35256]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 -- 172.21.15.46:0/3973712898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420106a80 msgr2=0x7f8420106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 --2- 172.21.15.46:0/3973712898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420106a80 0x7f8420106e60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8414009930 tx=0x7f841402a420 comp rx=0 tx=0).stop 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 -- 172.21.15.46:0/3973712898 shutdown_connections 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 --2- 172.21.15.46:0/3973712898 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8420101420 0x7f842010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 --2- 172.21.15.46:0/3973712898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8420100a80 0x7f8420100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 --2- 172.21.15.46:0/3973712898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420106a80 0x7f8420106e60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 -- 172.21.15.46:0/3973712898 >> 172.21.15.46:0/3973712898 conn(0x7f84200fc7a0 msgr2=0x7f84200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 -- 172.21.15.46:0/3973712898 shutdown_connections 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.070+0000 7f8426bec640 1 -- 172.21.15.46:0/3973712898 wait complete. 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 Processor -- start 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 -- start start 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 0x7f8420199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8420101420 0x7f8420199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8420106a80 0x7f84201a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8420110f20 con 0x7f8420100a80 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8420110da0 con 0x7f8420101420 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8426bec640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f84201110a0 con 0x7f8420106a80 2024-09-19T09:25:22.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8424988640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 0x7f8420199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8424988640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 0x7f8420199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48974/0 (socket says 172.21.15.46:48974) 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.071+0000 7f8424988640 1 -- 172.21.15.46:0/675624027 learned_addr learned my addr 172.21.15.46:0/675624027 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8425189640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8420106a80 0x7f84201a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f841ffff640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8420101420 0x7f8420199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8424988640 1 -- 172.21.15.46:0/675624027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8420106a80 msgr2=0x7f84201a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8424988640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8420106a80 0x7f84201a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8424988640 1 -- 172.21.15.46:0/675624027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8420101420 msgr2=0x7f8420199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8424988640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8420101420 0x7f8420199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8424988640 1 -- 172.21.15.46:0/675624027 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84201a4a10 con 0x7f8420100a80 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8424988640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 0x7f8420199450 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8414009a50 tx=0x7f8414004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:22.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841403f030 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8414003ce0 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84201a4be0 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414035070 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.072+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84201a5090 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.073+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8420100f60 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.075+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8414042030 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.075+0000 7f841dffb640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84100a32c0 0x7f84100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.075+0000 7f841ffff640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84100a32c0 0x7f84100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.075+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8087+0+0 (secure 0 0 0) 0x7f84140efe00 con 0x7f8420100a80 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.076+0000 7f841ffff640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84100a32c0 0x7f84100a5780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f842006b2e0 tx=0x7f840c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:22.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.079+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84140bcc00 con 0x7f8420100a80 2024-09-19T09:25:22.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.260+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f842002d7c0 con 0x7f8420100a80 2024-09-19T09:25:22.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.598+0000 7f841dffb640 1 -- 172.21.15.46:0/675624027 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7f84140bc500 con 0x7f8420100a80 2024-09-19T09:25:22.600 INFO:teuthology.orchestra.run.smithi046.stderr:pool 'cephfs_data' removed 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.601+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84100a32c0 msgr2=0x7f84100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.601+0000 7f8426bec640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84100a32c0 0x7f84100a5780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f842006b2e0 tx=0x7f840c008040 comp rx=0 tx=0).stop 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.601+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 msgr2=0x7f8420199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.601+0000 7f8426bec640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 0x7f8420199450 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8414009a50 tx=0x7f8414004270 comp rx=0 tx=0).stop 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 shutdown_connections 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:6800/1744336406,v1:172.21.15.46:6801/1744336406] conn(0x7f84100a32c0 0x7f84100a5780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8420106a80 0x7f84201a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8420101420 0x7f8420199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 --2- 172.21.15.46:0/675624027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8420100a80 0x7f8420199450 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:22.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 >> 172.21.15.46:0/675624027 conn(0x7f84200fc7a0 msgr2=0x7f84200fd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:22.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 shutdown_connections 2024-09-19T09:25:22.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-19T09:25:22.602+0000 7f8426bec640 1 -- 172.21.15.46:0/675624027 wait complete. 2024-09-19T09:25:22.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:22 smithi115 ceph-mon[35055]: pgmap v553: 65 pgs: 65 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:25:22.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:22 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/675624027' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:25:22.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:22 smithi046 ceph-mon[31203]: pgmap v553: 65 pgs: 65 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:25:22.981 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:22 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/675624027' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:25:23.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:22 smithi099 ceph-mon[35256]: pgmap v553: 65 pgs: 65 active+clean; 577 KiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:25:23.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:22 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/675624027' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:25:23.389 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:25:23.419 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:25:23.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:25:23.480 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:25:23.480 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:25:23.497 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:25:23.513 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:25:23.535 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:25:23.536 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:25:23.536 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:25:23.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:23 smithi046 systemd[1]: Stopping Ceph mon.a for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:23.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:23 smithi046 ceph-mon[31203]: from='client.? 172.21.15.46:0/675624027' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:25:23.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:23 smithi046 ceph-mon[31203]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:25:23.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:23 smithi099 ceph-mon[35256]: from='client.? 172.21.15.46:0/675624027' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:25:23.763 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:23 smithi099 ceph-mon[35256]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:25:23.935 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:23 smithi115 ceph-mon[35055]: from='client.? 172.21.15.46:0/675624027' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:25:23.935 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:23 smithi115 ceph-mon[35055]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:25:24.105 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[31199]: 2024-09-19T09:25:23.826+0000 7f18c6cc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:24.105 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a[31199]: 2024-09-19T09:25:23.826+0000 7f18c6cc8640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:25:24.404 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:24 smithi046 podman[117223]: 2024-09-19 09:25:24.104843771 +0000 UTC m=+0.367739383 container died 96dfa5da07047f24e6c61563fd0818d90e110da52a8c935a492db41e9c2e1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T09:25:24.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:24 smithi046 podman[117223]: 2024-09-19 09:25:24.494195161 +0000 UTC m=+0.757090753 container cleanup 96dfa5da07047f24e6c61563fd0818d90e110da52a8c935a492db41e9c2e1bf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T09:25:24.731 INFO:journalctl@ceph.mon.a.smithi046.stdout:Sep 19 09:25:24 smithi046 bash[117223]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:25:24.931 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:25:24.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:24.986 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:25:24.987 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:25:24.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:25:25.308 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:25 smithi099 systemd[1]: Stopping Ceph mon.b for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:25.709 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-b[35252]: 2024-09-19T09:25:25.306+0000 7f2c559af640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:25.710 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-b[35252]: 2024-09-19T09:25:25.306+0000 7f2c559af640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:25:25.710 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:25 smithi099 podman[68541]: 2024-09-19 09:25:25.409208984 +0000 UTC m=+0.215491598 container died ebf1daa339738fb6b5b90d4cad6dd9bb5c4a2e9d236541bb931e1b847b0b6db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:25:26.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:25 smithi099 podman[68541]: 2024-09-19 09:25:25.790978692 +0000 UTC m=+0.597261306 container cleanup ebf1daa339738fb6b5b90d4cad6dd9bb5c4a2e9d236541bb931e1b847b0b6db6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T09:25:26.013 INFO:journalctl@ceph.mon.b.smithi099.stdout:Sep 19 09:25:25 smithi099 bash[68541]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:25:26.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:25:26.273 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:26.273 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:25:26.273 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:25:26.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:25:26.591 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:26 smithi115 systemd[1]: Stopping Ceph mon.c for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-c[35051]: 2024-09-19T09:25:26.590+0000 7f1e1110a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-c[35051]: 2024-09-19T09:25:26.590+0000 7f1e1110a640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:25:26.960 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:26 smithi115 podman[68488]: 2024-09-19 09:25:26.805271641 +0000 UTC m=+0.339241520 container died dc23161d66efe472cc27a1646a2b3950f2ff2df5a6b040fa32fd76dcf870c5f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:25:27.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:27 smithi115 podman[68488]: 2024-09-19 09:25:27.207536891 +0000 UTC m=+0.741506760 container cleanup dc23161d66efe472cc27a1646a2b3950f2ff2df5a6b040fa32fd76dcf870c5f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T09:25:27.459 INFO:journalctl@ceph.mon.c.smithi115.stdout:Sep 19 09:25:27 smithi115 bash[68488]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:25:27.598 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:25:27.646 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:27.647 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:25:27.647 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:25:27.647 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:25:27.950 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:25:27 smithi046 systemd[1]: Stopping Ceph mgr.x for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:28.231 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:25:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x[31431]: 2024-09-19T09:25:27.948+0000 7f581db6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:28.231 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:25:27 smithi046 podman[117342]: 2024-09-19 09:25:27.980406289 +0000 UTC m=+0.130154355 container died baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:25:28.645 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:25:28 smithi046 podman[117342]: 2024-09-19 09:25:28.425477623 +0000 UTC m=+0.575225681 container cleanup baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:25:28.645 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:25:28 smithi046 bash[117342]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:25:28.897 INFO:journalctl@ceph.mgr.x.smithi046.stdout:Sep 19 09:25:28 smithi046 podman[117355]: 2024-09-19 09:25:28.644543715 +0000 UTC m=+0.661609166 container remove baa26900a6718a8fc44ef75e541ee2080dc9f870062468dc11046d8759fcaadb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:25:28.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:25:28.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:28.952 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:25:28.952 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:25:28.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:25:29.263 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:29 smithi099 systemd[1]: Stopping Ceph mgr.y for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:29.607 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:29 smithi099 podman[68664]: 2024-09-19 09:25:29.300249043 +0000 UTC m=+0.148912188 container died 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:29.949 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:29 smithi099 podman[68664]: 2024-09-19 09:25:29.722165902 +0000 UTC m=+0.570829047 container cleanup 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:25:29.950 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:29 smithi099 bash[68664]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:25:30.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:25:30.219 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:29 smithi099 podman[68679]: 2024-09-19 09:25:29.94901416 +0000 UTC m=+0.640445925 container remove 39b5900b3e3e39dee0ab2601a97ea21a7c4a11f2e94c1c37c3414e4788fd66e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:25:30.219 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:29 smithi099 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:25:30.219 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:30 smithi099 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-19T09:25:30.219 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:30 smithi099 systemd[1]: Stopped Ceph mgr.y for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:25:30.219 INFO:journalctl@ceph.mgr.y.smithi099.stdout:Sep 19 09:25:30 smithi099 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.y.service: Consumed 6.400s CPU time. 2024-09-19T09:25:30.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:30.232 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:25:30.232 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:25:30.232 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:25:30.559 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:25:30 smithi115 systemd[1]: Stopping Ceph mgr.z for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:30.863 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:25:30 smithi115 podman[68607]: 2024-09-19 09:25:30.55853454 +0000 UTC m=+0.131620427 container died ba63900103e87c4a1f8d15699796bd8a820ce7049fd610c297e89026d71ed6a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:31.210 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:25:30 smithi115 podman[68607]: 2024-09-19 09:25:30.970850696 +0000 UTC m=+0.543936572 container cleanup ba63900103e87c4a1f8d15699796bd8a820ce7049fd610c297e89026d71ed6a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:25:31.210 INFO:journalctl@ceph.mgr.z.smithi115.stdout:Sep 19 09:25:30 smithi115 bash[68607]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:25:31.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:25:31.425 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:31.426 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:25:31.426 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:25:31.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:25:31.731 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:31 smithi046 systemd[1]: Stopping Ceph osd.0 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:32.231 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0[45057]: 2024-09-19T09:25:31.746+0000 7f460a630640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:32.232 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0[45057]: 2024-09-19T09:25:31.746+0000 7f460a630640 -1 osd.0 88 *** Got signal Terminated *** 2024-09-19T09:25:32.232 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0[45057]: 2024-09-19T09:25:31.746+0000 7f460a630640 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:25:37.507 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:37 smithi046 podman[117462]: 2024-09-19 09:25:37.235882546 +0000 UTC m=+5.609014332 container died 3644dfc0cc0464c783ffc5415af4871318c8526dae7b826b63bcf9fd622abfd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:25:37.875 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:37 smithi046 podman[117462]: 2024-09-19 09:25:37.67338497 +0000 UTC m=+6.046516807 container cleanup 3644dfc0cc0464c783ffc5415af4871318c8526dae7b826b63bcf9fd622abfd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:25:37.876 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:37 smithi046 bash[117462]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:25:38.231 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:37 smithi046 podman[117479]: 2024-09-19 09:25:37.875119326 +0000 UTC m=+0.635843000 container remove 3644dfc0cc0464c783ffc5415af4871318c8526dae7b826b63bcf9fd622abfd9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:38.488 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:38 smithi046 podman[117566]: 2024-09-19 09:25:38.206881128 +0000 UTC m=+0.016732324 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:25:38.488 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:38 smithi046 podman[117566]: 2024-09-19 09:25:38.334465515 +0000 UTC m=+0.144316699 container create 15a877cc93460e688e1cb399fea31c231253b82c4f5f59f8e1e5bf3a4480cb24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T09:25:38.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:38 smithi046 podman[117566]: 2024-09-19 09:25:38.612521746 +0000 UTC m=+0.422372938 container init 15a877cc93460e688e1cb399fea31c231253b82c4f5f59f8e1e5bf3a4480cb24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T09:25:38.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:38 smithi046 podman[117566]: 2024-09-19 09:25:38.616423022 +0000 UTC m=+0.426274217 container start 15a877cc93460e688e1cb399fea31c231253b82c4f5f59f8e1e5bf3a4480cb24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T09:25:38.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:38 smithi046 podman[117566]: 2024-09-19 09:25:38.703761904 +0000 UTC m=+0.513613109 container attach 15a877cc93460e688e1cb399fea31c231253b82c4f5f59f8e1e5bf3a4480cb24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:25:38.981 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 19 09:25:38 smithi046 podman[117566]: 2024-09-19 09:25:38.810530915 +0000 UTC m=+0.620382113 container died 15a877cc93460e688e1cb399fea31c231253b82c4f5f59f8e1e5bf3a4480cb24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:25:39.499 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:25:39.545 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:39.545 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:25:39.545 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:25:39.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:25:39.852 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:39 smithi099 systemd[1]: Stopping Ceph osd.1 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:40.263 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1[39734]: 2024-09-19T09:25:39.850+0000 7f00be43a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:40.263 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1[39734]: 2024-09-19T09:25:39.850+0000 7f00be43a640 -1 osd.1 88 *** Got signal Terminated *** 2024-09-19T09:25:40.263 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1[39734]: 2024-09-19T09:25:39.850+0000 7f00be43a640 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:25:45.501 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:45 smithi099 podman[68794]: 2024-09-19 09:25:45.233179138 +0000 UTC m=+5.486343761 container died 6a3ab28930b6efbfee8e191af2ebd300928ddf0ad844a2af5590f280a0aa6559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:45.763 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:45 smithi099 podman[68794]: 2024-09-19 09:25:45.592102182 +0000 UTC m=+5.845266813 container cleanup 6a3ab28930b6efbfee8e191af2ebd300928ddf0ad844a2af5590f280a0aa6559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T09:25:45.763 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:45 smithi099 bash[68794]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:25:46.188 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:45 smithi099 podman[68809]: 2024-09-19 09:25:45.877487339 +0000 UTC m=+0.642590620 container remove 6a3ab28930b6efbfee8e191af2ebd300928ddf0ad844a2af5590f280a0aa6559 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:25:46.474 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:46 smithi099 podman[68895]: 2024-09-19 09:25:46.090647129 +0000 UTC m=+0.015869271 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:25:47.036 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:46 smithi099 podman[68895]: 2024-09-19 09:25:46.195361728 +0000 UTC m=+0.120583909 container create 9f1c8abd310d13b7cf7cf9001d8a1120af18992c7b65e117ccb54d0bf3ea4322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:47.037 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:46 smithi099 podman[68895]: 2024-09-19 09:25:46.473543814 +0000 UTC m=+0.398765949 container init 9f1c8abd310d13b7cf7cf9001d8a1120af18992c7b65e117ccb54d0bf3ea4322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:25:47.037 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:46 smithi099 podman[68895]: 2024-09-19 09:25:46.476996355 +0000 UTC m=+0.402218491 container start 9f1c8abd310d13b7cf7cf9001d8a1120af18992c7b65e117ccb54d0bf3ea4322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:47.038 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:46 smithi099 podman[68895]: 2024-09-19 09:25:46.582028636 +0000 UTC m=+0.507250778 container attach 9f1c8abd310d13b7cf7cf9001d8a1120af18992c7b65e117ccb54d0bf3ea4322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:25:47.038 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 09:25:46 smithi099 podman[68895]: 2024-09-19 09:25:46.669318226 +0000 UTC m=+0.594540370 container died 9f1c8abd310d13b7cf7cf9001d8a1120af18992c7b65e117ccb54d0bf3ea4322 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:25:47.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:25:47.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:47.445 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:25:47.446 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:25:47.446 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:25:47.737 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:47 smithi115 systemd[1]: Stopping Ceph osd.2 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:48.186 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2[40024]: 2024-09-19T09:25:47.856+0000 7f592fe55640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:48.186 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2[40024]: 2024-09-19T09:25:47.856+0000 7f592fe55640 -1 osd.2 88 *** Got signal Terminated *** 2024-09-19T09:25:48.186 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2[40024]: 2024-09-19T09:25:47.856+0000 7f592fe55640 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:25:53.534 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:53 smithi115 podman[68732]: 2024-09-19 09:25:53.230005172 +0000 UTC m=+5.584323910 container died 745ed83d0bb7d2171d0804612bf0f08fbf2f4a7107dc36a95e62cdfc772e8e67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:25:53.892 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:53 smithi115 podman[68732]: 2024-09-19 09:25:53.632035149 +0000 UTC m=+5.986353886 container cleanup 745ed83d0bb7d2171d0804612bf0f08fbf2f4a7107dc36a95e62cdfc772e8e67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:25:53.893 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:53 smithi115 bash[68732]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:25:54.210 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:53 smithi115 podman[68759]: 2024-09-19 09:25:53.891598867 +0000 UTC m=+0.656650894 container remove 745ed83d0bb7d2171d0804612bf0f08fbf2f4a7107dc36a95e62cdfc772e8e67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:25:54.538 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:54 smithi115 podman[68848]: 2024-09-19 09:25:54.1446505 +0000 UTC m=+0.015503949 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:25:54.538 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:54 smithi115 podman[68848]: 2024-09-19 09:25:54.284571547 +0000 UTC m=+0.155424983 container create d443f6fd2c05523038bcb518cab2b31794754b35f373eca29c625ac2a0de5609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:25:54.960 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:54 smithi115 podman[68848]: 2024-09-19 09:25:54.537670458 +0000 UTC m=+0.408523902 container init d443f6fd2c05523038bcb518cab2b31794754b35f373eca29c625ac2a0de5609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:25:54.960 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:54 smithi115 podman[68848]: 2024-09-19 09:25:54.54108425 +0000 UTC m=+0.411937695 container start d443f6fd2c05523038bcb518cab2b31794754b35f373eca29c625ac2a0de5609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:25:54.960 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:54 smithi115 podman[68848]: 2024-09-19 09:25:54.637077149 +0000 UTC m=+0.507930589 container attach d443f6fd2c05523038bcb518cab2b31794754b35f373eca29c625ac2a0de5609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:25:54.961 INFO:journalctl@ceph.osd.2.smithi115.stdout:Sep 19 09:25:54 smithi115 podman[68848]: 2024-09-19 09:25:54.736997567 +0000 UTC m=+0.607851017 container died d443f6fd2c05523038bcb518cab2b31794754b35f373eca29c625ac2a0de5609 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:25:55.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:25:55.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:25:55.454 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:25:55.454 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:25:55.455 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:25:55.762 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:25:55 smithi046 systemd[1]: Stopping Ceph osd.3 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:25:56.039 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:25:55 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:25:55.761+0000 7f551cf6e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:25:56.039 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:25:55 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:25:55.761+0000 7f551cf6e640 -1 osd.3 88 *** Got signal Terminated *** 2024-09-19T09:25:56.040 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:25:55 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:25:55.761+0000 7f551cf6e640 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:25:59.481 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:25:59 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:25:59.208+0000 7f5519584640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:33.291250+0000 front 2024-09-19T09:25:33.291155+0000 (oldest deadline 2024-09-19T09:25:58.591354+0000) 2024-09-19T09:25:59.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:25:59 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:25:59.712+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:00.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:25:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:25:59.848+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:00.481 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3[51506]: 2024-09-19T09:26:00.214+0000 7f5519584640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:33.291250+0000 front 2024-09-19T09:25:33.291155+0000 (oldest deadline 2024-09-19T09:25:58.591354+0000) 2024-09-19T09:26:00.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:00 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:00.686+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:01.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:00.882+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:01.387 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:01 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:01.088+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:01.388 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:01 smithi046 podman[117669]: 2024-09-19 09:26:01.107544761 +0000 UTC m=+5.452140477 container died 2211a535f620a24dd90d63d86fef126079c92611ea9415df0b4d348b24c67f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:26:01.668 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:01 smithi046 podman[117669]: 2024-09-19 09:26:01.586481841 +0000 UTC m=+5.931077600 container cleanup 2211a535f620a24dd90d63d86fef126079c92611ea9415df0b4d348b24c67f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:26:01.669 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:01 smithi046 bash[117669]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:26:01.907 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:01.618+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:01.981 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:01 smithi046 podman[117699]: 2024-09-19 09:26:01.888159914 +0000 UTC m=+0.773827731 container remove 2211a535f620a24dd90d63d86fef126079c92611ea9415df0b4d348b24c67f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:26:01.984 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:01 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:01.667+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:02.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:01.906+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:02.367 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:02 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:02.084+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:02.367 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:02 smithi046 podman[117786]: 2024-09-19 09:26:02.115296158 +0000 UTC m=+0.016313018 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:02.367 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:02 smithi046 podman[117786]: 2024-09-19 09:26:02.230989349 +0000 UTC m=+0.132006203 container create 847e5df8bb6a3dc27bc864b0b9e0acfa7a3525902a8a88661e269f559a811947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:02.684 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:02 smithi046 podman[117786]: 2024-09-19 09:26:02.483703156 +0000 UTC m=+0.384720011 container init 847e5df8bb6a3dc27bc864b0b9e0acfa7a3525902a8a88661e269f559a811947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:02.685 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:02 smithi046 podman[117786]: 2024-09-19 09:26:02.487033048 +0000 UTC m=+0.388049893 container start 847e5df8bb6a3dc27bc864b0b9e0acfa7a3525902a8a88661e269f559a811947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:02.685 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:02 smithi046 podman[117786]: 2024-09-19 09:26:02.57534103 +0000 UTC m=+0.476357893 container attach 847e5df8bb6a3dc27bc864b0b9e0acfa7a3525902a8a88661e269f559a811947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:26:02.936 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:02.578+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:02.936 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:02.799+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:02.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:02 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:02.702+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:02.981 INFO:journalctl@ceph.osd.3.smithi046.stdout:Sep 19 09:26:02 smithi046 podman[117786]: 2024-09-19 09:26:02.683906842 +0000 UTC m=+0.584923698 container died 847e5df8bb6a3dc27bc864b0b9e0acfa7a3525902a8a88661e269f559a811947 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:26:03.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:02 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:02.758+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:03.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:02.933+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:03.296 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:03.103+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:03.318 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:26:03.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:03.363 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:26:03.363 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:26:03.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:26:03.681 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:03 smithi099 systemd[1]: Stopping Ceph osd.4 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:03.960 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:03 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:03.828+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:03.960 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:03 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:03.624+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:03.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:03 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:03.668+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:04.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:03 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:03.712+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:04.013 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:03 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:26:03.680+0000 7f3ad2fee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:04.013 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:03 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:26:03.680+0000 7f3ad2fee640 -1 osd.4 88 *** Got signal Terminated *** 2024-09-19T09:26:04.013 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:03 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:26:03.680+0000 7f3ad2fee640 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:04.459 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:03 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:03.958+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:04.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:04.054+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:04.950 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:04 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:04.871+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:04.951 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:04 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:04.647+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:04.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:04 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:04.668+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:05.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:04 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:04.662+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:05.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:04 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:04.949+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:05.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:05 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:05.052+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:05.905 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:05 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:05.695+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:05.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:05 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:05.648+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:06.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:05 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:05.663+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:06.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:05 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:05.904+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:06.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:05 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:05.929+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:06.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:06 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:06.037+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:06.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:06 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:06.037+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:06.513 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:06 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:26:06.098+0000 7f3acb5fc640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:41.295238+0000 front 2024-09-19T09:25:41.295284+0000 (oldest deadline 2024-09-19T09:26:05.995440+0000) 2024-09-19T09:26:06.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:06 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:06.885+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:06.960 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:06 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:06.705+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:06.960 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:06 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:06.917+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:06.960 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:06 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:06.917+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:06.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:06 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:06.657+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:06.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:06 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:06.657+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:07.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:06 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:06.617+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:07.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:07 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:07.070+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:07.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:07 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:07.070+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:07.513 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:07 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:26:07.117+0000 7f3acb5fc640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:41.295238+0000 front 2024-09-19T09:25:41.295284+0000 (oldest deadline 2024-09-19T09:26:05.995440+0000) 2024-09-19T09:26:07.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:07 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:07.907+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:07.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:07 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:07.907+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:07.960 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:07 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:07.666+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:07.960 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:07 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:07.666+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:07.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:07 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:07.701+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:07.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:07 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:07.701+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:08.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:07 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:07.643+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:08.460 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:07 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:07.963+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:08.460 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:07 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:07.963+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:08.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:08.105+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:08.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:08.105+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:08.513 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:08 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4[46606]: 2024-09-19T09:26:08.115+0000 7f3acb5fc640 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:41.295238+0000 front 2024-09-19T09:25:41.295284+0000 (oldest deadline 2024-09-19T09:26:05.995440+0000) 2024-09-19T09:26:08.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:08 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:08.337+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:08.960 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:08 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:08.687+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:08.960 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:08 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:08.687+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:08.960 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:08 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:08.917+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:08.960 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:08 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:08.917+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:08.961 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:08 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:08.866+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:08.961 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:08 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:08.866+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:09.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:08 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:08.664+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:09.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:08 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:08.664+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:09.143 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:08.735+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:09.143 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:08 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:08.735+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:09.289 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:09 smithi099 podman[69012]: 2024-09-19 09:26:09.02777895 +0000 UTC m=+5.473113847 container died f47a79489c67ff4eee4854016e3fb3f2d8a2a5da36f83556ac1b0818f37ef2df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:09.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:09.142+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:09.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:09.142+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:09.673 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:09 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:09.287+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:09.674 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:09 smithi099 podman[69012]: 2024-09-19 09:26:09.429933785 +0000 UTC m=+5.875268681 container cleanup f47a79489c67ff4eee4854016e3fb3f2d8a2a5da36f83556ac1b0818f37ef2df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:26:09.674 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:09 smithi099 bash[69012]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:26:09.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:09.703+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:09.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:09.703+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:09.996 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:09 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:09.702+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:09.996 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:09 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:09.702+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:09.996 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:09 smithi099 podman[69027]: 2024-09-19 09:26:09.673185542 +0000 UTC m=+0.648488284 container remove f47a79489c67ff4eee4854016e3fb3f2d8a2a5da36f83556ac1b0818f37ef2df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:26:10.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:09 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:09.720+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:10.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:09 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:09.720+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:10.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:09 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:09.922+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:10.211 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:09 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:09.922+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:10.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:09 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:09.907+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:10.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:09 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:09.907+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:10.252 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:09 smithi099 podman[69118]: 2024-09-19 09:26:09.898640949 +0000 UTC m=+0.016171332 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:10.252 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:10 smithi099 podman[69118]: 2024-09-19 09:26:10.015898611 +0000 UTC m=+0.133429025 container create 5265375bf7af40518320ca9e3ed5c4eef1cf3e4a6e81e9a4289356c882067b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:10.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:10 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:10.160+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:10.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:10 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:10.160+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:10.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:10 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:10.324+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:10.514 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:10 smithi099 podman[69118]: 2024-09-19 09:26:10.25192674 +0000 UTC m=+0.369457117 container init 5265375bf7af40518320ca9e3ed5c4eef1cf3e4a6e81e9a4289356c882067b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:26:10.514 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:10 smithi099 podman[69118]: 2024-09-19 09:26:10.255519525 +0000 UTC m=+0.373049896 container start 5265375bf7af40518320ca9e3ed5c4eef1cf3e4a6e81e9a4289356c882067b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:10.514 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:10 smithi099 podman[69118]: 2024-09-19 09:26:10.351882547 +0000 UTC m=+0.469412919 container attach 5265375bf7af40518320ca9e3ed5c4eef1cf3e4a6e81e9a4289356c882067b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:10.514 INFO:journalctl@ceph.osd.4.smithi099.stdout:Sep 19 09:26:10 smithi099 podman[69118]: 2024-09-19 09:26:10.452681118 +0000 UTC m=+0.570211488 container died 5265375bf7af40518320ca9e3ed5c4eef1cf3e4a6e81e9a4289356c882067b5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:26:10.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:10 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:10.700+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:10.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:10 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:10.700+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:11.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:10 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:10.752+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:11.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:10 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:10.752+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:11.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:26:11.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:11.193 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:26:11.194 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:26:11.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:26:11.209 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:10 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:10.746+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:11.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:10 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:10.746+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:11.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:10 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:10.960+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:11.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:10 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:10.960+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:11.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:10 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:10.874+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:11.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:10 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:10.874+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:11.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:11 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:11.157+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:11.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:11 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:11.157+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:11.501 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:11 smithi115 systemd[1]: Stopping Ceph osd.5 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:11.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:11 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:11.359+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:11.882 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:11.501+0000 7fccbb05d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:11.882 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:11.501+0000 7fccbb05d640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-19T09:26:11.883 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:11.501+0000 7fccbb05d640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:11.883 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:11.713+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:11.883 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:11.713+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:11.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:11 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:11.675+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:11.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:11 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:11.675+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:12.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:11 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:11.721+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:12.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:11 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:11.721+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:12.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:11.934+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:12.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:11.934+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:12.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:11.881+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:12.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:11 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:11.881+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:12.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:12 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:12.146+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:12.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:12 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:12.146+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:12.686 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:12 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:12.343+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:12.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:12 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:12.651+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:12.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:12 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:12.651+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:13.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:12 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:12.685+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:13.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:12 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:12.685+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:13.209 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:12.722+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:13.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:12.722+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:13.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:12.961+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:13.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:12.961+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:13.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:12.866+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:13.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:12 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:12.866+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:13.375 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:13 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:13.113+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:13.376 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:13 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:13.113+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:13.681 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:13 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:13.317+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:13.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:13 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:13.623+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:13.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:13 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:13.623+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:14.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:13 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:13.680+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:14.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:13 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:13.680+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:14.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:13.755+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:14.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:13.755+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:14.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:13.755+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:14.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:13.937+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:14.211 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:13.937+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:14.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:13.838+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:14.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:13 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:13.838+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:14.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:14 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:14.151+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:14.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:14 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:14.151+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:14.635 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:14 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:14.275+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:14.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:14 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:14.621+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:14.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:14 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:14.621+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:15.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:14 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:14.634+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:15.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:14 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:14.634+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:15.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:14.782+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:15.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:14.782+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:15.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:14.782+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:15.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:14.953+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:15.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:14.953+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:15.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:14.856+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:15.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:14 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:14.856+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:15.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:15 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:15.193+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:15.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:15 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:15.193+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:15.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:15 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:15.252+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:15.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:15 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:15.621+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:15.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:15 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:15.621+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:15.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:15 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:15.621+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:16.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:15 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:15.636+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:16.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:15 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:15.636+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:16.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:15.829+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:16.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:15.829+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:16.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:15.829+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:16.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:15.903+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.313124+0000 front 2024-09-19T09:25:36.313105+0000 (oldest deadline 2024-09-19T09:26:02.212999+0000) 2024-09-19T09:26:16.210 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5[46473]: 2024-09-19T09:26:15.903+0000 7fccb366b640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.213670+0000 front 2024-09-19T09:25:42.213546+0000 (oldest deadline 2024-09-19T09:26:06.214093+0000) 2024-09-19T09:26:16.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:15.860+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:16.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:15.860+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:16.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:15 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:15.860+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:16.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:16.229+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:16.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:16.229+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:16.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:16.232+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:16.779 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:16.626+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:16.779 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:16 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:16.626+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:16.982 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:16.622+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:17.113 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:16.622+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:17.113 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:16 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:16.622+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:17.114 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:16.867+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:17.114 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:16.867+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:17.114 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:16.867+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:17.114 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:16.815+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:17.115 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:16.815+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:17.115 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:16 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:16.815+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:17.115 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:16 smithi115 podman[68954]: 2024-09-19 09:26:16.918522704 +0000 UTC m=+5.529294921 container died 7156dc26ee8a349558eaa56efcb65a794ad715c19822e911372a41e883e83f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:26:17.460 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:17 smithi115 podman[68954]: 2024-09-19 09:26:17.293211106 +0000 UTC m=+5.903983325 container cleanup 7156dc26ee8a349558eaa56efcb65a794ad715c19822e911372a41e883e83f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:26:17.460 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:17 smithi115 bash[68954]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:26:17.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:17.201+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:17.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:17.201+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:17.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:17.201+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:17.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:17 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:17.233+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:17.904 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:17 smithi115 podman[68968]: 2024-09-19 09:26:17.593766672 +0000 UTC m=+0.673061054 container remove 7156dc26ee8a349558eaa56efcb65a794ad715c19822e911372a41e883e83f3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:26:17.905 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:17 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:17.770+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:17.905 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:17 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:17.770+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:17.905 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:17 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:17.770+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:17.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:17.645+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:17.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:17.645+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:17.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:17.645+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:18.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:17 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:17.620+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:18.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:17 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:17.620+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:18.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:17 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:17.620+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:18.181 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:17 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:17.911+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:18.181 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:17 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:17.911+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:18.181 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:17 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:17.911+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:18.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:17 smithi115 podman[69056]: 2024-09-19 09:26:17.807069193 +0000 UTC m=+0.015522251 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:18.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:17 smithi115 podman[69056]: 2024-09-19 09:26:17.936050987 +0000 UTC m=+0.144504034 container create 43ebec6019211b321b5cf1327cad99d496c787eecd45a201e351872a7b9e6f1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T09:26:18.181 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:18 smithi115 podman[69056]: 2024-09-19 09:26:18.180426655 +0000 UTC m=+0.388879703 container init 43ebec6019211b321b5cf1327cad99d496c787eecd45a201e351872a7b9e6f1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:26:18.460 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:18 smithi115 podman[69056]: 2024-09-19 09:26:18.183815327 +0000 UTC m=+0.392268375 container start 43ebec6019211b321b5cf1327cad99d496c787eecd45a201e351872a7b9e6f1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:26:18.460 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:18 smithi115 podman[69056]: 2024-09-19 09:26:18.280499894 +0000 UTC m=+0.488952947 container attach 43ebec6019211b321b5cf1327cad99d496c787eecd45a201e351872a7b9e6f1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:26:18.461 INFO:journalctl@ceph.osd.5.smithi115.stdout:Sep 19 09:26:18 smithi115 podman[69056]: 2024-09-19 09:26:18.372441458 +0000 UTC m=+0.580894512 container died 43ebec6019211b321b5cf1327cad99d496c787eecd45a201e351872a7b9e6f1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:26:18.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:18 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:18.204+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:18.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:18 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:18.204+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:18.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:18 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:18.204+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:18.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:18 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:18.208+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:18.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:18 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:18.884+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:18.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:18 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:18.884+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:18.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:18 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:18.884+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:18.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:18 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:18.820+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:18.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:18 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:18.820+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:18.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:18 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:18.820+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:18.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:18 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:18.642+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:18.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:18 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:18.642+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:18.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:18 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:18.642+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:19.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:18 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:18.620+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:19.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:18 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:18.620+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:19.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:18 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:18.620+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:19.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:26:19.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:19.100 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:26:19.100 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:26:19.100 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:26:19.416 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 systemd[1]: Stopping Ceph osd.6 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:19.416 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:19.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:19.417 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:19.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:19.417 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:19.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:19.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:19 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:19.228+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:19.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:19 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:19.228+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:19.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:19.415+0000 7f375ac66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:19.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:19.415+0000 7f375ac66640 -1 osd.6 88 *** Got signal Terminated *** 2024-09-19T09:26:19.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:19.415+0000 7f375ac66640 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:19.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:19.655+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:19.731 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:19.655+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:19.732 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:19 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:19.655+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:20.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:19 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:19.596+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:20.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:19 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:19.596+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:20.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:19 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:19.596+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:20.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:19 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:19.809+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:20.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:19 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:19.809+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:20.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:19 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:19.809+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:20.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:19 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:19.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:20.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:19 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:19.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:20.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:19 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:19.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:20.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:20 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:20.138+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:20.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:20 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:20.138+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:20.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:20 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:20.138+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:20.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:20 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:20.251+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:20.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:20 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:20.251+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:20.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:20 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:20.620+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:20.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:20 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:20.620+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:20.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:20 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:20.620+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:21.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:20 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:20.602+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:21.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:20 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:20.602+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:21.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:20 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:20.602+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:21.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:20 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:20.838+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:21.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:20 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:20.838+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:21.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:20 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:20.838+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:21.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:20 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:20.826+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:21.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:20 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:20.826+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:21.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:20 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:20.826+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:21.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:21 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:21.145+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:21.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:21 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:21.145+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:21.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:21 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:21.145+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:21.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:21.244+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:21.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:21.244+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:21.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:21 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:21.643+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:21.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:21 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:21.643+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:21.982 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:21 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:21.643+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:22.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:21.591+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:22.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:21.591+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:22.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:21.591+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:22.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:21 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:21.821+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:22.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:21 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:21.821+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:22.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:21 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:21.821+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:22.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:21 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:21.865+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:22.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:21 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:21.865+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:22.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:21 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:21.865+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:22.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:22.142+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:22.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:22.142+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:22.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:22.142+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:22.517 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:22 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:22.236+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:22.517 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:22 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:22.236+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:22.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:22.625+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:22.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:22.625+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:22.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:22 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:22.625+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:23.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:22 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:22.603+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:23.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:22 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:22.603+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:23.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:22 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:22.603+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:23.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:22 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:22.603+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:22.796+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:22.796+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:22.796+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:22.915+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:22.915+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:22.915+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:23.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:22 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:22.915+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:23.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:23.174+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:23.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:23.174+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:23.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:23.174+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:23.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:23.174+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:23.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:23 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:23.235+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:23.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:23 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:23.235+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:23.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:23.636+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:34.819650+0000 front 2024-09-19T09:25:34.819774+0000 (oldest deadline 2024-09-19T09:25:59.519845+0000) 2024-09-19T09:26:23.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:23.636+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.721292+0000 front 2024-09-19T09:25:44.721499+0000 (oldest deadline 2024-09-19T09:26:06.421281+0000) 2024-09-19T09:26:23.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:23.636+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:49.322249+0000 front 2024-09-19T09:25:49.322235+0000 (oldest deadline 2024-09-19T09:26:14.622207+0000) 2024-09-19T09:26:23.982 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:23 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6[58399]: 2024-09-19T09:26:23.636+0000 7f375727c640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:56.823344+0000 front 2024-09-19T09:25:56.823401+0000 (oldest deadline 2024-09-19T09:26:22.723500+0000) 2024-09-19T09:26:24.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:23 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:23.566+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:24.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:23 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:23.566+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:24.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:23 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:23.566+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:24.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:23 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:23.566+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:24.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:23.771+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:24.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:23.771+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:24.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:23.771+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:24.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:23.882+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:24.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:23.882+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:24.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:23.882+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:24.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:23 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:23.882+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:24.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:24.146+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:24.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:24.146+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:24.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:24.146+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:24.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:24 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:24.146+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:24.563 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:24 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:24.270+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:24.564 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:24 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:24.270+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:25.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:24 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:24.562+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:25.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:24 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:24.562+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:25.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:24 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:24.562+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:25.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:24 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:24.562+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:25.149 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:24 smithi046 podman[117890]: 2024-09-19 09:26:24.754062699 +0000 UTC m=+5.446245678 container died cd84debaeb420a9ba0805e7baf2da42ff8e5f6cce8bb7da00e4befcdd2dab1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:25.149 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 podman[117890]: 2024-09-19 09:26:25.148736519 +0000 UTC m=+5.840919498 container cleanup cd84debaeb420a9ba0805e7baf2da42ff8e5f6cce8bb7da00e4befcdd2dab1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T09:26:25.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:24.788+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:25.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:24.788+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:25.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:24.788+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:25.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:24.788+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:25.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:24.856+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:25.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:24.856+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:25.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:24.856+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:25.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:24 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:24.856+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:25.481 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 bash[117890]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:26:25.481 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 podman[117905]: 2024-09-19 09:26:25.375187897 +0000 UTC m=+0.619321511 container remove cd84debaeb420a9ba0805e7baf2da42ff8e5f6cce8bb7da00e4befcdd2dab1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:26:25.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:25 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:25.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:25.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:25 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:25.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:25.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:25 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:25.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:25.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:25 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:25.158+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:25.545 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:25.280+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:25.545 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:25.280+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:25.545 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:25.280+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:25.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 podman[117993]: 2024-09-19 09:26:25.604001254 +0000 UTC m=+0.016754840 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:25.981 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 podman[117993]: 2024-09-19 09:26:25.717686531 +0000 UTC m=+0.130440119 container create 45aec3df3a976acd75224e678e7958322aaed55f9e27348b7def99117991a537 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:26:25.982 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 podman[117993]: 2024-09-19 09:26:25.945054273 +0000 UTC m=+0.357807870 container init 45aec3df3a976acd75224e678e7958322aaed55f9e27348b7def99117991a537 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:26:25.982 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:25 smithi046 podman[117993]: 2024-09-19 09:26:25.94844734 +0000 UTC m=+0.361200936 container start 45aec3df3a976acd75224e678e7958322aaed55f9e27348b7def99117991a537 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:26.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:25.544+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:26.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:25.544+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:26.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:25.544+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:26.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:25.544+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:26.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:25.804+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:26.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:25.804+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:26.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:25.804+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:26.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:25.804+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:26.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:25.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:26.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:25.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:26.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:25.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:26.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:25 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:25.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:26.432 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:26 smithi046 podman[117993]: 2024-09-19 09:26:26.003482913 +0000 UTC m=+0.416236516 container attach 45aec3df3a976acd75224e678e7958322aaed55f9e27348b7def99117991a537 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:26:26.433 INFO:journalctl@ceph.osd.6.smithi046.stdout:Sep 19 09:26:26 smithi046 podman[117993]: 2024-09-19 09:26:26.147180379 +0000 UTC m=+0.559933979 container died 45aec3df3a976acd75224e678e7958322aaed55f9e27348b7def99117991a537 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T09:26:26.433 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:26.173+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:26.433 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:26.173+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:26.433 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:26.173+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:26.433 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:26 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:26.173+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:26.763 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:26.290+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:26.763 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:26.290+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:26.763 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:26.290+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:26.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:26.505+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:26.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:26.505+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:26.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:26.505+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:26.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:26 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:26.505+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:26.839 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:26:26.884 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:26.884 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:26:26.884 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:26:26.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:26:27.209 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:26 smithi099 systemd[1]: Stopping Ceph osd.7 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:26.755+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:26.755+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:26.755+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:26.755+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:26.933+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:26.933+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:26.933+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:27.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:26 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:26.933+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:27.465 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:27.207+0000 7fe4828a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:27.465 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:27.207+0000 7fe4828a8640 -1 osd.7 88 *** Got signal Terminated *** 2024-09-19T09:26:27.465 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:27.207+0000 7fe4828a8640 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:27.465 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:27.256+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:27.466 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:27.256+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:27.466 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:27.256+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:27.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:27.150+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:27.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:27.150+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:27.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:27.150+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:27.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:27 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:27.150+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:27.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:27.464+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:27.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:27.464+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:27.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:27.464+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:27.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:27 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:27.464+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:28.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:27.761+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:28.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:27.761+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:28.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:27.761+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:28.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:27.761+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:28.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:27.938+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:28.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:27.938+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:28.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:27.938+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:28.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:27 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:27.938+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:28.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:28 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:28.131+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:28.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:28 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:28.131+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:28.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:28 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:28.131+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:28.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:28 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:28.131+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:28.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:28.467+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:28.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:28.467+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:28.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:28.467+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:28.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:28.467+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:28.764 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:28.293+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:28.764 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:28.293+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:28.764 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:28 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:28.293+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:29.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:28.779+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:29.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:28.779+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:29.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:28.779+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:29.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:28.779+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:29.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:28.958+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:29.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:28.958+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:29.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:28.958+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:29.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:28 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:28.958+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:29.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:29 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:29.179+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:29.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:29 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:29.179+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:29.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:29 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:29.179+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:29.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:29 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:29.179+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:29.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:29.258+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:29.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:29.258+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:29.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:29.258+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:29.513 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:29.503+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:29.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:29.503+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:29.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:29.503+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:29.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:29.503+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:30.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:29.817+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:30.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:29.817+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:30.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:29.817+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:30.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:29.817+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:30.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:29.911+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:30.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:29.911+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:30.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:29.911+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:30.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:29 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:29.911+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:30.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:30.147+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:30.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:30.147+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:30.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:30.147+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:30.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:30 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:30.147+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:30.763 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:30.262+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:30.763 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:30.262+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:30.763 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:30.262+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:30.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:30.460+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:30.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:30.460+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:30.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:30.460+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:30.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:30.460+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:30.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:30 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:30.460+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:31.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:30.799+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:31.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:30.799+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:31.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:30.799+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:31.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:30.799+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:31.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:30.932+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:31.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:30.932+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:31.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:30.932+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:31.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:30 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:30.932+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:31.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:31.133+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:31.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:31.133+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:31.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:31.133+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:31.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:31 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:31.133+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:31.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:31.249+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.203889+0000 front 2024-09-19T09:25:43.204076+0000 (oldest deadline 2024-09-19T09:26:07.904015+0000) 2024-09-19T09:26:31.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:31.249+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.405093+0000 front 2024-09-19T09:25:51.404909+0000 (oldest deadline 2024-09-19T09:26:18.405302+0000) 2024-09-19T09:26:31.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:31.249+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.405807+0000 front 2024-09-19T09:25:58.405999+0000 (oldest deadline 2024-09-19T09:26:24.305819+0000) 2024-09-19T09:26:31.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7[53123]: 2024-09-19T09:26:31.249+0000 7fe47aeb6640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:04.806902+0000 front 2024-09-19T09:26:04.806921+0000 (oldest deadline 2024-09-19T09:26:30.607555+0000) 2024-09-19T09:26:31.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:31.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:31.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:31.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:31.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:31.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:31.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:31.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:31.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:31 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:31.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:32.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:31.787+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:32.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:31.787+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:32.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:31.787+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:32.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:31.787+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:32.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:31.935+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:32.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:31.935+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:32.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:31.935+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:32.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:31.935+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:32.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:31 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:31.935+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:32.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:32 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:32.161+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:32.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:32 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:32.161+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:32.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:32 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:32.161+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:32.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:32 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:32.161+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:32.766 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:32 smithi099 podman[69230]: 2024-09-19 09:26:32.550049684 +0000 UTC m=+5.462880567 container died 4cef91302df74104d7b46ae8e8aed3ba8117bcc74948045a42001298e7dc2cad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T09:26:32.766 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:32 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:32.398+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:32.766 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:32 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:32.398+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:32.767 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:32 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:32.398+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:32.767 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:32 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:32.398+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:32.767 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:32 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:32.398+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:33.202 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:32 smithi099 podman[69230]: 2024-09-19 09:26:32.949064073 +0000 UTC m=+5.861894944 container cleanup 4cef91302df74104d7b46ae8e8aed3ba8117bcc74948045a42001298e7dc2cad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:26:33.202 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:32 smithi099 bash[69230]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:26:33.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:32.739+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:33.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:32.739+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:33.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:32.739+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:33.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:32.739+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:33.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:32.907+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:33.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:32.907+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:33.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:32.907+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:33.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:32.907+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:33.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:32 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:32.907+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:33.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:33 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:33.148+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:33.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:33 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:33.148+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:33.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:33 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:33.148+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:33.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:33 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:33.148+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:33.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:33 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:33.148+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:33.513 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69246]: 2024-09-19 09:26:33.20067905 +0000 UTC m=+0.649178008 container remove 4cef91302df74104d7b46ae8e8aed3ba8117bcc74948045a42001298e7dc2cad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:26:33.513 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:33.366+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:33.513 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:33.366+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:33.513 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:33.366+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:33.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:33.366+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:33.514 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:33.366+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:33.766 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69335]: 2024-09-19 09:26:33.416053691 +0000 UTC m=+0.016167025 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:33.767 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69335]: 2024-09-19 09:26:33.51795941 +0000 UTC m=+0.118072728 container create 2a43ed0d59c6e2f48bc492efef6f89fc534ad6a40df484fd56f41aa5ef4db4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T09:26:33.767 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69335]: 2024-09-19 09:26:33.76270336 +0000 UTC m=+0.362816686 container init 2a43ed0d59c6e2f48bc492efef6f89fc534ad6a40df484fd56f41aa5ef4db4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:26:33.767 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69335]: 2024-09-19 09:26:33.766241812 +0000 UTC m=+0.366355134 container start 2a43ed0d59c6e2f48bc492efef6f89fc534ad6a40df484fd56f41aa5ef4db4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-19T09:26:34.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:33.768+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:34.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:33.768+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:34.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:33.768+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:34.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:33.768+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:34.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:33.898+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:34.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:33.898+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:34.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:33.898+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:34.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:33.898+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:34.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:33 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:33.898+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:34.263 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69335]: 2024-09-19 09:26:33.862489506 +0000 UTC m=+0.462602830 container attach 2a43ed0d59c6e2f48bc492efef6f89fc534ad6a40df484fd56f41aa5ef4db4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:26:34.263 INFO:journalctl@ceph.osd.7.smithi099.stdout:Sep 19 09:26:33 smithi099 podman[69335]: 2024-09-19 09:26:33.953108122 +0000 UTC m=+0.553221450 container died 2a43ed0d59c6e2f48bc492efef6f89fc534ad6a40df484fd56f41aa5ef4db4a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:34.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:34 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:34.194+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:34.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:34 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:34.194+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:34.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:34 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:34.194+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:34.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:34 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:34.194+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:34.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:34 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:34.194+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:34.618 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:34.415+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:34.619 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:34.415+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:34.619 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:34.415+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:34.619 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:34.415+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:34.619 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:34 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:34.415+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:34.641 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:26:34.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:34.682 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:26:34.683 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:26:34.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:26:34.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:34 smithi115 systemd[1]: Stopping Ceph osd.8 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:34.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:34.776+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:34.960 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:34.776+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:34.776+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:34.776+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:34.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:34.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:34.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:34.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:34.961 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:34 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:34.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:35.459 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.001+0000 7f5df3aa5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:35.460 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.001+0000 7f5df3aa5640 -1 osd.8 88 *** Got signal Terminated *** 2024-09-19T09:26:35.460 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.001+0000 7f5df3aa5640 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:35.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:35 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:35.218+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:35.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:35 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:35.218+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:35.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:35 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:35.218+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:35.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:35 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:35.218+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:35.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:35 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:35.218+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:35.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:35 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:35.452+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:35.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:35 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:35.452+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:35.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:35 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:35.452+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:35.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:35 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:35.452+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:35.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:35 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:35.452+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:36.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.814+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:36.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.814+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:36.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.814+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:36.211 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:35.814+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:36.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:35.886+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:36.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:35.886+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:36.212 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:35.886+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:36.212 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:35.886+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:36.212 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:35 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:35.886+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:36.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:36 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:36.223+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:36.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:36 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:36.223+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:36.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:36 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:36.223+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:36.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:36 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:36.223+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:36.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:36 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:36.223+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:36.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:36 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:36.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:36.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:36 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:36.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:36.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:36 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:36.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:36.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:36 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:36.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:36.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:36 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:36.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:37.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:36.828+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:37.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:36.828+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:37.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:36.828+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:37.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:36.828+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:37.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:36.892+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:37.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:36.892+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:37.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:36.892+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:37.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:36.892+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:37.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:36 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:36.892+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:37.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:37.243+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:37.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:37.243+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:37.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:37.243+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:37.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:37.243+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:37.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:37 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:37.243+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:37.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:37 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:37.455+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:37.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:37 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:37.455+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:37.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:37 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:37.455+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:37.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:37 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:37.455+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:37.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:37 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:37.455+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:38.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:37.859+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:38.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:37.859+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:38.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:37.859+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:38.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:37.859+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:38.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:37.858+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:38.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:37.858+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:38.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:37.858+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:38.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:37.858+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:38.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:37.858+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:38.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:38.265+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:38.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:38.265+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:38.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:38.265+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:38.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:38.265+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:38.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:38.265+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:38.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:38 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:38.265+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:38.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:38 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:38.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:38.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:38 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:38.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:38.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:38 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:38.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:38.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:38 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:38.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:38.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:38 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:38.463+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:39.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:38.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:39.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:38.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:39.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:38.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:39.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:38.863+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:39.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:38.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:39.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:38.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:39.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:38.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:39.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:38.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:39.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:38.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:39.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:38 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:38.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:39.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:39.277+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:39.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:39.277+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:39.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:39.277+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:39.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:39.277+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:39.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:39.277+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:39.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:39 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:39.277+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:39.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:39.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:39.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:39.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:39.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:39.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:39.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:39.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:39.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:39 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:39.444+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:40.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:39.890+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.429885+0000 front 2024-09-19T09:25:35.430025+0000 (oldest deadline 2024-09-19T09:25:59.529912+0000) 2024-09-19T09:26:40.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:39.890+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.430893+0000 front 2024-09-19T09:25:42.431070+0000 (oldest deadline 2024-09-19T09:26:07.730859+0000) 2024-09-19T09:26:40.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:39.890+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.831580+0000 front 2024-09-19T09:25:51.831673+0000 (oldest deadline 2024-09-19T09:26:15.331747+0000) 2024-09-19T09:26:40.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8[53389]: 2024-09-19T09:26:39.890+0000 7f5df00bb640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.032821+0000 front 2024-09-19T09:26:00.032960+0000 (oldest deadline 2024-09-19T09:26:24.132791+0000) 2024-09-19T09:26:40.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:39.864+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:40.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:39.864+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:40.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:39.864+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:40.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:39.864+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:40.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:39.864+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:40.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:39 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:39.864+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:40.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:40 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:40.239+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:40.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:40 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:40.239+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:40.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:40 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:40.239+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:40.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:40 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:40.239+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:40.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:40 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:40.239+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:40.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:40 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:40.239+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:40.744 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:40 smithi115 podman[69157]: 2024-09-19 09:26:40.475787034 +0000 UTC m=+5.599615111 container died 74ac9206cd0e13b45f4333638315be389fb225a7c2dce01059bfc28fcccdc835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:40.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:40 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:40.425+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:40.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:40 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:40.425+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:40.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:40 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:40.425+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:40.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:40 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:40.425+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:40.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:40 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:40.425+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:41.128 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:40 smithi115 podman[69157]: 2024-09-19 09:26:40.826371624 +0000 UTC m=+5.950199742 container cleanup 74ac9206cd0e13b45f4333638315be389fb225a7c2dce01059bfc28fcccdc835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:26:41.128 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:40 smithi115 bash[69157]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:26:41.128 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:40 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:40.819+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:41.128 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:40 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:40.819+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:41.128 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:40 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:40.819+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:41.129 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:40 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:40.819+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:41.129 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:40 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:40.819+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:41.129 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:40 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:40.819+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:41.460 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69172]: 2024-09-19 09:26:41.127512055 +0000 UTC m=+0.654383259 container remove 74ac9206cd0e13b45f4333638315be389fb225a7c2dce01059bfc28fcccdc835 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:26:41.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:41 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:41.214+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:41.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:41 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:41.214+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:41.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:41 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:41.214+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:41.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:41 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:41.214+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:41.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:41 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:41.214+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:41.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:41 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:41.214+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:41.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:41 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:41.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:41.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:41 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:41.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:41.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:41 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:41.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:41.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:41 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:41.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:41.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:41 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:41.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:41.789 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69259]: 2024-09-19 09:26:41.469911442 +0000 UTC m=+0.103889472 container create 1d7c2f9d637b48ab1a7c9706e7268e5e3711cc0660f6fb556ccba9a20b218d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:26:41.789 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69259]: 2024-09-19 09:26:41.381806935 +0000 UTC m=+0.015784978 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:41.789 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69259]: 2024-09-19 09:26:41.705444826 +0000 UTC m=+0.339422857 container init 1d7c2f9d637b48ab1a7c9706e7268e5e3711cc0660f6fb556ccba9a20b218d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:41.789 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69259]: 2024-09-19 09:26:41.708830382 +0000 UTC m=+0.342808420 container start 1d7c2f9d637b48ab1a7c9706e7268e5e3711cc0660f6fb556ccba9a20b218d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:41.789 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69259]: 2024-09-19 09:26:41.788699677 +0000 UTC m=+0.422677727 container attach 1d7c2f9d637b48ab1a7c9706e7268e5e3711cc0660f6fb556ccba9a20b218d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.8.smithi115.stdout:Sep 19 09:26:41 smithi115 podman[69259]: 2024-09-19 09:26:41.897334765 +0000 UTC m=+0.531312797 container died 1d7c2f9d637b48ab1a7c9706e7268e5e3711cc0660f6fb556ccba9a20b218d7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:41.789+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:41.789+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:41.789+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:41.789+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:41.789+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:42.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:41.789+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:42.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:26:42.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:42.618 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:26:42.618 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:26:42.618 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:26:42.646 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.264+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:42.646 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.264+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:42.646 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.264+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:42.646 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.264+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:42.646 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.264+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:42.646 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.264+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:42.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:42 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:42.401+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:42.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:42 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:42.401+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:42.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:42 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:42.401+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:42.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:42 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:42.401+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:42.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:42 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:42.401+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:42.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:42 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:42.401+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:42.927 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 systemd[1]: Stopping Ceph osd.9 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:42.927 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.925+0000 7fd02e081640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:42.927 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.925+0000 7fd02e081640 -1 osd.9 88 *** Got signal Terminated *** 2024-09-19T09:26:43.213 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:42.824+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:43.213 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:42.824+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:43.213 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:42.824+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:43.213 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:42.824+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:43.214 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:42.824+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:43.214 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:42 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:42.824+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:43.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:42 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:42.925+0000 7fd02e081640 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:43.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:43 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:43.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:43.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:43 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:43.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:43.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:43 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:43.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:43.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:43 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:43.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:43.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:43 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:43.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:43.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:43 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:43.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:43.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:43 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:43.406+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:43.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:43 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:43.406+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:43.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:43 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:43.406+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:43.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:43 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:43.406+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:43.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:43 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:43.406+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:43.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:43 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:43.406+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:44.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:43 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:43.784+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:44.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:43 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:43.784+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:44.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:43 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:43.784+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:44.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:43 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:43.784+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:44.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:43 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:43.784+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:44.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:43 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:43.784+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:44.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:44 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:44.253+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:44.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:44 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:44.253+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:44.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:44 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:44.253+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:44.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:44 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:44.253+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:44.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:44 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:44.253+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:44.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:44 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:44.253+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:44.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:44.424+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:44.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:44.424+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:44.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:44.424+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:44.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:44.424+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:44.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:44.424+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:44.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:44 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:44.424+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:45.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:44 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:44.827+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:45.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:44 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:44.827+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:45.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:44 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:44.827+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:45.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:44 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:44.827+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:45.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:44 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:44.827+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:45.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:44 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:44.827+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:45.664 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:45 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:45.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:45.665 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:45 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:45.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:45.665 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:45 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:45.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:45.665 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:45 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:45.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:45.665 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:45 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:45.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:45.665 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:45 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:45.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:45.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:45.268+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:45.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:45.268+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:45.731 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:45.268+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:45.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:45.268+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:45.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:45.268+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:45.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:45 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:45.268+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:46.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:45.810+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:46.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:45.810+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:46.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:45.810+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:46.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:45.810+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:46.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:45.810+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:46.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:45.810+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:46.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:46.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:46.481 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:46.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:46.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:46.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:46.482 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:46 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:46.222+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:19.737195+0000 front 2024-09-19T09:26:19.737230+0000 (oldest deadline 2024-09-19T09:26:45.637418+0000) 2024-09-19T09:26:46.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:46 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:46.417+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:46.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:46 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:46.417+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:46.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:46 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:46.417+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:46.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:46 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:46.417+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:46.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:46 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:46.417+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:46.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:46 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:46.417+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:47.111 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:46 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:46.857+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:47.111 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:46 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:46.857+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:47.112 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:46 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:46.857+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:47.112 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:46 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:46.857+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:47.112 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:46 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:46.857+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:47.112 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:46 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:46.857+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:35.530222+0000 front 2024-09-19T09:25:35.530404+0000 (oldest deadline 2024-09-19T09:26:00.230349+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:44.732482+0000 front 2024-09-19T09:25:44.732457+0000 (oldest deadline 2024-09-19T09:26:05.232570+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:51.634103+0000 front 2024-09-19T09:25:51.634136+0000 (oldest deadline 2024-09-19T09:26:16.334164+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:59.234891+0000 front 2024-09-19T09:25:59.234860+0000 (oldest deadline 2024-09-19T09:26:22.735000+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.436113+0000 front 2024-09-19T09:26:07.436214+0000 (oldest deadline 2024-09-19T09:26:32.735994+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:12.736426+0000 front 2024-09-19T09:26:12.736397+0000 (oldest deadline 2024-09-19T09:26:38.036472+0000) 2024-09-19T09:26:47.732 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:47 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9[65222]: 2024-09-19T09:26:47.232+0000 7fd02a697640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:19.737195+0000 front 2024-09-19T09:26:19.737230+0000 (oldest deadline 2024-09-19T09:26:45.637418+0000) 2024-09-19T09:26:47.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:47.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:47.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:47.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:47.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:47.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:47.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:47 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:47.439+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:48.124 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:47.821+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:48.124 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:47.821+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:48.124 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:47.821+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:48.124 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:47.821+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:48.124 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:47.821+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:48.124 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:47 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:47.821+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:48.530 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:48 smithi046 podman[118094]: 2024-09-19 09:26:48.271140562 +0000 UTC m=+5.455828514 container died d1c1fc8c58d6f20d2eb65eecf3edb5e70c93ca84427c5157f1da992c99faf2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:26:48.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.403+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:48.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:48.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:48.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:48.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:48.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:48.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:48 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:48.404+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:48.981 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:48 smithi046 podman[118094]: 2024-09-19 09:26:48.718080827 +0000 UTC m=+5.902768768 container cleanup d1c1fc8c58d6f20d2eb65eecf3edb5e70c93ca84427c5157f1da992c99faf2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:48.981 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:48 smithi046 bash[118094]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:26:49.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:48.861+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:49.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:48.861+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:49.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:48.861+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:49.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:48.861+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:49.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:48.861+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:49.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:48 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:48.861+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:49.347 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:48 smithi046 podman[118109]: 2024-09-19 09:26:48.994445222 +0000 UTC m=+0.723401672 container remove d1c1fc8c58d6f20d2eb65eecf3edb5e70c93ca84427c5157f1da992c99faf2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:26:49.639 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:49 smithi046 podman[118201]: 2024-09-19 09:26:49.249157737 +0000 UTC m=+0.016500484 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:49.639 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:49 smithi046 podman[118201]: 2024-09-19 09:26:49.353382606 +0000 UTC m=+0.120725343 container create 6e09fe04def37843271437a03fb9738148e41eb89f4a77d20e573dce44584f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:49.639 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:49 smithi046 podman[118201]: 2024-09-19 09:26:49.555789843 +0000 UTC m=+0.323132583 container init 6e09fe04def37843271437a03fb9738148e41eb89f4a77d20e573dce44584f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:26:49.640 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:49 smithi046 podman[118201]: 2024-09-19 09:26:49.559111962 +0000 UTC m=+0.326454708 container start 6e09fe04def37843271437a03fb9738148e41eb89f4a77d20e573dce44584f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:49.640 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:49 smithi046 podman[118201]: 2024-09-19 09:26:49.638859005 +0000 UTC m=+0.406201750 container attach 6e09fe04def37843271437a03fb9738148e41eb89f4a77d20e573dce44584f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:26:49.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:49.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:49.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:49.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:49.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:49.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:49.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:49 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:49.356+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:49.982 INFO:journalctl@ceph.osd.9.smithi046.stdout:Sep 19 09:26:49 smithi046 podman[118201]: 2024-09-19 09:26:49.751193854 +0000 UTC m=+0.518536602 container died 6e09fe04def37843271437a03fb9738148e41eb89f4a77d20e573dce44584f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T09:26:50.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:49.904+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:50.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:49.904+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:50.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:49.904+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:50.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:49.904+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:50.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:49.904+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:50.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:49.904+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:50.330 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:26:50.412 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:50.413 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:26:50.413 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:26:50.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.381+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 systemd[1]: Stopping Ceph osd.10 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.734+0000 7f83f78d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:50.736 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.734+0000 7f83f78d2640 -1 osd.10 88 *** Got signal Terminated *** 2024-09-19T09:26:50.737 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:50 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:50.734+0000 7f83f78d2640 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:51.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:50 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:50.879+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:51.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:50 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:50.879+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:51.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:50 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:50.879+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:51.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:50 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:50.879+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:51.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:50 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:50.879+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:51.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:50 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:50.879+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:51.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:51.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:51.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:51.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:51.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:51.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:51.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:51 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:51.333+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:52.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:51 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:51.919+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:52.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:51 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:51.919+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:52.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:51 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:51.919+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:52.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:51 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:51.919+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:52.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:51 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:51.919+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:52.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:51 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:51.919+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:52.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:52 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:52.351+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:53.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:52 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:52.896+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:53.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:52 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:52.896+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:53.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:52 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:52.896+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:53.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:52 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:52.896+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:53.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:52 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:52.896+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:53.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:52 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:52.896+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:53.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:53.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:53.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:53.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:53.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:53.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:53.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:53 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:53.319+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:54.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:53 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:53.868+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:54.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:53 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:53.868+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:54.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:53 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:53.868+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:54.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:53 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:53.868+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:54.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:53 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:53.868+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:54.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:53 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:53.868+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:54.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:54.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:54.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:54.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:54.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:54.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:54.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:54 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:54.336+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:55.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:54 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:54.893+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:55.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:54 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:54.893+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:55.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:54 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:54.893+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:55.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:54 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:54.893+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:55.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:54 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:54.893+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:55.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:54 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:54.893+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:55.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.322396+0000 front 2024-09-19T09:25:36.322561+0000 (oldest deadline 2024-09-19T09:26:02.222433+0000) 2024-09-19T09:26:55.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:43.923448+0000 front 2024-09-19T09:25:43.923391+0000 (oldest deadline 2024-09-19T09:26:08.623544+0000) 2024-09-19T09:26:55.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:50.924539+0000 front 2024-09-19T09:25:50.924743+0000 (oldest deadline 2024-09-19T09:26:16.824413+0000) 2024-09-19T09:26:55.763 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:26:00.226059+0000 front 2024-09-19T09:26:00.225969+0000 (oldest deadline 2024-09-19T09:26:21.925753+0000) 2024-09-19T09:26:55.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:07.226444+0000 front 2024-09-19T09:26:07.226473+0000 (oldest deadline 2024-09-19T09:26:30.126550+0000) 2024-09-19T09:26:55.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:16.027587+0000 front 2024-09-19T09:26:16.027712+0000 (oldest deadline 2024-09-19T09:26:41.927484+0000) 2024-09-19T09:26:55.764 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:55 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10[59697]: 2024-09-19T09:26:55.353+0000 7f83f3ee8640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.46:6822 osd.6 since back 2024-09-19T09:26:21.927918+0000 front 2024-09-19T09:26:21.927999+0000 (oldest deadline 2024-09-19T09:26:47.227948+0000) 2024-09-19T09:26:56.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:55 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:55.941+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:56.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:55 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:55.941+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:56.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:55 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:55.941+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:56.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:55 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:55.941+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:56.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:55 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:55.941+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:56.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:55 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:55.941+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:56.344 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:56 smithi099 podman[69463]: 2024-09-19 09:26:56.086168321 +0000 UTC m=+5.469619925 container died 1ae1b574e1c662388a4ef447325ac4114479fb494ccdce73c22b826c16560adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:26:56.642 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:56 smithi099 podman[69463]: 2024-09-19 09:26:56.44218617 +0000 UTC m=+5.825637782 container cleanup 1ae1b574e1c662388a4ef447325ac4114479fb494ccdce73c22b826c16560adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:56.643 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:56 smithi099 bash[69463]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:26:57.013 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:56 smithi099 podman[69479]: 2024-09-19 09:26:56.743363717 +0000 UTC m=+0.653568391 container remove 1ae1b574e1c662388a4ef447325ac4114479fb494ccdce73c22b826c16560adf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:57.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:56 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:56.906+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:26:57.306 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:57 smithi099 podman[69567]: 2024-09-19 09:26:57.052947108 +0000 UTC m=+0.110279794 container create 3020ba301f17612ee1afd03c49c070b8bfb20b86e017618a75beb1bd4ac7afe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:26:57.306 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:57 smithi099 podman[69567]: 2024-09-19 09:26:56.958176755 +0000 UTC m=+0.015509455 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:26:57.758 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:57 smithi099 podman[69567]: 2024-09-19 09:26:57.305838378 +0000 UTC m=+0.363171071 container init 3020ba301f17612ee1afd03c49c070b8bfb20b86e017618a75beb1bd4ac7afe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:26:57.759 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:57 smithi099 podman[69567]: 2024-09-19 09:26:57.309698719 +0000 UTC m=+0.367031406 container start 3020ba301f17612ee1afd03c49c070b8bfb20b86e017618a75beb1bd4ac7afe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:26:57.759 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:57 smithi099 podman[69567]: 2024-09-19 09:26:57.388697895 +0000 UTC m=+0.446030582 container attach 3020ba301f17612ee1afd03c49c070b8bfb20b86e017618a75beb1bd4ac7afe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:26:57.759 INFO:journalctl@ceph.osd.10.smithi099.stdout:Sep 19 09:26:57 smithi099 podman[69567]: 2024-09-19 09:26:57.496057936 +0000 UTC m=+0.553390640 container died 3020ba301f17612ee1afd03c49c070b8bfb20b86e017618a75beb1bd4ac7afe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:26:58.036 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:26:58.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:26:58.074 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:26:58.074 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:26:58.074 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:26:58.169 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:58.169 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:58.170 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:58.170 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:58.170 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:58.170 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:58.170 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:57 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:57.876+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:26:58.170 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 systemd[1]: Stopping Ceph osd.11 for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:26:58.460 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.383+0000 7f3699a05640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:26:58.460 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.384+0000 7f3699a05640 -1 osd.11 88 *** Got signal Terminated *** 2024-09-19T09:26:58.460 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.384+0000 7f3699a05640 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:26:59.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:26:59.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:26:59.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:26:59.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:26:59.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:26:59.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:26:59.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:58 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:58.887+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:27:00.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:26:59 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:26:59.875+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:27:01.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:00 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:00.860+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:27:02.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.816+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:27:02.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:01 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:01.817+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6820 osd.8 since back 2024-09-19T09:26:35.954464+0000 front 2024-09-19T09:26:35.954517+0000 (oldest deadline 2024-09-19T09:27:01.254498+0000) 2024-09-19T09:27:03.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-19T09:25:36.745966+0000 front 2024-09-19T09:25:36.745840+0000 (oldest deadline 2024-09-19T09:26:01.445837+0000) 2024-09-19T09:27:03.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6804 osd.1 since back 2024-09-19T09:25:42.546836+0000 front 2024-09-19T09:25:42.546938+0000 (oldest deadline 2024-09-19T09:26:07.246836+0000) 2024-09-19T09:27:03.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6804 osd.2 since back 2024-09-19T09:25:48.947611+0000 front 2024-09-19T09:25:48.947662+0000 (oldest deadline 2024-09-19T09:26:13.647700+0000) 2024-09-19T09:27:03.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.46:6814 osd.3 since back 2024-09-19T09:25:58.249184+0000 front 2024-09-19T09:25:58.249240+0000 (oldest deadline 2024-09-19T09:26:22.349100+0000) 2024-09-19T09:27:03.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6812 osd.4 since back 2024-09-19T09:26:02.850091+0000 front 2024-09-19T09:26:02.850069+0000 (oldest deadline 2024-09-19T09:26:31.050407+0000) 2024-09-19T09:27:03.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6812 osd.5 since back 2024-09-19T09:26:15.051727+0000 front 2024-09-19T09:26:15.051679+0000 (oldest deadline 2024-09-19T09:26:38.551707+0000) 2024-09-19T09:27:03.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.99:6820 osd.7 since back 2024-09-19T09:26:30.054247+0000 front 2024-09-19T09:26:30.054377+0000 (oldest deadline 2024-09-19T09:26:55.954164+0000) 2024-09-19T09:27:03.211 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:02 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11[59950]: 2024-09-19T09:27:02.831+0000 7f369601b640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.115:6820 osd.8 since back 2024-09-19T09:26:35.954464+0000 front 2024-09-19T09:26:35.954517+0000 (oldest deadline 2024-09-19T09:27:01.254498+0000) 2024-09-19T09:27:04.210 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:03 smithi115 podman[69373]: 2024-09-19 09:27:03.934578854 +0000 UTC m=+5.647220687 container died f63f9b56430c70b8072ee829f61462d78c16259fc5a9e25dc731eec6b7b3c538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:27:04.560 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:04 smithi115 podman[69373]: 2024-09-19 09:27:04.317507126 +0000 UTC m=+6.030148918 container cleanup f63f9b56430c70b8072ee829f61462d78c16259fc5a9e25dc731eec6b7b3c538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:27:04.560 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:04 smithi115 bash[69373]: ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:27:04.885 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:04 smithi115 podman[69388]: 2024-09-19 09:27:04.560007624 +0000 UTC m=+0.613830473 container remove f63f9b56430c70b8072ee829f61462d78c16259fc5a9e25dc731eec6b7b3c538 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:27:05.172 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:04 smithi115 podman[69479]: 2024-09-19 09:27:04.787794415 +0000 UTC m=+0.015758229 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:27:05.172 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:04 smithi115 podman[69479]: 2024-09-19 09:27:04.894059189 +0000 UTC m=+0.122023002 container create 5c7c0be01ca7b82f2103a1e21267e5d0db443d9d5bf6503c3dcdcce83387d5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:27:05.172 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:05 smithi115 podman[69479]: 2024-09-19 09:27:05.096611055 +0000 UTC m=+0.324574868 container init 5c7c0be01ca7b82f2103a1e21267e5d0db443d9d5bf6503c3dcdcce83387d5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T09:27:05.173 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:05 smithi115 podman[69479]: 2024-09-19 09:27:05.099759909 +0000 UTC m=+0.327723731 container start 5c7c0be01ca7b82f2103a1e21267e5d0db443d9d5bf6503c3dcdcce83387d5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:27:05.173 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:05 smithi115 podman[69479]: 2024-09-19 09:27:05.171561539 +0000 UTC m=+0.399525355 container attach 5c7c0be01ca7b82f2103a1e21267e5d0db443d9d5bf6503c3dcdcce83387d5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:27:05.460 INFO:journalctl@ceph.osd.11.smithi115.stdout:Sep 19 09:27:05 smithi115 podman[69479]: 2024-09-19 09:27:05.284530521 +0000 UTC m=+0.512494341 container died 5c7c0be01ca7b82f2103a1e21267e5d0db443d9d5bf6503c3dcdcce83387d5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:27:05.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:27:05.909 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:05.910 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:27:05.910 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:27:05.910 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:27:06.204 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:05 smithi046 systemd[1]: Stopping Ceph mds.a for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:06.481 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:06 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a[72398]: 2024-09-19T09:27:06.202+0000 7f85da29e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:06.481 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:06 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a[72398]: 2024-09-19T09:27:06.202+0000 7f85da29e640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:27:08.953 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:08 smithi046 podman[118317]: 2024-09-19 09:27:08.55340416 +0000 UTC m=+2.444033510 container died c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T09:27:08.954 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:08 smithi046 podman[118317]: 2024-09-19 09:27:08.952463719 +0000 UTC m=+2.843093067 container cleanup c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T09:27:09.231 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:08 smithi046 bash[118317]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:27:09.231 INFO:journalctl@ceph.mds.a.smithi046.stdout:Sep 19 09:27:09 smithi046 podman[118330]: 2024-09-19 09:27:09.162021759 +0000 UTC m=+0.604875265 container remove c98a3b20441a276a76fb8df9162e35785c7354e2e3ecca7296934cd215409626 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:27:09.302 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:27:09.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:09.337 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:27:09.338 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:27:09.338 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:27:09.657 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:09 smithi046 systemd[1]: Stopping Ceph mds.d for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:09.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d[71216]: 2024-09-19T09:27:09.655+0000 7ff971009640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:09.981 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:09 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d[71216]: 2024-09-19T09:27:09.655+0000 7ff971009640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:27:12.065 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:11 smithi046 podman[118435]: 2024-09-19 09:27:11.745526041 +0000 UTC m=+2.188152132 container died 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:27:12.481 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:12 smithi046 podman[118435]: 2024-09-19 09:27:12.064404213 +0000 UTC m=+2.507030294 container cleanup 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-19T09:27:12.481 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:12 smithi046 bash[118435]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:27:12.481 INFO:journalctl@ceph.mds.d.smithi046.stdout:Sep 19 09:27:12 smithi046 podman[118447]: 2024-09-19 09:27:12.249170206 +0000 UTC m=+0.498854797 container remove 1d465c309b4cfacb0d22dba09964f2cfff979ba25cbbf629fae060d290186651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T09:27:12.502 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:27:12.536 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:12.536 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:27:12.536 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:27:12.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:27:12.852 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:12 smithi046 systemd[1]: Stopping Ceph mds.g for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:13.231 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:12 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g[71985]: 2024-09-19T09:27:12.850+0000 7f6119ba5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:13.231 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:12 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g[71985]: 2024-09-19T09:27:12.850+0000 7f6119ba5640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:27:16.868 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:16 smithi046 podman[118555]: 2024-09-19 09:27:16.555372428 +0000 UTC m=+3.801236002 container died b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:27:16.868 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:16 smithi046 podman[118555]: 2024-09-19 09:27:16.867923952 +0000 UTC m=+4.113787536 container cleanup b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:27:17.127 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:16 smithi046 bash[118555]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:27:17.369 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:27:17.392 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:17 smithi046 podman[118567]: 2024-09-19 09:27:17.127275985 +0000 UTC m=+0.569842825 container remove b7ba8648749ed25b556281c618bef6714de065be6bf8dc0396a1dcffce49fd22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:27:17.392 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:17 smithi046 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-19T09:27:17.392 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:17 smithi046 systemd[1]: Stopped Ceph mds.g for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:27:17.392 INFO:journalctl@ceph.mds.g.smithi046.stdout:Sep 19 09:27:17 smithi046 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.g.service: Consumed 2.294s CPU time. 2024-09-19T09:27:17.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:17.403 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:27:17.404 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:27:17.404 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:27:17.706 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:27:17 smithi046 systemd[1]: Stopping Ceph mds.j for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:17.981 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:27:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j[70798]: 2024-09-19T09:27:17.705+0000 7febb8520640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:17.981 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:27:17 smithi046 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j[70798]: 2024-09-19T09:27:17.705+0000 7febb8520640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:27:20.340 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:27:20 smithi046 podman[118679]: 2024-09-19 09:27:20.065896761 +0000 UTC m=+2.442950389 container died acd14ab5840e9b9a93dd7393e2ff94d751e6605825879923f3439bfc40be47aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:27:20.664 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:27:20 smithi046 podman[118679]: 2024-09-19 09:27:20.429747744 +0000 UTC m=+2.806801362 container cleanup acd14ab5840e9b9a93dd7393e2ff94d751e6605825879923f3439bfc40be47aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:27:20.664 INFO:journalctl@ceph.mds.j.smithi046.stdout:Sep 19 09:27:20 smithi046 bash[118679]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:27:20.790 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:27:20.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:20.824 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:27:20.824 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:27:20.824 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:27:21.200 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:27:20 smithi099 systemd[1]: Stopping Ceph mds.b for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:21.457 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:27:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: 2024-09-19T09:27:21.198+0000 7fb029a14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:21.457 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:27:21 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b[65038]: 2024-09-19T09:27:21.198+0000 7fb029a14640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:27:24.893 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:27:24 smithi099 podman[69668]: 2024-09-19 09:27:24.555050837 +0000 UTC m=+3.531598199 container died c5a33ce3e8cc070159bf7c05a8e5f7a70f904323d0c9358c84f9059ac13c9b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:27:25.167 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:27:24 smithi099 podman[69668]: 2024-09-19 09:27:24.965442862 +0000 UTC m=+3.941990222 container cleanup c5a33ce3e8cc070159bf7c05a8e5f7a70f904323d0c9358c84f9059ac13c9b41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:27:25.167 INFO:journalctl@ceph.mds.b.smithi099.stdout:Sep 19 09:27:24 smithi099 bash[69668]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:27:25.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:27:25.416 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:25.416 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:27:25.416 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:27:25.416 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:27:25.737 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:27:25 smithi099 systemd[1]: Stopping Ceph mds.e for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:26.013 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:27:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: 2024-09-19T09:27:25.735+0000 7f6177188640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:26.013 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:27:25 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e[64420]: 2024-09-19T09:27:25.735+0000 7f6177188640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:27:28.829 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:27:28 smithi099 podman[69802]: 2024-09-19 09:27:28.553780504 +0000 UTC m=+2.918156491 container died b2da851b1298e8d53466893e109e2660aea941e1cc543e0d9688893718293e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:27:29.162 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:27:28 smithi099 podman[69802]: 2024-09-19 09:27:28.902604672 +0000 UTC m=+3.266980658 container cleanup b2da851b1298e8d53466893e109e2660aea941e1cc543e0d9688893718293e8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:27:29.162 INFO:journalctl@ceph.mds.e.smithi099.stdout:Sep 19 09:27:28 smithi099 bash[69802]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:27:29.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:27:29.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:29.383 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:27:29.383 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:27:29.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:27:29.707 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:29 smithi099 systemd[1]: Stopping Ceph mds.h for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:30.013 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:27:29.706+0000 7f5d9530c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:30.013 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:29 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h[64724]: 2024-09-19T09:27:29.706+0000 7f5d9530c640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:27:32.763 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:32 smithi099 podman[69924]: 2024-09-19 09:27:32.572684983 +0000 UTC m=+2.966769672 container died b7c1ee3d2906abf22093c87f8e4eba3d281401ea21a7fad2787ac119c7c8dcaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T09:27:33.091 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:32 smithi099 podman[69924]: 2024-09-19 09:27:32.897821767 +0000 UTC m=+3.291906455 container cleanup b7c1ee3d2906abf22093c87f8e4eba3d281401ea21a7fad2787ac119c7c8dcaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:27:33.091 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:32 smithi099 bash[69924]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:27:33.327 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:27:33.349 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:33 smithi099 podman[69937]: 2024-09-19 09:27:33.090684991 +0000 UTC m=+0.514504185 container remove b7c1ee3d2906abf22093c87f8e4eba3d281401ea21a7fad2787ac119c7c8dcaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:27:33.349 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:33 smithi099 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.h.service: Deactivated successfully. 2024-09-19T09:27:33.349 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:33 smithi099 systemd[1]: Stopped Ceph mds.h for a514acda-7666-11ef-bceb-c7b262605968. 2024-09-19T09:27:33.349 INFO:journalctl@ceph.mds.h.smithi099.stdout:Sep 19 09:27:33 smithi099 systemd[1]: ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.h.service: Consumed 11.572s CPU time. 2024-09-19T09:27:33.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:33.360 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:27:33.360 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:27:33.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:27:33.677 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:33 smithi099 systemd[1]: Stopping Ceph mds.k for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:34.013 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k[64108]: 2024-09-19T09:27:33.676+0000 7f445a0d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:34.013 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:33 smithi099 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k[64108]: 2024-09-19T09:27:33.676+0000 7f445a0d4640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:27:36.919 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:36 smithi099 podman[70044]: 2024-09-19 09:27:36.577335429 +0000 UTC m=+2.997870945 container died 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:27:37.263 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:36 smithi099 podman[70044]: 2024-09-19 09:27:36.993309142 +0000 UTC m=+3.413844646 container cleanup 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-19T09:27:37.263 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:36 smithi099 bash[70044]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:27:37.263 INFO:journalctl@ceph.mds.k.smithi099.stdout:Sep 19 09:27:37 smithi099 podman[70056]: 2024-09-19 09:27:37.160900306 +0000 UTC m=+0.585543433 container remove 49fce7ac9a0343660ba03d58a023e05087f3dfda728dc43e2d3c5e4d256cb8ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:27:37.368 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:27:37.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:37.400 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:27:37.400 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:27:37.400 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:27:37.710 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:27:37 smithi115 systemd[1]: Stopping Ceph mds.c for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:37.968 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:27:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:27:37.763+0000 7f62dbecb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:37.968 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:27:37 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c[64780]: 2024-09-19T09:27:37.763+0000 7f62dbecb640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:27:40.856 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:27:40 smithi115 podman[69584]: 2024-09-19 09:27:40.566895836 +0000 UTC m=+2.976890903 container died 045bf3231bd945312534f4344dc929fe8298a9da754b7813c4fa3142f16037de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T09:27:41.181 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:27:40 smithi115 podman[69584]: 2024-09-19 09:27:40.954815954 +0000 UTC m=+3.364811011 container cleanup 045bf3231bd945312534f4344dc929fe8298a9da754b7813c4fa3142f16037de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T09:27:41.181 INFO:journalctl@ceph.mds.c.smithi115.stdout:Sep 19 09:27:40 smithi115 bash[69584]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:27:41.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:27:41.360 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:41.360 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:27:41.360 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:27:41.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:27:41.710 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:27:41 smithi115 systemd[1]: Stopping Ceph mds.f for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:41.710 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:27:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f[64475]: 2024-09-19T09:27:41.681+0000 7f686928f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:41.710 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:27:41 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f[64475]: 2024-09-19T09:27:41.681+0000 7f686928f640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:27:44.827 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:27:44 smithi115 podman[69718]: 2024-09-19 09:27:44.562538729 +0000 UTC m=+2.984423004 container died 35e80748627eab84d0b8ad191087e1d4af44db5a54b884f8b79968a36d9f0d97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:27:45.201 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:27:44 smithi115 podman[69718]: 2024-09-19 09:27:44.924377388 +0000 UTC m=+3.346261676 container cleanup 35e80748627eab84d0b8ad191087e1d4af44db5a54b884f8b79968a36d9f0d97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:27:45.201 INFO:journalctl@ceph.mds.f.smithi115.stdout:Sep 19 09:27:44 smithi115 bash[69718]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:27:45.350 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:27:45.384 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:45.384 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:27:45.385 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:27:45.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:27:45.960 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:45 smithi115 systemd[1]: Stopping Ceph mds.i for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:45.960 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:27:45.702+0000 7fdd30053640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:45.960 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:45 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i[65086]: 2024-09-19T09:27:45.702+0000 7fdd30053640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:27:48.710 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:48 smithi115 podman[69837]: 2024-09-19 09:27:48.57042062 +0000 UTC m=+2.974968107 container died 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:27:49.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:49 smithi115 podman[69837]: 2024-09-19 09:27:49.019622493 +0000 UTC m=+3.424169980 container cleanup 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:27:49.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:49 smithi115 bash[69837]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:27:49.210 INFO:journalctl@ceph.mds.i.smithi115.stdout:Sep 19 09:27:49 smithi115 podman[69850]: 2024-09-19 09:27:49.195583627 +0000 UTC m=+0.618543851 container remove 1e4d6b948a8f44b09abdbaa2f5554f4bbf941e13e3b93335bf02c9f5c0cf9a3a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:27:49.437 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:27:49.470 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:49.470 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:27:49.470 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:27:49.471 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:27:49.710 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:27:49 smithi115 systemd[1]: Stopping Ceph mds.l for a514acda-7666-11ef-bceb-c7b262605968... 2024-09-19T09:27:50.210 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:27:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l[64174]: 2024-09-19T09:27:49.796+0000 7f24bec7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:27:50.210 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:27:49 smithi115 ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l[64174]: 2024-09-19T09:27:49.796+0000 7f24bec7e640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:27:52.899 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:27:52 smithi115 podman[69958]: 2024-09-19 09:27:52.56767296 +0000 UTC m=+2.876159878 container died ddd13913a268c5c7cfc69128f44cf8f8ae94ff672cbe020ddc74e352d19c120e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:27:53.199 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:27:52 smithi115 podman[69958]: 2024-09-19 09:27:52.997359318 +0000 UTC m=+3.305846235 container cleanup ddd13913a268c5c7cfc69128f44cf8f8ae94ff672cbe020ddc74e352d19c120e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:27:53.199 INFO:journalctl@ceph.mds.l.smithi115.stdout:Sep 19 09:27:52 smithi115 bash[69958]: ceph-a514acda-7666-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:27:53.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a514acda-7666-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:27:53.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:27:53.446 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:27:53.446 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a514acda-7666-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:27:53.658 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:27:56.237 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a514acda-7666-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:27:56.443 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting cluster with fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:27:58.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a514acda-7666-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:27:59.118 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:28:01.516 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:01.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:01.584 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:01.616 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:28:01.618 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi046/crash 2024-09-19T09:28:01.619 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:28:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:28:01.657 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:28:01.659 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi099/crash 2024-09-19T09:28:01.660 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:28:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:28:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:28:01.713 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi115/crash 2024-09-19T09:28:01.714 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:28:01.751 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/a514acda-7666-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:28:01.751 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:28:01.753 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:28:01.753 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:28:01.797 INFO:teuthology.orchestra.run.smithi046.stdout:2024-09-19T09:20:48.099355+0000 mds.h (mds.4) 2 : cluster [WRN] Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/48eeea67-3676-48df-8ba4-ca3da54965ee/client.0/tmp/xfstests-dev/src/log-writes) see mds.h log and `damage ls` output for details 2024-09-19T09:28:01.798 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T09:28:01.799 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:28:01.799 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:28:01.842 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:28:01.845 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:28:01.867 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:28:01.867 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2024-09-19T09:28:01.867 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:28:01.868 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:28:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:28:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:28:01.872 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:28:01.873 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:28:01.873 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:28:01.873 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:28:01.873 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:28:01.873 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:28:01.873 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:28:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:28:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-09-19T09:28:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:28:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:28:01.884 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:28:01.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log: 83.0% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:28:01.886 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:28:01.889 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:: No such file or directory 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:28:01.890 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr: 83.0% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr: 90.5% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.l.log: 90.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:28:01.891 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:28:01.892 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:28:01.892 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.y.log: 92.5% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:28:01.892 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 91.0% --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:28:01.892 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:28:01.893 INFO:teuthology.orchestra.run.smithi046.stderr: 90.9% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:28:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:28:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:28:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.d.log: 94.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:28:01.893 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:28:01.893 INFO:teuthology.orchestra.run.smithi046.stderr: 90.7% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:28:01.895 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log: 90.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:28:01.895 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:28:01.895 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:28:01.896 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.6% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:28:01.896 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:28:01.897 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:28:01.900 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:28:01.901 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:28:01.904 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.h.log: /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:28:01.906 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:28:01.925 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:28:01.927 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:28:01.940 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:28:02.135 INFO:teuthology.orchestra.run.smithi046.stderr: 90.3% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:28:02.215 INFO:teuthology.orchestra.run.smithi099.stderr: 94.9% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:28:02.219 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:28:02.262 INFO:teuthology.orchestra.run.smithi046.stderr: 94.6% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:28:02.269 INFO:teuthology.orchestra.run.smithi115.stderr: 94.9% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:28:02.291 INFO:teuthology.orchestra.run.smithi046.stderr: 95.1% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:28:02.312 INFO:teuthology.orchestra.run.smithi115.stderr: 91.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:28:02.641 INFO:teuthology.orchestra.run.smithi046.stderr: 90.4% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:28:04.813 INFO:teuthology.orchestra.run.smithi099.stderr: 96.0% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:28:05.159 INFO:teuthology.orchestra.run.smithi115.stderr: 94.7% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:28:05.730 INFO:teuthology.orchestra.run.smithi046.stderr: 92.7% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:28:06.298 INFO:teuthology.orchestra.run.smithi099.stderr: 94.6% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:28:06.598 INFO:teuthology.orchestra.run.smithi046.stderr: 91.9% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:28:07.547 INFO:teuthology.orchestra.run.smithi115.stderr: 94.7% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:28:07.878 INFO:teuthology.orchestra.run.smithi115.stderr: 94.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:28:07.961 INFO:teuthology.orchestra.run.smithi099.stderr: 92.2% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:28:08.363 INFO:teuthology.orchestra.run.smithi099.stderr: 92.4% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:28:09.074 INFO:teuthology.orchestra.run.smithi115.stderr: 91.7% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:28:09.684 INFO:teuthology.orchestra.run.smithi046.stderr: 92.1% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:28:10.619 INFO:teuthology.orchestra.run.smithi115.stderr: 91.8% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:28:11.899 INFO:teuthology.orchestra.run.smithi115.stderr: 91.5% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:28:12.075 INFO:teuthology.orchestra.run.smithi115.stderr: 91.4% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:28:12.077 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-19T09:28:12.077 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m10.218s 2024-09-19T09:28:12.077 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m50.021s 2024-09-19T09:28:12.077 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m1.491s 2024-09-19T09:28:13.046 INFO:teuthology.orchestra.run.smithi099.stderr: 91.6% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:28:14.007 INFO:teuthology.orchestra.run.smithi099.stderr: 92.0% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:28:16.257 INFO:teuthology.orchestra.run.smithi046.stderr: 91.4% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:28:16.258 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-19T09:28:16.259 INFO:teuthology.orchestra.run.smithi046.stderr:real 0m14.403s 2024-09-19T09:28:16.259 INFO:teuthology.orchestra.run.smithi046.stderr:user 0m31.578s 2024-09-19T09:28:16.259 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m1.012s 2024-09-19T09:28:28.624 INFO:teuthology.orchestra.run.smithi099.stderr: 93.5% -- replaced with /var/log/ceph/a514acda-7666-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:28:28.626 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-19T09:28:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m26.767s 2024-09-19T09:28:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:user 1m8.048s 2024-09-19T09:28:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.124s 2024-09-19T09:28:28.627 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:28:28.627 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi046/log 2024-09-19T09:28:28.628 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:28:33.936 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi099/log 2024-09-19T09:28:33.937 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:28:43.491 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi115/log 2024-09-19T09:28:43.493 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:28:50.777 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:28:50.778 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a514acda-7666-11ef-bceb-c7b262605968 --force 2024-09-19T09:28:50.992 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:28:51.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a514acda-7666-11ef-bceb-c7b262605968 --force 2024-09-19T09:28:51.506 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting cluster with fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:28:51.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a514acda-7666-11ef-bceb-c7b262605968 --force 2024-09-19T09:28:52.040 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: a514acda-7666-11ef-bceb-c7b262605968 2024-09-19T09:28:52.524 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:28:52.525 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:52.545 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:52.562 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:28:52.578 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:28:52.578 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:28:52.591 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:28:52.592 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:28:52.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:28:52.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:28:52.717 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:28:52.729 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:28:52.729 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:28:52.732 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:28:52.734 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:28:52.747 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:28:52.747 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:28:52.748 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:28:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:28:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-19T09:28:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +1213us[+1214us] +/- 66ms 2024-09-19T09:28:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -1969us[-1967us] +/- 53ms 2024-09-19T09:28:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +1525us[+1527us] +/- 89ms 2024-09-19T09:28:52.752 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 +1182us[+1015us] +/- 66ms 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -2002us[-2002us] +/- 53ms 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +1478us[+1478us] +/- 89ms 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:28:52.754 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-19T09:28:52.755 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +1166us[+1161us] +/- 66ms 2024-09-19T09:28:52.755 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -2003us[-2008us] +/- 53ms 2024-09-19T09:28:52.755 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +1492us[+1488us] +/- 89ms 2024-09-19T09:28:52.755 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:28:52.755 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:28:52.766 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:28:52.766 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:28:52.777 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:28:52.882 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:28:52.951 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:28:53.017 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:28:53.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:28:53.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:28:53.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:28:53.078 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:28:53.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:28:53.106 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:28:53.116 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:28:53.188 INFO:teuthology.task.internal:Duration was 1621.876375 seconds 2024-09-19T09:28:53.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:28:53.201 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:28:53.202 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:28:53.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:28:53.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:28:53.244 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:28:53.246 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:28:53.246 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:28:53.754 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:28:53.754 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-09-19T09:28:53.755 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:28:53.779 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T09:28:53.779 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:28:53.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-09-19T09:28:53.817 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:28:53.837 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:28:53.838 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:28:53.840 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:28:53.859 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:28:53.904 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:28:53.904 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:28:53.910 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:28:53.927 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:28:54.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:28:54.873 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:28:54.873 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:28:54.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:28:54.928 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:28:54.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:28:54.966 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:28:54.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:28:54.970 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:28:54.989 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-09-19T09:28:54.993 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-19T09:28:55.019 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-09-19T09:28:55.054 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:28:55.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:28:55.070 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:28:55.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:28:55.086 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:28:55.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:28:55.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:28:55.121 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:28:55.122 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi046 2024-09-19T09:28:55.123 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:28:55.179 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi099 2024-09-19T09:28:55.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:28:55.218 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911893/remote/smithi115 2024-09-19T09:28:55.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:28:55.256 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:28:55.257 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:28:55.259 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:28:55.262 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:28:55.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:28:55.319 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:28:55.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:28:55.330 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:28:55.330 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:28:55.333 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:28:55.335 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:28:55.346 INFO:teuthology.orchestra.run.smithi046.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:28 /home/ubuntu/cephtest 2024-09-19T09:28:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:28 /home/ubuntu/cephtest 2024-09-19T09:28:55.360 INFO:teuthology.orchestra.run.smithi115.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:28 /home/ubuntu/cephtest 2024-09-19T09:28:55.361 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:28:55.376 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:28:55.403 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsx}} duration: 1621.876374721527 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T09:28:55.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:28:55.491 INFO:teuthology.run:FAIL